DE102015208337A1 - WORKING ENVIRONMENT OF A MACHINE VISIBILITY SYSTEM FOR A PART PROGRAM IN WHICH A CONTINUOUS DATA STREAM OF IMAGE PROCESSING IS PERFORMED IN A RUNNING MODE - Google Patents

Abstract

In a machining environment of a machine vision system for a parts program, a continuous data stream of image acquisition operations is executed in a run mode. Previously, a continuous stream of image capture operations was achieved by using various programming representations and syntax to program and group image capture operations in the part program. A new common syntax and representations are used wherein such continuous image acquisition operations are recorded as normal operations, with the run of the part program being performed in two phases. First, the portion of the part program that is to have the continuous image capture data stream is examined for image capture operations, and the most efficient order for capturing the images is determined. Second, while the image acquisition process is being performed, the part program part is re-examined, and then the image analysis operations are performed.

Description

CROSS REFERENCE TO RELATED APPLICATION

The present application is a continuation-in-part of US Patent Application No. 13 / 297,220, filed on Nov. 15, 2011, the disclosure of which is hereby incorporated by reference in its entirety.

FIELD OF THE INVENTION

The present disclosure relates generally to machine vision inspection systems and, more particularly, machining environments for part programs that include continuous high speed image capture in such systems.

BACKGROUND

Precise machine vision inspection systems (or "vision systems" for short) can be used to obtain precise dimensional measurements of inspected objects and to inspect various other object features. Such systems may include a computer, a camera and an optical system, and a precision work table that is movable in multiple directions for the camera to scan the features of a workpiece being inspected. An exemplary prior art system that is commercially available is the QUICK VISION® series of PC-based vision systems and the QVPA® software available from Mitutoyo America Corporation (MAC) of Aurora, IL. The features and operation of the QUICK VISION ^® vision system series and the QVPAK ^® software are described, for example, in "QVPAK 3D CNC Vision Measuring Machine User's Guide", published in January 2003 , and "QVPAK 3D CNC Vision Measuring Machine Operation Guide", published in September 1996 , which are hereby incorporated by reference in their entirety, are generally described. This product, as exemplified by the QV302 Pro model, is capable of using a microscope-type optical system to provide images of a workpiece at various magnifications and to move the worktable as needed around the workpiece surface cross the boundaries of any single video image. A single video image typically includes only a portion of the workpiece being viewed or inspected, given the desired magnification, measurement resolution, and physical size limitations of such systems.

Machine vision inspection systems generally use an automated video inspection. The U.S. Patent No. 6,542,180 teaches various aspects of such an automated video inspection and is hereby fully incorporated by reference. As taught in the '180 patent, automated video inspection gauges generally have a programming capability that allows an automatic inspection event sequence for each particular workpiece configuration to be defined by the user. This may be implemented, for example, by text-based programming or a record mode that gradually "learns" the inspection event sequence by a sequence of machine control statements corresponding to a sequence of inspection operations performed by a user through a graphical user interface or a combination of both methods are executed. Such a recording mode is often referred to as a "learning mode" or "training mode". Once the inspection event sequence has been defined in the "learning mode", such a sequence can then be used to automatically capture (and additionally analyze or inspect) images of a workpiece in "run mode".

Video tools (or "tools" for short) and other graphical user interface features can be manually used to perform manual inspection and / or machine control operations (in "manual mode"). Their setup parameters and their operation can also be recorded in the learning mode to create automatic inspection programs or "part programs". For example, video tools may include edge / edge detection tools, autofocus tools, shape or pattern matching tools, dimension measurement tools, and the like. Other graphical user interface features may include dialog boxes relating to data analysis, loopback programming, and the like. For example, such tools are commonly used in many commercially available machine vision inspection systems, such as in the aforementioned series QUICK VISION ^® vision systems and related software QVPAK ^®.

The machine control instructions that include the specific inspection event sequence (ie, how each image is to be captured and how each captured image is to be analyzed / inspected) are generally stored as a "part program" or "part program" specific to the particular workpiece configuration. For example, a part program defines how each image is to be captured, such as how the camera is to be positioned with respect to the workpiece, at which illumination level, at which magnification level, etc. Furthermore, the parts program defines how to capture a captured image analyze / inspect using, for example, one or more video tools, such as edge / edge detection video tools. The ability to create part programs with instructions that perform a predetermined sequence of inspection operations provides several benefits, including improved inspection repeatability, as well as the ability to automatically execute the same part program repeatedly on one or more compatible machine vision inspection systems.

For universal machine vision inspection systems, which are intended to be fast programmed for many different workpieces as VISION ^® are represented by PC-based vision systems by the aforementioned series QUICK, it was common for imaging processes with image analysis processes and / or feature inspection operations interspersed that were executed on the last captured image (referred to herein as "interspersed" operations). However, there is an increasing demand for universal machine vision inspection systems to provide higher throughput. According to one method, this may be accomplished by performing image acquisition while allowing continuous relative movement between the camera and the workpiece table (as opposed to temporarily stopping and starting the relative movement necessary for interspersed operations), thereby increasing inspection throughput is significantly increased. Such operations are referred to as continuous operations. It is advantageous that such systems include strobe lighting to help capture images during continuous motion without blurring the image.

Fast "on-the-fly" vision inspection systems used in fast assembly lines have provided a continuous operation image capture. However, such tracking vision systems are typically dedicated to a single production line and repeatedly capture the "same" image for successive workpieces e.g. B. on a conveyor system. In such cases, the parameters of moving speed and strobe lighting, etc. are the same for each picture. Further, the workpiece configurations and / or the image acquisition parameters, etc. are rarely changed. Thus, the programming techniques for such systems have not facilitated rapid programming for an unlimited variety of workpieces, camera positions, image acquisition parameters, etc. by relatively untrained users.

In contrast, experience has shown that it is essential for universal vision machine vision systems to facilitate rapid programming for an infinite variety of workpieces, camera positions, image acquisition parameters, etc. by relatively untrained users. Previous programming methods for universal vision machine vision systems have not made programming continuous operations easy and fast enough. Further, previous programming techniques have not made programming continuous operations combined with interspersed operations simple or fast enough. Systems and methods of programming that can solve these problems and disadvantages either separately or in combination would be desirable.

An exemplary prior art method that overcomes some of these problems and disadvantages is disclosed in U.S.P. U.S. Patent No. 7,590,276 which is hereby incorporated by reference in its entirety. As described in the '276 patent, a part programming method is provided that allows a user to readily define multiple image capture operations interspersed with associated image analysis operations during learning mode operations in a natural and intuitively understandable relationship. Then, in the resulting part program, image acquisition operations for at least some of the images are automatically rearranged to a continuous operation image capture sequence that captures images and "intersperses" images to increase the throughput of the machine vision inspection system.

However, a disadvantage of certain prior programming methods, such as that illustrated in the '276 patent, is that the continuous data stream of image acquisition operations typically accomplished by analyzing various operations entered by the user in the learning mode, and by changing or "regrouping" their order in the part program instructions using "regrouped" programming representations and syntax such that the image capture instructions were grouped to capture a plurality of images using one continuous motion and their respective image analysis instructions were regrouped or "regrouped""To follow the image capture instructions so that the image analysis operations did not have to enforce or interrupt fast image capture in continuous operation. Then, when the part program instructions were fetched for editing or viewing, the image analysis instructions were separated from the capture instructions for their corresponding image. This has proved confusing to the users of such systems by providing the related image capture and analysis instructions with "unrelated" intermediate image capture and image processing instructions which is not intuitive and results in poor efficiency and errors when a user attempts to read or edit the "reordered" part program instructions. In other words, the reordered programming representations and the syntax for grouping the image acquisition operations in the part program have made programming and editing such part programs more difficult for users. There is a need for part programming syntax and machining operations and features that address these and other shortcomings to enable more efficient, more intuitive, and more flexible programming and editing of continuous imaging subprograms for precise vision machine vision systems.

SUMMARY

This summary is provided to provide a selection of concepts in a simplified form, which are described in more detail below in the detailed description. This summary is not intended to identify key features of the claimed subject matter, nor is it intended to be used as an aid in determining the scope of the claimed subject matter.

In various embodiments, a machining environment for a precision machine vision system for a part program is provided in which a continuous or continuous sequential stream of image acquisition operations is performed in a run mode. The precise machine vision inspection system includes an imaging section, a work table for holding one or more workpieces in a field of view (FOV) of the imaging section, a control section, a display, and a user interface.

In various embodiments, the machine vision inspection system further includes a learn mode operable to receive user input to control the operations of the machine vision inspection system and to record instructions corresponding to the controlled operations to create a part program. The learning mode is also operable to edit the part program and execute previously recorded part program instructions according to a machining execution mode. In some embodiments, the learning mode may include user interface features, such as a user-controllable data stream mode instructing element and an editable part program representation of part program instructions. The user-controllable data stream mode instruction item may be useable to designate a data stream mode segment that includes a segment of a part program designated for data stream mode execution. In various embodiments, the data stream mode implementation may include performing image acquisition operations in a sequential order during a continuous operation sequence, wherein the work table and imaging portion move continuously or approximately continuously relative to one another to capture at least two images. The editable parts program representation includes representations of image capture instructions that correspond to image capture operations, representations of image analysis instructions that correspond to image analysis operations, and may include a representation of a data stream mode segment in some embodiments.

In various embodiments, the machine vision inspection system includes a run mode that is operable to execute a previously created part program. The run mode generally includes a data stream execution mode for executing at least some of the part program instructions. In some embodiments, where data stream mode segments are defined in a part program, the run mode may be a non-data stream mode for executing part program instructions that are not in a defined data stream mode segment, and the data stream mode for executing part program instructions that are in one defined data stream mode segment include. In some embodiments, the non-stream execution mode executes the image capture instructions and the corresponding image analysis instructions of the first plurality of part program instructions that are not in a data stream mode segment to perform the image capture operations and the corresponding image analysis operations in a manner consistent with first order is compatible.

In various embodiments, the learn mode is configured such that the editable part program representation represents a first plurality of part program instructions that include image capture and corresponding image analysis instructions in a first order that corresponds to an order in which the corresponding controlled operations were performed to program the part program create. In addition, the learning mode is further configured such that the machining execution mode executes the image acquisition instructions and the corresponding image analysis instructions of the part program of the first plurality of part program instructions to perform the image acquisition operations and the corresponding image analysis operations in a manner consistent with the first order independently , if she first plurality of image capture and corresponding image analysis instructions of the part program are included in a data stream mode segment (if defined).

In various embodiments, the run mode is configured such that the data stream mode executes the first plurality of image capture and corresponding image analysis instructions of the part program in a second order (eg, by default or in some embodiments if included in a defined data stream mode segment) , In one embodiment, the second order includes executing the first plurality of image capture instructions of the part program to perform their respective image capture operations in a sequential order, regardless of performing the corresponding image analysis operations. In addition, the second order may further include executing the first plurality of image analysis instructions of the part program to perform their respective image analysis operations after their corresponding images have been acquired. In one embodiment, the execution of the image analysis operations after their corresponding images are captured occurs during the sequential order of the image acquisition operations.

In some embodiments where the machine vision inspection system includes strobe lighting or other means to enable rapid image exposure without blurring, the imaging operations are performed in a sequential order during a true continuous operation sequence with the work table and imaging portion continuously in proportion move (eg, the worktable moves continuously relative to the imaging section). In some configurations, the worktable movement may be operable to spatially move a workpiece in a horizontal plane (eg, an XY plane), but not move the imaging section, whereas the worktable movement may be operable to move the imaging section in a vertical direction (eg, a Z-direction), but not the workpiece. In other configurations, the worktable movement may be operable to spatially move a workpiece in a horizontal direction (eg, an X direction), but not the imaging section, whereas the worktable movement may be operable to move the imaging section in another horizontal direction (For example, a Y-direction) and a vertical direction (eg, a Z-direction) to move, but not the workpiece. In various embodiments, the image capture operations are performed in a continuous operation sequence for at least two images. In other embodiments, where the machine vision inspection system does not include strobe lighting or otherwise requires slowing or temporarily stopping the relative motion to limit image blur, image acquisition operations may be performed in sequential order during an approximately continuous operation sequence. The approximate steady state sequence may include motion that prevents image blur (eg, slowing down or temporarily stopping the actual continuous operation as dictated by image capture requirements), but does not include the motion delays associated with performing image analysis or the like.

In various embodiments, the execution of the image analysis operations after their corresponding images are captured occurs at least in part during the sequential order of the image acquisition operations.

In some embodiments, the learning mode is configured such that when a part program including a data stream mode segment is retrieved for editing, the editable part program representation is displayed in the first order, and the editing execution mode displays the image acquisition operations and the corresponding image analysis operations in a manner which is consistent with the first order. According to another aspect of the present disclosure, the learning mode is configured such that a user can select an instruction representation of the part program included in a data stream mode segment as a place to initiate the editing execution mode of the corresponding part program instructions after the following part program instructions performed in a manner consistent with the first order. In accordance with another aspect of the present disclosure, the subsequent part program instructions are executed in a manner consistent with the first order.

In some embodiments, the data stream mode segment comprises a first set of instructions and a second set of instructions, wherein the first set of instructions comprises first image capture instructions and first image analysis instructions that include video tool instructions of a first video tool, and wherein the second Set of instructions includes second image capture instructions and second image analysis instructions that include video tool instructions of a second video tool, wherein in edit execution mode the first Image capture instructions and the first image analysis instructions comprising video tool instructions of a first video tool are executed before commencing the execution of the second image capture instructions and the second image analysis instructions comprising video tool instructions of the second video tool. In the run mode, the data stream mode segment is executed in the data stream mode due to the data stream mode instructing element, and in the run execution mode of the data stream mode segment, the first and second image capturing instructions become the video tool in a sequential order regardless of the execution of the respective first and second image analysis operations Execute statements of the first and second video tools. According to another aspect of the present disclosure, the first and second video tools include edge detection video tools.

In some embodiments, the parts program further comprises a non-stream mode segment, and in the learning mode, the non-stream mode segment is distinguished from the stream mode segment due to a missing stream mode instruction element for the non-stream mode segment, wherein the non-stream mode Segment comprises a third set of instructions and a fourth set of instructions, the third set of instructions comprising third image capture instructions and third image analysis instructions comprising video tool instructions of a third video tool, and wherein the fourth set of instructions include fourth image capture instructions and fourth image analysis instructions comprising video tool instructions of a fourth video tool, wherein in the edit execution mode, the third image capture instructions and the third image analysis instructions comprising video tool instructions of the third video tool are executed before off the fourth image capture instructions and the fourth image analysis instructions, which include video tool instructions of the fourth video tool, are started. In the run mode, the non-stream mode segment is executed due to the absence of a data stream mode instruction element for the non-stream mode segment in the non-stream mode, and during the stream mode execution of the non-stream mode segment, the third and fourth image capture instructions become in a sequential order regardless of the execution of the corresponding third and fourth image analysis operations that include video tool instructions of the third and fourth video tools.

In some embodiments, when a part program including a data stream mode segment is fetched for editing, the editable part program representation is displayed in the first order, and the edit execution mode performs the image capture operations and the corresponding image analysis operations in a manner consistent with the first Order is compatible.

In some embodiments, a user in learn mode may select any part program instruction in a data stream mode segment as a location to begin execution of the part program instructions, after which the subsequent part program instructions are executed in a manner consistent with the first order.

In some embodiments, the data stream mode segment includes a first set of instructions and a second set of instructions. The first set of instructions includes first image capture statements and first Image analysis instructions that include video tool instructions of a first video tool, whereas the second set of instructions include second image capture instructions and second image analysis instructions that include video tool instructions of a second video tool. In one embodiment, in the edit execution mode, first image capture instructions and first image analysis instructions that include video tool instructions of the first video tool are executed, prior to executing the second image capture instructions and the second image analysis instructions, the video tool instructions of the second video tool include, is started. Then, in the run mode, the data stream mode segment is executed based on the data stream mode instructing element in the data stream mode. In the run mode of the data stream mode segment, the first and second image capture instructions are executed in a sequential order regardless of the execution of the respective first and second image analysis operations including video tool instructions of the first and second video tools. In one embodiment, the first and second video tools include edge detection video tools.

In some embodiments, the parts program further includes a non-stream mode segment, and in the learning mode, the non-stream mode segment is separated from the stream mode segment by the absence of a stream mode instruction element for the non-stream mode segment. In one embodiment, the non-data stream segment includes a third set of instructions and a fourth set of instructions. The third set of instructions includes third image capture instructions and third image analysis instructions that include video tool instructions of a third video tool, while the fourth set of instructions includes fourth image capture instructions and fourth image analysis instructions that include video tool instructions of a fourth video tool , In the editing execution mode, the third image capture instructions and the third image analysis instructions, which include video tool instructions of the third video tool, are executed before executing the fourth image capture instructions and the fourth image analysis instructions that include video tool instructions of the fourth video tool , is started. Then, in the run mode, the non-stream mode segment is executed due to the lack of a stream mode instruction element for the non-stream mode segment in the non-stream mode. During the run execution mode of the non-stream mode segment, the third and fourth image capturing instructions are executed in a sequential order regardless of the execution of the respective third and fourth image analysis operations including video tool instructions of the third and fourth video tools.

In some embodiments, in the learn mode, the first and second sets of instructions are executed in the first order, wherein at least some of the first and second image capture instructions are interspersed with video tool instructions of the first video tool and the second video tool be displayed on the user interface in the first order. In run mode, then, in the data stream mode, the part program instruction corresponding to the data stream mode segment is processed to determine an image capture routine including the image capture instructions of the first and second sets of instructions but not the video tool instructions, the image capture routine is to capture the images are executed and the video tool instructions are executed while the image capture routine is running.

In some embodiments, during run mode in the data stream mode, at least a portion of the execution of the video tool instructions during the second pass through the data stream mode segment occurs in parallel with the execution of the image capture routine.

In some embodiments, in run mode, during the execution of the image capture routine, a plurality of the image capture instructions are executed in series, meanwhile, any video tool instructions that were interspersed in the learn mode are not yet executed, so that the instructions are executed in the second order, which is different than the first order.

In some embodiments, in the running mode, when the image acquisition routine is performed, the work table and the imaging section move continuously relative to each other to capture the images.

In some embodiments, the data stream mode segment of the part program is identified by predetermined representations of data stream mode instructions at the beginning and at the end of the data stream mode segment.

In some embodiments, in the learn mode, the part program instructions in the data stream mode segment displayed in a part program representation are made to look identical to similar part program instructions that are outside of the data stream mode segment so that a user has no other programming representation or syntax must be used when programming or editing operations that are within the data stream mode segment, rather than outside the data stream mode segment.

Although the preceding summary has emphasized embodiments that include an explicit mark or indication of the data stream mode segment, marking of the data stream mode segment and / or detection of a separate mode or stream of operations may be incomprehensible or inconsequential to particular users , For example, the data stream mode execution may be available on all machines owned by a user, and / or may be the default or only execution mode used for the run execution mode on a machine, so that it may not be necessary to perform data stream mode operations for special recognition or Distinction to be distinguished. In some embodiments, some or all of the data stream mode compatible instructions and / or operations may be automatically performed in data stream mode during the run mode. For some implementations, this may be the default or only run-execution mode setting. In other implementations, the user may select either the data stream or non-data stream mode execution as the global "automatic" run mode execution mode.

In any event, it should be understood that whether or not the data stream mode instructions are explicitly tagged in a user interface or defined in a part program to indicate data stream mode execution in run mode, many or all of the features and benefits of the illustration and Execution of the non-data stream Edit mode for users in the learning mode and / or editing operations remain desirable, as described below with reference to 6A . 6B and 7 will be described in more detail.

DESCRIPTION OF THE DRAWINGS

The foregoing aspects and many of the attendant advantages of the present disclosure will become more readily appreciated as the same becomes better understood by reference to the following detailed description when considered in conjunction with the accompanying drawings. Show it:

1 a diagram showing various typical components of a universal precision machine vision inspection system;

2 a block diagram of a control system section and a visual component section of a machine vision inspection system, similar to that 1 and comprising features according to the present disclosure;

3 a diagram of a processing interface comprising a representation of a part program comprising a data stream mode segment, for which a continuous stream of image acquisition operations in a run mode is executed;

4 a diagram of a user interface, which includes a part of a workpiece on which the part program steps from 3 be executed;

5A and 5B Flowcharts of an embodiment of a routine for providing a part program processing environment that includes a data stream mode segment;

6A and 6B Flowcharts of one embodiment of a routine for implementing an embodiment, wherein a part program may be executed using a data stream mode of operations in the run mode, whereas a "non-data stream" edit mode may be used for display and execution in the learning mode; and

7 a time diagram 700 , which identifies one aspect of a non-data stream or edit execution mode as compared to a data stream execution mode.

DETAILED DESCRIPTION

1 FIG. 10 is a block diagram of an exemplary machine vision inspection system. FIG 10 which is useful according to the methods described herein. The machine vision inspection system 10 includes a vision measuring machine 12 Operationally connected to data and control signals with a control computer system 14 exchange. The control computer system 14 is also operably connected to provide data and control signals with a monitor or display 16 , a printer 18 a joystick 22 , a keyboard 24 and a mouse 26 exchange. The monitor or the display 16 may indicate a user interface suitable for the operations of the machine vision inspection system 10 to control and / or to program.

The sight measuring machine 12 includes a movable workpiece table 32 and an optical imaging system 34 which may include a zoom lens or interchangeable lenses. The zoom or replaceable lenses generally provide various magnifications for the images produced by the optical imaging system 34 to be provided. The machine vision inspection system 10 is generally comparable to the previously discussed series QUICK VISION ^® vision systems and software QVPAK ^® and similar commercially available precision machine vision inspection systems from the prior art. The machine vision inspection system 10 is also transferred to the jointly U.S. Pat. Nos. 7,454,053 . 7,324,682 . 8,111,938 and 8,111,905 which are hereby incorporated by reference in their entirety.

2 Fig. 10 is a block diagram of a control system section 120 and a visual component section 200 a machine vision inspection system 100 similar to the machine vision inspection system 1 and includes features according to the present disclosure. As will be described in more detail below, the control system section 120 used to view the visual component section 200 to control. The visual component section 200 includes an optical assembly section 205 , the light sources 220 . 230 and 240 and a work piece table 210 , the middle transparent section 212 having. The workpiece work table 210 is controllably movable along the X and Y axes which lie in a plane which is generally parallel to the surface of the work table on which a workpiece 20 can be positioned. The optical assembly section 205 includes a camera system 260 , a replaceable objective lens 250 and can be a turret lens assembly 280 include the lenses 286 and 288 having. As an alternative to the turret lens assembly, a fixed or manually replaceable magnification change lens or a zoom lens configuration or the like may be included. The optical assembly portion 205 is along a Z-axis, which is orthogonal to the X and Y axes, using a controllable motor 294 controllably movable.

A workpiece 20 or a tray or fastener that holds a variety of workpieces 20 using the machine vision inspection system 100 are to be imaged, is on the workpiece work table 210 placed. The workpiece work table 210 can be controlled to be relative to the optical package section 205 to move so that the interchangeable objective lens 250 between points on a workpiece 20 and / or between a plurality of workpieces 20 emotional. One or more of a work table lamp 220 , a coaxial light 230 and a surface light 240 each emit or emit output light 222 . 232 or 242, around the work piece (s) 20 to illuminate. The output light is called workpiece light 255 through the interchangeable objective lens 250 and the revolver lens assembly 280 goes, reflects or passes through and is picked up by the camera system 260 collected. The picture of the workpiece (s) 20 that from the camera system 260 is recorded on a signal line 262 to the control system section 120 output. The light sources 220 . 230 and 240 can each have signal lines or buses 221 . 231 and 241 to the control system section 120 be connected. To change the image magnification, the control system section may 120 the turret lens assembly 280 along the axis 284 turn over to a signal line or a bus 281 to select the revolver lens.

In various embodiments, the optical assembly section 205 in the direction of the vertical Z-axis in relation to the workpiece table 210 using a controllable motor 294 which drives an actuator, a connection cable or the like movable to the optical assembly section 205 move along the z-axis to the focal point of the image taken by the camera system 260 is added to change. As used herein, the term Z-axis refers to the axis that is intended to be used to focus the image that is from the optical assembly section 205 is achieved. As far as it is used is the controllable engine 294 via a signal line 296 to an input / output interface 130 connected.

As in 2 The control system section includes 120 in various embodiments, a controller 125 , the input / output interface 130 , a store 140 , a device for generating and executing workpiece programs 170 and a power supply section 190 , Each of these components, as well as the additional components described below, may be interconnected by one or more data / control buses and / or application programming interfaces, or by direct connections between the various elements.

In various embodiments according to the present disclosure, the apparatus includes generating and executing workpiece programs 170 a processing section 172 which provides or activates various operations and user interface features relating to the processing of a part program, as described in more detail below. It is understood that the terms "workpiece program" and "part program" can be used interchangeably here. In general, the processing section includes 172 a machining operation controller 174 , which controls the operations for the editing functions, and a machining interface 176 which provides the user interface features for the editing functions. The device for generating and executing workpiece programs 170 also includes a data stream mode section 178 , which provides various features associated with the present disclosure, as described in more detail below.

As in 2 shown includes the input / output interface 130 an imaging control interface 131 , a motion control interface 132 , a lighting control interface 133 and a lens control interface 134 , The motion control interface 132 can be a position control 132a and a speed / acceleration control element 132b Although such elements may be merged and / or indistinguishable. The lighting control interface 133 includes lighting controls 133a to 133n for example, the selection, the power, the on / off switch and optionally the strobe pulse timing for the various corresponding light sources of the machine vision inspection system 100 Taxes.

The memory 140 includes an image file storage section 141 , a part program storage section 142 which may include one or more part programs or the like, and a video tool section 143 , The video tool section 143 includes the video tool section 143a and other video tool sections (e.g., 143 m) that determine the GUI, the image processing operation, etc. for each of the corresponding video tools. Many known video tools are in commercially available machine vision inspection systems included, such as in the aforementioned series QUICK VISION ^® vision systems and related software QVPAK ^®. The video tool section 143 also includes a device for generating interest areas (ROI) 143x , which supports automatic, semi-automatic, and / or manual operations that define various ROIs that are operational in various video tools included in the Video Tools section 143 are included.

In general, the memory section stores 140 Data that is usable to the vision system component section 200 to use to take a picture of the workpiece 20 absorb or capture, so that the captured image of the workpiece 20 has desired image characteristics. The storage section 140 may also store inspection result data, may also store data usable to the machine vision inspection system 100 to operate various inspection and measurement operations on the captured images (eg, partially implemented as video tools), either manually or automatically, and the results via the I / O interface 130 issue. The storage section 140 can also contain data that defines a user interface through the I / O interface 130 is operational.

The signal lines or buses 221 . 231 and 241 each of the work table lamp 220 , the coaxial light 230 and the surface light 240 are all connected to the I / O interface 130 connected. The signal line 262 from the camera system 260 and the signal line 296 from the controllable engine 294 are to the I / O interface 130 connected. In addition to carrying image data, the signal line can 262 a signal from the controller 125 lead, which initiates the image capture.

One or more display devices 136 (eg the ad 16 out 1 ) and one or more input devices 138 (eg the joystick 22 , the keyboard 24 and the mouse 26 out 1 ) can also be sent to the I / O interface 130 be connected. The display devices 136 and the input devices 138 may be used to use a user interface that may include various user interface features to perform inspection operations and / or to create and / or modify part programs to view the images produced by the camera system 260 and / or around the vision system component section 200 directly to control.

When a user in various embodiments, the machine vision inspection system 100 used to create a part program for the workpiece 20 The user generates part program instructions either by explicitly coding the instructions automatically, semi-automatically or manually, using a workpiece programming language and / or by generating the instructions by operating the machine vision inspection system 100 in a learning mode to provide a desired image capture training sequence. For example, a training sequence may include positioning a workpiece feature in the field of view (FOV), adjusting light levels, focusing or autofocusing, capturing an image, and providing an analysis training sequence that is applied to the image (eg, using video tools). is applied. The learn mode functions to capture or record the sequence (s) and translate them into corresponding part program steps (ie instructions). When the parts program is executed, these part program steps cause the machine vision inspection system to render the trained image acquisition and analysis operations around one or more workpieces 20 to automatically inspect the workpiece that was used when the part program was created.

Related processing features and functions are also described in the patent applications entitled "Machine Vision System Program Editing Environment Including Real Time Context Generation Features." US Publication No. 2013/0123945 ); "Machine Vision System Program Editing Environment Including Synchronized User Interface Features" (preliminary US Publication No. 2013/0125044 ); "System and Method Utilizing An Editing Initialization Block In A Part Program Environment A Machine Vision System" (preliminary US Publication No. 2013/0120567 ), each filed concurrently herewith and hereby incorporated by reference.

3 is a diagram of a processing interface 300 , which includes various measurement and / or process selection bars, such as the selection bar 310 , and an editable representation of a part program 320 which corresponds to various part program instructions and an illustration of a non-data stream segment 330 and an illustration of a data stream mode segment 340 includes. The representation of the non-stream mode segment 330 comprises a set of instruction representations of the part program 331 and 332 , and the representation of the data stream mode segment 340 comprises a set of instruction representations of the part program 341 to 349 , The data stream mode segment 340 is a segment of the parts program 320 , which is designated for data stream mode execution, as described in more detail below. The operation of the specific part program instructions 331 to 349 will be described below with reference to 4 described in more detail.

4 is a diagram that has a user interface 400 includes a field of view window 410 with a section of a workpiece 415 maps. The user interface 400 also includes various measurement and / or process selection bars, such as the selection bars 420 and 440 , a real-time XYZ (position) coordinate window 430 , a light control window 450 and a video tool parameter box 460 , As will be described in more detail below, various features will be attached to the workpiece 415 according to the related part program instructions 3 certainly.

The following description will be made with reference to both the instruction representations of the part program 321 to 350 out 3 as well as the corresponding actions regarding the workpiece 415 out 4 , As in 3 shown, the part program starts 320 with the instruction presentations 321 . 331 and 332 indicating the prolog node where the lights are set and the worktable is moved to the desired location. Regarding 4 would be the setting of the lights with respect to the illumination in the field of view window 410 visible, and the movement of the work table would be in the field of view window 410 visible and would be in the real-time XYZ (position) coordinate window 430 specified. As will be described in more detail below, the instruction representations 331 and 332 Part of the representation of the non-data stream segment 330 to look at in the picture 3 the representation of the data stream mode segment 340 follows. It should be understood that although for purposes of illustration, the illustration of the non-data stream segment 330 has been designed to include only two instruction representations, in a more detailed embodiment may include a plurality of instruction representations, such as representations of video tool instructions, etc., as described in more detail below.

The statement representation 341 is a data stream mode instruction element that is the beginning of the data stream mode segment 340 designated. The statement representation 341 for example, by enabling the data stream mode section 178 via a menu selection in a program menu 360 be inserted. The statement representations 342 . 343 . 344 and 345 then indicate that the magnification is set, the track smoothing is switched off, the permissible movement is set and the lights are set.

The statement representation 346 then indicates that a circle tool is opened to measure a circle C1 as indicated by the corresponding instruction representations 346A to 346C specified. More specifically, the instruction representation 346A means for measuring (e.g., including movement of the work table to a particular location and acquisition of a corresponding image) while the instruction representation 346B indicates the use of a circle tool to determine edge points of the circle C1 that is in the captured image. The functions and operations of the circle tools and other edge detection video tools are well known in the art and are described in more detail in the previously incorporated references. As in 4 shown is a circle tool in the field of view 410 as a circular feature (such as circle C1) on the workpiece 415 superimposed. The border points that are determined by the circle tool are then taken from the statement representation 346C used to define circle C1.

The instructions are similar 347 and 348 that the circle tools are opened to measure each of the circles C2 and C3 as indicated by the corresponding instruction representations 347A to 347C and 348A to 348C specified. More precisely, the statement statements give 347A and 348A means for measuring (e.g., including moving the work table to certain locations and acquiring corresponding images), whereas the instruction representations 347B and 348B specify the use of a circle tool to specify the edge points of circles C2 and C3 that are in the captured images. Regarding 4 indicates that the worktable would be moved such that the field of view window 415 would show the movement from the circular feature C1 to each of the circular features C2 and C3 for the acquisition of the corresponding images. The edge points that are determined by the circle tools are then taken from the statement representations 347C and 348C used to define circles C2 and C3. The statement representation 349 is a data stream mode instruction element which is the end of the data stream mode segment 340 designated. The statement representation 350 indicates the end of the part program.

With reference to the original creation of the parts program 320 part program instructions are recorded in the learning mode according to the user input (eg as provided via the user interface to control the operations of the machine vision inspection system). Subsequently, in a processing mode, the previously described instruction representations of the part program 321 to 350 in a processing interface, such as the editing interface 300 out 3 , provided to facilitate the corresponding part program instructions (eg, as written in a programming language) in a simplified manner Form for practical reasons and for ease of use. As will be described in more detail below, although the sequence of instruction representations of the part program 341 to 349 in the data stream mode segment 340 in edit mode in a first order (ie in the order in 3 1), in a run mode according to the present disclosure, the corresponding part program instructions may be executed in a second order.

More specifically, in one embodiment, the run mode includes a data stream execution mode applicable to identified data stream segments, and the data stream mode is configured such that the part program instructions corresponding to the representation of the data stream mode segment 340 are processed to identify the image capture operations contained in the data stream segment (e.g., a plurality of image capture operations). The image capture process for the plurality of images may begin as soon as this processing allows. Further, the part program instructions that are the representation of the data stream mode segment 340 are processed to identify the image analysis operations corresponding to the captured images, and the identified image analysis instructions (e.g., video tooling operations) can begin as soon as their corresponding images are captured, provided that this is not the sequence of image acquisition operations interrupts (for example, a continuous operation used to capture the images may continue regardless of the image analysis operations).

As a specific example, the order of operations of the part program 320 as follows. The statement representation 321 for the prolog node, as well as the instruction representations 331 and 332 for the adjustment of the luminaires and the movement of the worktable (which is part of the representation of the non-data-stream segment 330 are) are executed in the order shown. As previously described, once the statement representation 341 is reached, this gives the beginning of the presentation of the data stream mode segment 340 which data stream mode processing begins. In data stream mode, a first pass through the data stream mode segment occurs 340 to determine a list of image capture operations that will then be performed, and then a second pass to begin performing image analysis operations (e.g., video tooling operations).

More specifically, at the first pass through the data stream mode segment 340 In one embodiment, all the operations needed to capture images are added to the list for an image capture routine, whereas all operations that are not needed for image capture operations are ignored. In a specific embodiment, the instruction representations become 342 to 345 , which are all part of the facility of the machine vision inspection system for capturing the images, are thus added to the list of operations that are part of the image capture routine. In contrast, the instruction representation of the part program becomes 346 indicating that a circle measurement tool needs to be opened is not added to the list for the image acquisition routine because it is not necessary to capture the corresponding image. The statement representation 346A however, indicating a means for measuring, including walking to a position and taking a picture, is added to the list for the image acquisition routine. The statement representations 346B and 346C that involve running the circle tool and defining the circle are not necessary for image capture and are thus ignored instead of being added to the list. The instruction representation becomes similar 347 ignores the statement representation 347A is added to the list, the statement representations 347B . 347C and 348 are ignored, the statement representation 348A is added to the list and the statement representations 348B and 348C are ignored.

After the first pass through the data stream mode segment 340 after the image acquisition routine according to the instruction representations 342 to 345 . 346A . 347A and 348A has been determined, the execution of the image acquisition routine is started. Although the image capture routine is executed, a second pass through the data stream mode segment occurs 340 during which image analysis operations (such as video tool operations) are performed. During the second pass, in one embodiment, the instruction representations 342 to 345 that does not include image analysis operations, ignored. The statement representation 346 , which indicates that a circular measurement is to be opened, is executed.

The statement representation 346A is a special case indicating both image capture and image analysis operations, as described in more detail below. In short, during the second pass, the instruction representation 346A , which previously indicated image acquisition operations, also indicates that an image is to be loaded, which is an image analysis process, and is thus executed. More specifically, if the image is from the statement representation 346A is already detected by the image acquisition routine started as stated above, then the image is loaded. If the picture is not captured yet was, then the process for the second pass is temporarily stopped until the image is detected by the image acquisition routine. Thus, as by the instruction representation 346A For example, certain instruction representations indicate operations that occur during both the first and second passes through the data stream mode segment 340 be executed.

After executing the statement representation 346A the second pass goes to the instruction screens 346B and 346C which are executed to execute the circle tool and to define the circle C1 according to the boundary points determined by the circle tool. The instruction representation becomes similar 347 executed, and the instruction representation 347A to load the corresponding image of the circle C2 is executed if the image has been acquired by the image acquisition routine, and is waited if the image has not yet been acquired. After executing the statement representation 347A become the statement representations 347B . 347C and 348 executed, the statement representation 348A is executed if the corresponding image is available or otherwise waited if the image has not yet been captured. After executing the statement representation 348A become the statement representations 348B and 348C executed, the statement representation 349 the end of the data stream mode segment 340 and indicates the end of the data stream mode. It should be understood that in one embodiment, additional instruction representations to the data stream mode segment 340 followed, which would be out of data stream mode and executed in the order shown according to the non-data stream mode, much like the instruction elements 331 and 332 of the non-data stream segment 330 ,

It will be appreciated that the above-described operations and processing environment for a data stream mode segment are advantageous over certain prior art implementations. Specifically, in some prior implementations, an explicit list of commands was used for image capture, and another explicit list of commands was used to parse the images that were captured. To achieve continuous operation image capturing at the time of programming, the image capturing instructions were organized into a separate list and were in other programming representations and syntax in the part program. This made it difficult to process and "debug" the corresponding part programs. Specifically, when a user returned to a part program where operations had to be rearranged and other programming representations and syntax were used for continuous image capture, it was more confusing to determine how to edit or rewrite the statements that were inside instead of outside the continuous mode image acquisition routine. In addition, part program debugging was even more complicated in that there was no readily visualized representation of the steps originally performed, making it harder to determine which statements caused which results.

In accordance with the present disclosure as described above, a more desirable editing environment is provided in which the instruction representations of the part program may be provided in their original order. Further, instruction representations are within a data stream mode segment (eg, data stream mode segment 340 ) to have an identical appearance to those outside a data stream mode segment. As a specific example, when the statement representations 346 . 346A . 346B and 346C outside the data stream mode segment 340 (eg within the non-data stream segment 330 ), they would have an identical look in the editing interface 300 except for the fact that the representation in the statement representation 341 Would be included. This is unlike the prior art methods described above in which such instruction representations would be provided in a different programming representation and syntax within a data stream mode segment as compared to outside. As described above, the representation of the parts program allows 320 as in the editing interface 300 It also illustrates the sequential execution of part program debugging itself within the data stream mode segment 340 , More specifically, during a debug process (eg, in edit mode), a user may select that the instruction representations within the data stream mode segment 340 in the first order (ie, in the order shown in the edit view 300 which is the order in which they were originally programmed, in a step-by-step process to simplify the determination of which statement statements cause which results.

5A and 5B are flowcharts 500A and 500B an embodiment of a routine for providing a part program processing environment that includes a data stream mode segment. As in 5A shown is in a block 510 provided a learning mode operable to allow user input received to control the operations of the machine vision inspection system and record instructions that correspond to the controlled operations to create a part program. The learning mode is also operable to edit a part program and execute previously recorded part program instructions according to a machining execution mode.

In a block 520 Features of the user interface are provided that include a user-controllable data stream mode instruction item and editable part program representation of part program instructions. The user-controllable data stream mode instruction item is usable to designate a data stream mode segment that includes a segment of a part program designated for data stream mode execution. The editable parts program representation may include representations of image capture instructions that correspond to image capture operations, representations of image analysis instructions that correspond to image analysis operations, and an illustration of the data stream mode segment.

In a block 530 provided a run mode operable to execute a previously created part program, the run mode being a non-data stream mode for executing part program instructions that are not in a data stream mode segment and a data stream mode for executing part program instructions that are in one Data stream mode segment includes. From the block 530 the routine continues to point A, as described below with reference to FIG 5B will be described in more detail.

As in 5B As shown, the routine moves from point A to one block 540 continued. In the block 540 For example, the learn mode is configured such that the editable part program representation represents a first plurality of part program instructions that include image capture and corresponding image analysis instructions in a first order that corresponds to an order in which the corresponding controlled operations were performed to build the part program. The learning mode is further configured such that the editing execution mode executes the part program instructions to include the image acquisition operations and the corresponding image analysis operations in a manner consistent with the first order regardless of whether the first plurality of part program instructions are included in a data stream mode segment or not.

In a block 550 For example, the run mode is configured such that the data stream mode executes the first plurality of part program instructions when contained in a data stream mode segment according to a second order. The second order includes executing the first plurality of image acquisition instructions of the part program to perform their respective image acquisition operations in a sequential order regardless of the execution of the corresponding image analysis operations. In one embodiment, the image capture operations may be performed in sequential order during a continuous operation sequence. The second order further comprises executing the first plurality of image analysis instructions of the part program to perform their respective image analysis operations after their corresponding images have been acquired.

Although the preceding summary has emphasized embodiments that include an explicit mark or indication of the data stream mode segment, marking of the data stream mode segment and / or detection of a separate mode or stream of operations may be incomprehensible or inconsequential to particular users , For example, the data stream mode execution may be available on all machines owned by the user and / or may be the default or only execution mode used for the run execution mode on a machine, so that it may not be necessary to have one or more data stream mode operations to distinguish for special recognition or consideration. Therefore, representations and code marks of the data stream mode user interface, such as part program representation 341 , omitted in some embodiments; for example, in various embodiments similar to those described below with reference to FIG 6 . 7A and 7B to be discribed. For example, in some embodiments, some or all of the data stream mode compatible instructions and / or operations may be automatically performed in data stream mode during the run mode. For some implementations, this may be the default or only run-execution mode setting. In other implementations, the user may select either the data stream or non-data stream mode execution as the global "automatic" run mode execution mode.

In any event, it should be understood that whether or not the data stream mode instructions are explicitly tagged in a user interface or defined in a part program to indicate data stream mode execution in run mode, many or all of the features and benefits of the illustration and Execution of the non-data stream editing mode for the users in the learning mode and / or machining operations for the reasons mentioned above remain desirable.

To summarize such an embodiment, a precise machine vision inspection system may include an imaging section, a work table for holding one or more workpieces in a field of view (FOV) of the imaging section, a control section, a display, and a user interface. The machine vision inspection system may further include a learn mode operable to receive user input to control the operations of the machine vision inspection system and to record instructions corresponding to the controlled operations to create a part program that is operable to execute a part program and operable to execute previously recorded part program instructions according to a processing execution mode. The learn mode may include features of a user interface that include editable part program representation of part program instructions that include representations of image capture instructions that correspond to image capture operations, and representations of image analysis instructions that correspond to image analysis operations. The machine vision inspection system may further include a run mode operable to execute a previously created part program, the run mode including a data stream mode for executing part program instructions. The learn mode may be configured such that the editable part program representation represents a first plurality of part program instructions that include image capture and corresponding image analysis instructions in a first order that corresponds to an order in which the corresponding controlled operations were performed to create the part program. and the execution execution mode executes the image acquisition instructions of the part program and the corresponding image analysis instructions of the first plurality of part program instructions to perform the image acquisition operations and the corresponding image analysis operations in a manner consistent with the first order. The run mode may be configured such that the data stream mode executes the first plurality of part program instructions according to a second order, the second order executing the first plurality of image capture instructions of the part program to perform their respective image capture operations in a sequential order independent of the execution of the corresponding image analysis operations and executing the first plurality of image analysis instructions of the part program to perform their respective image analysis operations after their corresponding images are acquired.

6A and 6B are flowcharts 600A and 600B an embodiment of a routine for implementing an embodiment consistent with the one discussed immediately above, wherein a part program may generally be executed using a data stream mode of operations in run mode, while a more user friendly "non-data stream" edit mode for display and execution in the Learning mode can be used.

As in 6A shown is in a block 610 provided a learn mode operable to receive user input to control the operations of the machine vision inspection system and record instructions corresponding to the controlled operations to create a part program. The learning mode is also operable to edit a part program and execute previously recorded part program instructions according to a machining execution mode. In a block 620 Features of the user interface are provided that include an editable parts program representation of part program instructions. The editable part program representation may include representations of image capture instructions that correspond to image capture operations, and representations of image analysis instructions that correspond to image analysis operations. In a block 630 provided is a run mode operable to execute a previously created part program, the run mode comprising a data stream mode for executing part program instructions. From the block 630 the routine proceeds to a point A, as described below with reference to FIG 6B will be described in more detail.

As in 6B As shown, the routine moves from point A to one block 640 continued. In the block 640 For example, the learn mode is configured such that the editable part program representation represents a first plurality of part program instructions that include image capture and corresponding image analysis instructions in a first order that corresponds to an order in which the corresponding controlled operations were performed to build the part program. The learning mode is further configured such that the editing execution mode executes the part program instructions to perform the image acquisition operations and the corresponding image analysis operations in a manner consistent with the first order. In a block 650 the run mode is configured such that the data stream mode is the first plurality of Execute part program instructions according to a second order. The second order includes executing the first plurality of image acquisition instructions of the part program to perform their respective image acquisition operations in a sequential order regardless of the execution of the corresponding image analysis operations. In one embodiment, the image capture operations may be performed in sequential order during a continuous operation sequence. The second order may further include executing the first plurality of image analysis instructions of the part program to perform their respective image analysis operations after their corresponding images have been acquired.

In one embodiment, executing the first plurality of image capture instructions of the part program to perform their respective image capture operations in a sequential order may include performing image capture operations during a continuous image capture sequence, wherein the work table and the imaging section move approximately continuously relative to each other Capture images with the exception of image capture motion necessary to limit image blur at imaging sites and without motion delays due to image analysis operations. For example, with reference to the in 3 shown part program 320 during the operations, the statement representation 346A For example, means for measuring may include moving the work table to a certain location and detecting a corresponding image while either stopping or slowing the motion sufficiently to limit image blur. A similar move can be used for the operations that follow the statement views 347A and 348A correspond.

The foregoing description has emphasized embodiments in which the machine vision inspection system includes strobe lighting or other means to enable rapid image exposure without blurring during data stream mode execution of a part program. In such systems, the imaging operations may be performed in a sequential order during a true continuous operation sequence, wherein the work table and the imaging section move continuously relative to one another without stopping. However, in other embodiments where the machine vision inspection system lacks strobe lighting or otherwise requires the relative movement to be slowed down or temporarily stopped to limit image blurring, the imaging operations may be performed in the sequential order during data stream mode execution. while an approximate continuous operation sequence is used, and the essential advantages discussed above can be retained. In various embodiments, the approximate steady state sequence may then include the necessary motion events that prevent image blur (eg, slowing or temporarily stopping the otherwise continuous motion as dictated by image capture requirements), but does not include motion delays with respect to Performing image analysis or the like to reduce or minimize the overall execution time of the part program during data stream mode execution. This thought is related to 7 clarified.

7 is a time chart 700 , which is one aspect of one embodiment of a non-stream or edit execution mode 710 and one embodiment of the data stream mode implementation 740 features. The time sequence associated with the non-stream or edit execution mode 710 linked, does not specify a sequential image capture sequence. Instead, first an image capture process 720A which may include operations in which a work table and the imaging section move relative to one another to bring a feature into view of the imaging system, provide the image illumination, and so on, as necessary to capture an image. After the image capture process 720A becomes an image analysis process 730A performed on this captured image, the operations such as edge detection based on an image during the image acquisition process 720A is detected. After the image analysis process 730A is finished, becomes an image capture process 720B executed (eg analogous to the process 720A ), and after completion, an image analysis process 730B executed. This pattern continues with the image acquisition processes 720C and 720D and the image analysis operations 730C and 730D and so on. Each image analysis process can interrupt and delay subsequent image capture. Such an embodiment is advantageous and easily understood in the learning mode when user actions are necessary to define the image acquisition parameters and the image analysis results must be evaluated to confirm that a desirable image has yielded the expected analysis results before proceeding to the next part program operation to define or verify. In such a case, the image analysis time does not significantly delay the entire learning mode process, which is typically organized by user input and evaluation and the like.

In contrast, there is the time sequence associated with the stream execution mode 740 linked, a sequential image capture sequence. First, an image capture process 720A ' similar to the image capture process 720A in this example, and may include operations in which a work table and the imaging section move relative to each other to bring a feature into view of the imaging system, provide the image illumination, and so on, as necessary Capture image. After the image capture process 720A ' is finished, the image acquisition process 720B ' Immediately initiated and executed because the motion between the image capture sites is typically one of the more time consuming in an inspection sequence and controls the overall throughput. The following image acquisition procedures 720C ' . 720D ' and so on follow a similar pattern for this reason and form a sequential image capture sequence. In modern computers, the image analysis operations corresponding to a particular image may be initiated virtually at any time after the image has been captured and / or stored in memory. In this example, the image analysis process 730A ' which may include operations (eg, similar or with the image analysis operations 730A identical), such as an Edge Detect Analysis for an edge appearing in the image of Process 720A ' is included immediately after the image acquisition process 720A ' is completed, and is parallel to the image capture process 720B ' executed. The following image analysis procedures 730B ' . 730C ' . 730D ' and so on, follow a similar pattern. The result is an improvement in the time that the data stream execution mode 740 requires the same number of image acquisition and analysis operations as compared to the non-stream or edit execution mode 710 perform.

In embodiments where the machine vision inspection system includes strobe lighting or other means to enable rapid image exposure without blurring, the image acquisition operations are performed in a sequential order during the data stream mode 740 during a true continuous operation sequence, wherein the work table and the imaging section move continuously relative to one another. This is the ideal case and typically results in the shortest execution times. In embodiments where the machine vision inspection system lacks strobe lighting, or otherwise requires the relative movement to be slowed or temporarily stopped to limit image blur, the image sensing operations may be performed in the sequential order in data stream mode 740 during an "approximately continuous" motion sequence. The approximate steady state sequence may include motion that prevents image blur (eg, slowing or temporarily stopping the otherwise continuous motion as dictated by image capture requirements), but does not include motion delays associated with performing image analysis or the like. The data stream mode implementation in such an embodiment is still advantageous. Experimental results show that an exemplary part program on a non-data-stream or "conventional" machine vision inspection system that collects 16 images in a 4 × 4 matrix with 1 mm increments in the XY plane, using the data stream mode 740 running about 40% faster than if it is the non-stream or edit execution mode 710 even if it temporarily pauses or becomes much slower during performing image acquisition operations in a sequential order during an approximately continuous image capture sequence. Thus, in general, various embodiments contemplated herein may include performing image acquisition operations during a continuous image acquisition sequence that includes at least one of: (a) operations wherein the work table and the imaging portion for capturing the images move continuously relative to each other, or (b) Operations in which the work table and imaging section for capturing the images move approximately continuously with respect to each other, except for image capture motion operations necessary to limit image blur at imaging sites and without motion delays due to image analysis operations.

While various preferred and exemplary embodiments of the present disclosure have been illustrated and described, it will be understood that various changes may be made therein without departing from the spirit and scope of the present disclosure.

QUOTES INCLUDE IN THE DESCRIPTION

This list of the documents listed by the applicant has been generated automatically and is included solely for the better information of the reader. The list is not part of the German patent or utility model application. The DPMA assumes no liability for any errors or omissions.

Cited patent literature

• US 6542180 [0004]
• US 7590276 [0010]
• US 7454053 [0044]
• US 7324682 [0044]
• US 8111938 [0044]
• US 8111905 [0044]
• US 2013/0123945 [0056]
• US 2013/0125044 [0056]
• US 2013/0120567 [0056]

Cited non-patent literature

• "QVPAK 3D CNC Vision Measuring Machine User's Guide", published in January 2003 [0003]
• "QVPAK 3D CNC Vision Measuring Machine Operation Guide", published September, 1996 [0003]

Claims (33)

A precision machine vision inspection system comprising an imaging section, a work table for holding one or more workpieces in a field of view (FOV) of the imaging section, a control section, a display, and a user interface, the machine vision inspection system further comprising: a learning mode operable to receive user input to control the operations of the machine vision inspection system, and to record instructions corresponding to the controlled operations to create a part program operable to process a part program; is operable to execute prerecorded part program instructions according to a processing execution mode, the learning mode comprising user interface features comprising: a user-controllable data stream mode instruction item useable to designate a data stream mode segment comprising a segment of a part program designated for data stream mode execution; and an editable parts program representation of part program instructions comprising representations of image capture instructions that correspond to image capture operations, representations of image analysis instructions that correspond to image analysis operations, and a representation of the data stream mode segment; and a run mode operable to execute a previously created part program, the run mode being a non-data stream mode for executing part program instructions that are not in a data stream mode segment and a data stream mode for executing part program instructions that are in a data stream mode. Segment, includes, where the learning mode is configured such that: the editable part program representation represents a first plurality of part program instructions that include image capture and corresponding image analysis instructions in a first order that corresponds to an order in which the corresponding controlled operations were performed to create the part program; and the processing execution mode executes the image acquisition instructions of the part program and the corresponding image analysis instructions of the first plurality of part program instructions to perform the image acquisition operations and the corresponding image analysis operations in a manner consistent with the first order, irrespective of whether the first plurality of part program instructions in a data stream mode segment or not; and the run mode is configured such that: the data stream mode executes the first plurality of part program instructions when contained in a data stream mode segment according to a second order, the second order comprising: Executing the first plurality of image capturing instructions of the part program to perform their respective image capturing operations in a sequential order independently of the execution of the respective image analysis operations, and executing the first plurality of image analysis instructions of the part program to perform their respective image analysis operations after their corresponding images are captured. The system of claim 1, wherein the image acquisition operations are performed in a sequential order during a continuous operation sequence, wherein the work table and the imaging section for capturing the images move continuously relative to one another. The system of claim 1, wherein the image acquisition operations are performed in a sequential order during a continuous image acquisition sequence, wherein the work table and the image acquisition portion for acquiring the images move approximately continuously with respect to each other, except for image acquisition movement operations that are necessary limit image blur at imaging sites, and without motion delays due to image analysis operations. The system of claim 1, wherein the execution of the image analysis operations after their respective images have been captured occurs at least in part during the sequential order of image acquisition operations. The system of claim 1, wherein the non-stream execution mode executes the image capture instructions and the corresponding image analysis instructions of the first plurality of part program instructions that are not in a data stream mode segment to perform the image capture operations and the corresponding image analysis operations in a manner is compatible with the first order. The system of claim 1, wherein the learning mode is configured such that when a part program including a data stream mode segment is retrieved for editing, the editable part program representation is displayed in the first order, and the editing execution mode includes the image acquisition operations and the corresponding image analysis operations performs a manner consistent with the first order. The system of claim 1, wherein the learning mode is configured such that a user can select an instruction representation of the part program included in a data stream mode segment as a point for initiating the edit execution mode of corresponding part program instructions, after which the subsequent part program instructions are sorted and Be performed manner that is consistent with the first order. The system of claim 7, wherein the subsequent part program instructions are executed in a manner consistent with the first order. The system of claim 1, wherein the data stream mode segment comprises a first set of instructions and a second set of instructions, the first set of instructions comprising first image capture instructions and first image analysis instructions comprising video tool instructions of a first video tool, and the second set of instructions executes second image capture instructions and second image analysis instructions that include video tool instructions of a second video tool, wherein in the edit execution mode executes the first image capture instructions and the first image analysis instructions that comprise video tool instructions of the first video tool before commencing the execution of the second image capture instructions and the second image analysis instructions comprising video tool instructions of the second video tool; and in the run mode, the data stream mode segment is executed in data stream mode based on the data stream mode instructing element, and in the run execution mode of the data stream mode segment, the first and second image capture instructions in a sequential order independent of the execution of the respective first and second image analysis operations, the video tool mode. Instructions for the first and second video tools include. The system of claim 9, wherein the parts program further comprises a non-stream mode segment, and in the learning mode, discriminating the non-stream mode segment from the stream mode segment by the absence of a stream mode instruction element for the non-stream mode segment The non-stream mode segment comprises a third set of instructions and a fourth set of instructions, the third set of instructions comprising third image capture instructions and third image analysis instructions comprising video tool instructions of a third video tool, and the fourth set of instructions fourth image capture instructions and fourth image analysis instructions comprising video tool instructions of a fourth video tool, wherein in the edit execution mode, the third image capture instructions and the third image analysis instructions comprising video tool instructions of the third video tool are executed before using the Execution of the fourth image capture instructions and the fourth image analysis instructions that include video tool instructions of the fourth video tool are started; and in the run mode, the non-stream mode segment is executed due to the absence of a stream mode instruction element for the non-stream mode segment in the non-stream mode, and in the stream execution mode of the non-stream mode segment, the third and fourth frame captures are independent in a sequential order execution of the corresponding third and fourth image analysis operations including video tool instructions of the third and fourth video tools. The system of claim 9, wherein the first and second video tools comprise edge detection video tools. The system of claim 9, wherein in the learn mode, the first and second sets of instructions are executed in the first order, wherein at least some of the first and second image capture instructions are interspersed with the video tool instructions of the first video tool and the second video tool wherein the instructions are displayed on the user interface in the first order; and during the data stream mode run mode, processing the part program instruction corresponding to the data stream mode segment to determine an image capture routine that includes the image capture instructions of the first and second sets of instructions but not the video tool instructions, the image capture routine for capture the image is being executed, and while the image capture routine is running, the video tool instructions are being executed. The system of claim 12, wherein during the data mode mode run mode, at least a portion of the execution of the video tool instructions during the second pass through the data stream mode segment occurs in parallel with the execution of the image capture routine. The system of claim 12, wherein in run mode, during the execution of the image capture routine, a plurality of the image capture instructions are executed in sequence, meanwhile all video tool instructions interspersed in the learn mode have not been executed, so that the instructions in the second sequence which is different than the first order. The system of claim 12, wherein in the running mode, when the image acquisition routine is executed, the work table and the imaging section for capturing the images move continuously relative to each other. The system of claim 1, wherein the data stream mode segment of the part program is identified by data stream mode instruction representations at the beginning and at the end of the data stream mode segment. The system of claim 1, wherein in the learning mode, the part program instructions within the data stream mode segment displayed in a part program representation are caused to have an identical appearance to similar part program instructions that are outside the data stream mode segment, such that one user is not Programming or syntax must be used when programming or editing operations that are within the data stream mode segment, rather than outside the data stream mode segment. A method of operating a precision machine vision inspection system comprising an imaging section, a work table for holding one or more workpieces in a field of view (FOV) of the imaging section, a control section, a display, and a user interface, the method comprising the steps of: Providing a learn mode operable to receive user input to control operations of the machine vision inspection system and record instructions corresponding to the controlled operations to create a part program operable to process a part program and operable is to execute previously recorded part program instructions according to a processing execution mode, the learning mode comprising user interface features comprising: a user-controllable data stream mode instruction item useable to designate a data stream mode segment comprising a segment of a part program designated for data stream mode execution; and an editable parts program representation of part program instructions comprising representations of image capture instructions that correspond to image capture operations, representations of image analysis instructions that correspond to image analysis operations, and a representation of the data stream mode segment; Provide a run mode that is operable to execute a previously created part program, wherein the run mode comprises a non-data stream mode for executing part program instructions that are not in a data stream mode segment and a data stream mode for executing part program instructions that are in a data stream mode segment the learning mode is configured such that: the editable part program representation includes a first plurality of image capture and corresponding image analysis instructions of the part program in a first order corresponding to an order in which the corresponding controlled operations were performed to create the part program; and the processing execution mode executes the image acquisition instructions of the part program and the corresponding image analysis instructions of the first plurality of part program instructions to perform the image acquisition operations and the corresponding image analysis operations in a manner consistent with the first order, irrespective of whether the first plurality of part program image instructions in a stream mode segment is included; and the run mode is configured such that: the data stream mode executes the first plurality of part program instructions when contained in a data stream mode segment according to a second order, the second order comprising: Executing the first plurality of image capturing instructions of the part program to perform their respective image capturing operations in a sequential order independently of the execution of the respective image analysis operations, and executing the first plurality of image analysis instructions of the part program to perform their respective image analysis operations after their corresponding images are captured. The method of claim 18, wherein, when a part program including a data stream mode segment is retrieved for editing, the editable part program representation is displayed in the first order, and the editing execution mode executes the image acquisition operations and the corresponding image analysis operations in a manner that is compatible with the first order. The method of claim 18, wherein executing the first plurality of image capture instructions of the part program to perform their respective image capture operations in a sequential order, performing image capture operations during a continuous one An image acquisition sequence comprising at least one of: (a) operations in which the work table and the imaging section for acquiring the images move continuously relative to each other, or (b) processes in which the work table and the image acquisition section capture the image Move approximately continuously, with the exception of image capture motion necessary to limit image blur at imaging sites, and with no motion delays due to image analysis operations. A precision machine vision inspection system comprising an imaging section, a work table for holding one or more workpieces in a field of view (FOV) of the imaging section, a control section, a display, and a user interface, the machine vision inspection system further comprising: a learn mode operable to receive user input to control the operations of the machine vision inspection system and to record instructions corresponding to the controlled operations to create a part program operable to process a part program and operable is to execute previously recorded part program instructions according to a editing execution mode, the learning mode comprising user interface features comprising: an editable parts program representation of part program instructions comprising representations of image capture instructions that correspond to image capture operations and representations of image analysis instructions that correspond to image analysis operations; a run mode operable to execute a previously created part program, the run mode comprising a data stream mode for executing part program instructions, wherein the learning mode is configured such that: the editable part program representation represents a first plurality of part program instructions that include image capture and corresponding image analysis instructions in a first order that corresponds to an order in which the corresponding controlled operations were performed to create the part program; and the processing execution mode executes the image acquisition instructions of the part program and the corresponding image analysis instructions of the first plurality of part program instructions to perform the image acquisition operations and the corresponding image analysis operations in a manner consistent with the first order; and the run mode is configured such that: the data stream mode executes the first plurality of part program instructions according to a second order, the second order comprising: Executing the first plurality of image capturing instructions of the part program to perform their respective image capturing operations in a sequential order independently of the execution of the respective image analysis operations, and executing the first plurality of image analysis instructions of the part program to perform their respective image analysis operations after their corresponding images are captured. The system of claim 21, wherein the image acquisition operations are performed in a sequential order during a continuous image acquisition sequence comprising at least one of: (a) operations in which the work table and the imaging section for capturing the images move continuously relative to each other; b) Operations in which the work table and imaging section for capturing the images move approximately continuously, with the exception of image capture motion necessary to limit image blur at imaging sites, and without motion delays due to image analysis operations. The system of claim 21, wherein the execution of the image analysis operations after their respective images have been captured is performed at least in part during the sequential order of image acquisition operations. The system of claim 21, wherein the learning mode is configured such that when a part program executed using the data stream mode in the run mode is retrieved for editing, the editable part program representation is displayed in the first order, and the editing execution mode is the image capturing operations and perform corresponding image analysis operations in a manner consistent with the first order. The system of claim 21, wherein the part program executing using the data stream mode in run mode comprises a first set of instructions and a second set of instructions, the first set of instructions comprising first image capture instructions and first image analysis instructions that are video tooling. Comprise instructions of a first video tool, and the second set of instructions comprises second image capture instructions and second image analysis instructions comprising video tool instructions of a second video tool, wherein in the editing execution mode the first image capture instructions and the first image analysis instructions, the video tooling instructions Instructions of the first video Tools include executing before commencing the execution of the second image capture instructions and the second image analysis instructions comprising video tool instructions of the second video tool; and in the run mode, the part program is executed in the data stream mode, the first and second image capturing instructions being executed in a sequential order independent of the execution of the respective first and second image analysis operations comprising video tool instructions of the first and second video tools. The system of claim 25, wherein in the learn mode, the first and second sets of instructions are executed in the first order, wherein at least some of the first and second image capture instructions are interspersed with video tool instructions of the first video tool and the second video tool, wherein the instructions are displayed on the user interface in the first order; and in run mode, the part program instructions are processed to determine an image capture sequence or routine that includes the image capture instructions of the first and second sets of instructions, but not the video tool instructions, wherein the image capture sequence or the image capture routine is performed; and while the image capture sequence or routine is being executed, the video tool instructions are executed. The system of claim 21, wherein: the learning mode comprises user interface features further comprising a user controllable data stream mode instruction item useable to designate a data stream mode segment comprising a segment of a part program designated for data stream mode execution; the editable part program representation of part program instructions further comprises a representation of the data stream mode segment; the run mode further comprises a non-data stream mode for executing part program instructions that are not in a data stream mode segment in addition to the data stream mode used to execute part program instructions that are in a data stream mode segment; in the learning mode, the editing execution mode executes the part program image acquisition instructions and the corresponding image analysis instructions of the first plurality of part program instructions to perform the image acquisition operations and the corresponding image analysis operations in a manner consistent with the first order, irrespective of whether the first plurality of part program instructions in FIG a stream mode segment or not; and in the run mode, the data stream mode executes the first plurality of part program instructions according to the second order only under the condition that they are included in a data stream mode segment. A method of operating a precision machine vision inspection system comprising an imaging section, a work table for holding one or more workpieces in a field of view (FOV) of the imaging section, a control section, a display, and a user interface, the method comprising the steps of: providing a learn mode; operable to receive user input to control the operations of the machine vision inspection system and record instructions corresponding to the controlled operations to create a part program operable to process a part program and operable to execute prerecorded part program instructions according to a machining execution mode, the learning mode comprising user interface features comprising: an editable parts program representation of part program instructions that represent images of images instructions that correspond to image capture operations, and representations of image analysis instructions that correspond to image analysis operations; Providing a run mode operable to execute a previously created part program, the run mode comprising a data stream mode for executing part program instructions, the learn mode configured such that: the editable part program representation includes a first plurality of image capture and corresponding image analysis instructions of the part program in FIG a first order corresponding to an order in which the corresponding controlled operations were executed to create the part program; and the execution execution mode executes the image acquisition instructions of the part program and the corresponding image analysis instructions of the first plurality of part program instructions to perform the image acquisition operations and the corresponding image analysis operations in a manner consistent with the first order; and the run mode is configured such that: the data stream mode executes the first plurality of part program instructions according to a second order, the second order comprising: executing the first plurality of image capture instructions of the part program to obtain their perform respective image acquisition operations in a sequential order independently of the execution of the corresponding image analysis operations, and execute the first plurality of image analysis instructions of the part program to perform their respective image analysis operations after their respective images are acquired. The method of claim 28, wherein the image acquisition operations are performed in a sequential order during a continuous image acquisition sequence comprising at least one of: (a) operations in which the work table and the imaging section for capturing the images move continuously relative to each other; b) Operations in which the work table and imaging section for capturing the images move approximately continuously, with the exception of image capture motion necessary to limit image blur at imaging sites, and without motion delays due to image analysis operations. The method of claim 28, wherein the execution of the image analysis operations after their respective images have been captured occurs at least in part during the sequential order of image acquisition operations. The method of claim 28, wherein the learning mode is configured such that when a part program executed using the data stream mode in the run mode is retrieved for editing, the editable part program representation is displayed in the first order, and the editing execution mode is the image capturing operations and perform corresponding image analysis operations in a manner consistent with the first order. The method of claim 28, wherein the part program executing using the data stream mode in the run mode comprises a first set of instructions and a second set of instructions, the first set of instructions comprising first image capture instructions and first image analysis instructions that are video tooling. Comprise instructions of a first video tool, and the second set of instructions comprises second image capture instructions and second image analysis instructions comprising video tool instructions of a second video tool, wherein in the editing execution mode the first image capture instructions and the first image analysis instructions, the video tooling instructions Instructions of the first video tool are executed before starting the execution of the second image capture instructions and the second image analysis instructions comprising video tool instructions of the second video tool; and in the run mode, the part program is executed in the data stream mode, the first and second image capturing instructions being executed in a sequential order independent of the execution of the respective first and second image analysis operations comprising video tool instructions of the first and second video tools. The method of claim 32, wherein in the learn mode, the first and second sets of instructions are executed in the first order, wherein at least some of the first and second image capture instructions are interspersed with the video tool instructions of the first video tool and the second video tool wherein the instructions are displayed on the user interface in the first order; and in run mode the part program instructions are processed to determine an image capture sequence or routine comprising the image capture instructions of the first and second sets of instructions but not the video tool instructions, the image capture routine is executed to capture the images, and during the image capture routine is executed, the video tool instructions are executed.

Images