WO2004036898A2 - Improvements in and relating to imaging - Google Patents

Improvements in and relating to imaging Download PDF

Info

Publication number
WO2004036898A2
WO2004036898A2 PCT/GB2003/004486 GB0304486W WO2004036898A2 WO 2004036898 A2 WO2004036898 A2 WO 2004036898A2 GB 0304486 W GB0304486 W GB 0304486W WO 2004036898 A2 WO2004036898 A2 WO 2004036898A2
Authority
WO
WIPO (PCT)
Prior art keywords
light
specimen
image capture
capture device
excitation light
Prior art date
Application number
PCT/GB2003/004486
Other languages
French (fr)
Other versions
WO2004036898A3 (en
Inventor
Fedja Bobanovic
John Phillips
Shab Ladha
Patrick Courtney
Original Assignee
Perkinelmer Singapore Pte Ltd.
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Perkinelmer Singapore Pte Ltd. filed Critical Perkinelmer Singapore Pte Ltd.
Priority to CA2502701A priority Critical patent/CA2502701C/en
Priority to AU2003301487A priority patent/AU2003301487B2/en
Priority to KR1020057006667A priority patent/KR101160356B1/en
Priority to US10/531,007 priority patent/US8289620B2/en
Priority to DE60312717T priority patent/DE60312717T2/en
Priority to JP2004544480A priority patent/JP4829499B2/en
Priority to EP03756579A priority patent/EP1552333B1/en
Publication of WO2004036898A2 publication Critical patent/WO2004036898A2/en
Publication of WO2004036898A3 publication Critical patent/WO2004036898A3/en

Links

Classifications

    • GPHYSICS
    • G02OPTICS
    • G02BOPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B21/00Microscopes
    • GPHYSICS
    • G02OPTICS
    • G02BOPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B21/00Microscopes
    • G02B21/0004Microscopes specially adapted for specific applications
    • G02B21/002Scanning microscopes
    • G02B21/0024Confocal scanning microscopes (CSOMs) or confocal "macroscopes"; Accessories which are not restricted to use with CSOMs, e.g. sample holders
    • G02B21/0036Scanning details, e.g. scanning stages
    • G02B21/0044Scanning details, e.g. scanning stages moving apertures, e.g. Nipkow disks, rotating lens arrays
    • GPHYSICS
    • G02OPTICS
    • G02BOPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B21/00Microscopes
    • G02B21/0004Microscopes specially adapted for specific applications
    • G02B21/002Scanning microscopes
    • G02B21/0024Confocal scanning microscopes (CSOMs) or confocal "macroscopes"; Accessories which are not restricted to use with CSOMs, e.g. sample holders
    • G02B21/0052Optical details of the image generation
    • G02B21/0064Optical details of the image generation multi-spectral or wavelength-selective arrangements, e.g. wavelength fan-out, chromatic profiling
    • GPHYSICS
    • G02OPTICS
    • G02BOPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B21/00Microscopes
    • G02B21/0004Microscopes specially adapted for specific applications
    • G02B21/002Scanning microscopes
    • G02B21/0024Confocal scanning microscopes (CSOMs) or confocal "macroscopes"; Accessories which are not restricted to use with CSOMs, e.g. sample holders
    • G02B21/0052Optical details of the image generation
    • G02B21/0076Optical details of the image generation arrangements using fluorescence or luminescence
    • GPHYSICS
    • G02OPTICS
    • G02BOPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B21/00Microscopes
    • G02B21/0004Microscopes specially adapted for specific applications
    • G02B21/002Scanning microscopes
    • G02B21/0024Confocal scanning microscopes (CSOMs) or confocal "macroscopes"; Accessories which are not restricted to use with CSOMs, e.g. sample holders
    • G02B21/008Details of detection or image processing, including general computer control
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00Cameras or camera modules comprising electronic image sensors; Control thereof

Definitions

  • This invention concerns a method and apparatus by which luminescent elements of a specimen or sample can be imaged for analysis.
  • One system which is capable of providing such data about microscopic specimens such as cells and tissue samples is the UltraVIEW live Cell Imager as produced and supplied by Perkin Elmer Life Sciences.
  • This system uses a confocal laser microscope and CCD camera imaging system such as is described in a paper written by Kawamura Negishi Otsuki and Tomosada entitled Confocal Laser Microscope and CCD Camera, published in the Yokogawa Technical Report No. 33 (2002), English Edition and Yokogawa Patent No. EP 0539691 WO 9804946.
  • US 5034613 (Denk) describes another process, known as a 2 photon process, to limit the focal plane of activation and achieve confocality.
  • one pulse from the excitation source equates to rotation of the Nipkow disc(s).
  • transmission and reflective elements arranged in a random or quasi-random pattern can be used for confocal scanning as described in WO 97/31282 and WO 0043819 (Wilson et al). Again one complete scan of the transmission and reflective elements corresponds to the rotation of the Nipkow disc(s).
  • a scanning system in which excitation light passes to the specimen via a scanning system and light emitted by luminescence of the specimen passes in another direction via the scanning system to an image capture device having discrete spatially distinct light sensitive regions
  • the scanning system is operated so as to scan the whole of an area of interest of the specimen the excitation light and/or the image capture device are controlled so that light emitted from the specimen is only incident on the image capture device for a specific time period equal to that required for scanning the whole of the area of interest n times (where n is a whole number equal to or greater than 1).
  • the area of interest may be the whole of the viewable area of the specimen or a part thereof, and a window of variable size and location may be created by the scanning system to enable some or all of the area to be scanned, and for example a subarray of variable size and location may be used.
  • the scanning system comprises a rotating a Nipkow disc scanner in which excitation light passes through openings in the disc in one direction and light emitted by luminescence of the specimen passes through the openings in the opposite direction to form an image at the image capture device, and the pattern of openings is such that rotation of the disc through A 0 results in scanning the whole of the area of interest and the specific time period is selected to correspond to DA 0 of rotation of the disc (where ⁇ is a whole number equal to or greater than one).
  • the image capture device is a CCD camera.
  • a single Nipkow disc may be employed, but more preferably a 2-disc arrangement is employed, one containing openings and the other microlenses, as described in the Yokogawa Technical Report No. 33 (2002).
  • References herein to a disc (or disc means or disc arrangement) are intended to include multiple disc assemblies such as described in that Report, as well as single disc arrangements, where the context so admits.
  • one or more lensless discs may be used (for example as described in US Patent 6147798).
  • the rotation of the lensless disc corresponds to rotation of the Nipkow disc.
  • light may be scanned using a linear process such as a raster scanning technique, using one pinhole, or several pinholes in a fixed pattern (for example as described in US Patent 5248876 also WO 03/019242) where one complete linear scan of the pinholes corresponds to rotation of the Nipkow disc.
  • a linear process such as a raster scanning technique, using one pinhole, or several pinholes in a fixed pattern (for example as described in US Patent 5248876 also WO 03/019242) where one complete linear scan of the pinholes corresponds to rotation of the Nipkow disc.
  • a scanning slit scanner may be used (for example as described in US 6038076) where a scan of the slit corresponds to rotation of the Nipkow disc.
  • confocality may be achieved by a 2 photon process which limits the focal plane of activation (see as described in US Patent 5034613) where one pulse of the 2 photon excitation source corresponds to rotation of the Nipkow disc.
  • confocality may be obtained by a time delay multiplexed process (as described by Bewersdorf, Pick and Hell in a paper entitled “Multifocal Multiphoton Microscope” 1998 Opt Lett. 23(9): 655-657) where one complete scan of the pinholes corresponds to rotation of the Nipkow disc.
  • an array of independently controllable mirrors may be used to synthesise the pinholes (see for example EP 0911667 and US 2002,024007) where a complete scan using the mirrors, creates an image or subimage and corresponds to rotation of the Nipkow disc.
  • transmissive and reflective elements may be scanned (as described in WO 97/31282 and WO 0043819) where one complete scan of the transmissive and reflective elements corresponds to rotation of the Nipkow disc.
  • a scanning device is employed by which light is prevented from reaching the specimen except from an excitation source for each of a succession of separated specific periods of time, the image capture device is read out at the end of each said period of time and is reset prior to the beginning of the next said time period, and light from the source of excitation light is supplied for a time precisely equal to each said specific period of time and thereafter is extinguished, so that the duration of the image capture device exposure is controlled by the time for which the excitation light source is active.
  • the excitation light source is switched on and off to control the duration of the exposure.
  • shutter means may be provided to interrupt light from the excitation source except for when the specimen is to be scanned, and the excitation light source may be operated continuously or for longer periods of time than the said specific periods of time.
  • an intrinsic (electronic) shutter may be used.
  • a light chopper may be used to interrupt the excitation light.
  • an acousto-optic light interrupting element may be used.
  • Shutter means may be provided between the scanning system and the image capture device to prevent light reaching all or part of the capture device sensor, except for the specific periods of time during which the excitation light is incident on the specimen, thereby to reduce errors which could arise from light arising from phosphorescence, afterglow, stray reflections or other effects, from reaching the device.
  • shutter means are provided for both excitation source and image capture device, they are preferably synchronously operated such as by mechanical or electrical means, or electronic pseudo shutter means may be employed or any combination thereof.
  • the specimen is largely transparent it can be scanned and imaged at different spaced apart planes which are also preferably parallel to one another.
  • Multiple images may be collected over short periods of time (eg 1 minute-60 minutes) or extended periods of time (eg 24-72 hours) as well as intermediate periods (eg 1-24 hours). Such images are often referred to as a stack of images.
  • the method may thus involve relative movement between the specimen with and the scanning device. This may be achieved for example by displacing the scanning device along an axis (typically its Z axis) which is normal to the scanning plane to be imaged, so that the incident light can be brought to a focus at different points along that axis, each point lying in (and defining) a different focal plane, to enable the specimen to be scanned and imaged in different parallel spaced apart planes.
  • movement is restricted to periods during which at least excitation light is not incident on the specimen and/or to periods during which the image capture device is also insensitive to light from the specimen luminescence.
  • the optical path may be modified to define the different planes, by moving an objective lens or the specimen, typically by moving a holder containing the specimen.
  • a specimen carrier is displaced to define the spaced apart imaging planes.
  • the axis of displacement may be at an angle of other than 90° to the focal plane.
  • the Z-axis movement is performed at the end of each said time period, or after N successive such time periods (N being an integer equal to or greater than 1).
  • the movement may be such as to increase or decrease the distance between the scanning device or optical system element and the specimen.
  • Each Z-axis movement between exposures may be the same size or may differ from those before and/or following.
  • each Z-axis movement between exposures is preferably made in discrete steps, each of a predetermined equal size and in that event, each Z-axis movement between exposures may be made up of M discrete steps, (where M is a whole number equal to or greater than 1).
  • the Z-axis motion may be continuous. This allows faster motion between Z positions without having to wait for the Z mechanism to settle.
  • the disadvantage is that the Z position is varying during the imaging with the result that the image can be blurred in Z. However this may be compensated for by applying deconvolution to re-sharpen the image.
  • the method preferably includes the step of adjusting the time between exposures or controlling the illumination and image capture device exposure by reference to the Z-axis movement, such that excitation illumination and exposure is only initiated after a sufficient period of time has elapsed or after a desired Z-axis movement has been achieved.
  • the excitation light may be composed of light having two or more differing wavelengths.
  • the method preferably also includes the step of altering the excitation light wavelength between the end of one exposure and the beginning of the next.
  • stage of a microscope used in the system, and carrying a specimen may effect larger scale X or Y motions (10 micron to 10mm) to bring into view other portions of a sample such as for example other cells on the same slide or other regions of tissue or sample.
  • a number of samples may be held in the wells of a multiwell plate.
  • the samples may all be similar but may be different and may for example differ due to constituents, concentration or age.
  • the multiwell place may be mounted on a microscope stage which is moved so as to bring different wells into registry, or different parts of a single sample in one of the wells into registry.
  • the Z motion may be in one direction and then in another, alternately, to save time.
  • Wavelength variation may be achieved by employing two or more light sources of different peak wavelengths and selectively operating the sources, or selectively directing light from the sources in turn, as required, to the scanning device and specimen.
  • the light sources used may have more complex spectral characteristics (eg multiple peaks available from an Argon ion laser with a main line at 488nm, and additional lines at 476nm and 496nm).
  • the wavelengths may be selected by a single code (eg 2 lines to select one of 4 wavelengths as code 00, 01, 10, 11) or as a set of individual signal lines (eg 4 lines for 4 wavelengths). In this way several lines may be activated at the same time.
  • the excitation light may be obtained from one or more laser light sources.
  • the light source may comprise a directly driven laser diode.
  • a single light source which comprises an acousto optic tuneable filter (AOTF) crystal and the wavelength of the emitted light is altered by altering the frequency controlling signal to the crystal as required.
  • AOTF acousto optic tuneable filter
  • Such an arrangement may contain a single laser source, or two or more laser light sources whose outputs can be optically combined.
  • any alteration of the frequency of the controlling signal is effected between exposures.
  • the excitation light may be pulsed.
  • the excitation light may be polarised.
  • a luminescent or incandescent light source may be used as the source of excitation light, and an optical filter or a monochomator employed to control the wavelength of the light emitted by the source.
  • a light emitting diode (LED) source may be used which may comprise one or more light-emitting elements.
  • the method preferably involves the step of adjusting the intensity of the incident illumination between exposures.
  • This may for example be achieved by interposing neutral density filters, opening or closing an iris diaphragm in the light path, adjusting the power to the light source, employing an attenuating element such as an AOTF or LCD shutter or any combination thereof.
  • the intensity of the excitation light incident on the specimen at one wavelength is different from that at another wavelength, such as may be due to inherent intensity variation as between one source and another, or between different modes of operation of a controlled excitation light source
  • the intensity of the excitation illumination between one wavelength and another may be adjusted so as to provide a predetermined intensity of illumination at the specimen for each wavelength.
  • the power adjustment from one exposure to another as wavelength varies is such as to ensure a substantially similar level (ie intensity) of illumination at the specimen during the scanning making up each exposure, independent of wavelength.
  • a similar technique may be employed if the emission from the sample differs according to wavelength of the luminescence, and in order to render the emitted light of similar intensity (irrespective of wavelength), the power adjustment and/or attenuation from one exposure to another may also, or instead, be adjusted to provide substantially constant intensity luminescence irrespective of the wavelength thereof.
  • a system performing a method embodying the invention is controlled from a single control means such as a control centre which typically includes a programmable computer and one or more interfaces for converting signals produced by the computer into signals suitable for driving, or controlling, the supply of power to drives, or to control power to devices to effect the movements and rotations required by the different steps of the method.
  • a control centre typically includes a programmable computer and one or more interfaces for converting signals produced by the computer into signals suitable for driving, or controlling, the supply of power to drives, or to control power to devices to effect the movements and rotations required by the different steps of the method.
  • a preferred mage capture device is a CCD camera.
  • Such a camera can provide a picture signal in analogue or digital format.
  • Preferably a camera is selected which produces a picture signal in digital format.
  • the image capture device is a CCD camera, it is preferably cooled to increase the S/N ratio of the camera output signals.
  • Alternative image capture devices which may be employed are a light sensitive sensor, a CMOS camera, a CID (charge injection device) camera, an intensified or gated camera, a photomultipher tube array, a photodiode array or an image capture device employing an addressable microcolometer array, or a chemical film camera may be used.
  • the light presented to the image capture device is capable of forming an image
  • the light may be directed instead or as well to an eyepiece which will allow the image to be seen by the human eye, or to optical apparatus adapted to project the image onto a screen for viewing.
  • the light path to the image capture device may include a beam-splitting or beam directing device by which light can be split (or divided) between the image capture device, an eyepiece, or projection system.
  • a plurality of image capture devices may be employed each of which is supplied with light from the specimen and each of which may be the same type of device or different from the other device(s).
  • Cameras may be replaced by sensors.
  • the light path thereto may include a beam splitting means or beam directing means as appropriate.
  • the light image may be transmitted to an image capture device (which may be a sensor) via a fibre bundle.
  • an image capture device which may be a sensor
  • the signals from the image capture device may be processed and/or analysed in real time, for example using a suitably programmed computer.
  • Signals from the image capture device may be stored for example in a frame store for subsequent analysis by a computer, or may be displayed in real time (or subsequently by reading out signals from the store) for visual inspection and analysis of an image produced from the signals.
  • the system may operate using dark field illumination, or Rheinberg illumination, phase contrast illumination, or Differential Interference Contrast (DIC) illumination.
  • dark field illumination or Rheinberg illumination
  • phase contrast illumination or Differential Interference Contrast (DIC) illumination.
  • DIC Differential Interference Contrast
  • the system may utilise Hoffman Modulation Contrast may be employed.
  • the illumination may be oblique or axial, and the illuminating light may be polarised and/or from a non-visible part of the spectrum such as infrared light.
  • Apparatus for imaging light emitted from a specimen, typically due to fluorescence of different parts of the specimen, onto an image capture device to produce a video signal for creating an image in a display device or for processing and analysis comprises
  • a light source for producing excitation light - a scanning system adapted to scan the specimen with the excitation light (as by directing excitation light in one direction towards, and thereby to scan an area of the specimen) and also adapted to convey light emitted from the specimen as a consequence of the excitation light impinging thereon in another (typically the opposite) direction, which operates in use to scan (typically repeatedly) an area of interest of the specimen,
  • an image capture device having discrete spatially distinct light sensitive regions on which the light emitted from the specimen is focussed to form an image after being conveyed (i.e. passing) through the scanning system in the said other direction, and
  • control means adapted to control the excitation light and/or the image capture device so that light from the specimen is incident on the image capture device for a time period equal to that required by the scanning system to scan the area of interest n times (where n. is a whole number equal to or greater than 1).
  • the area of interest may be the whole of the viewable area of the specimen.
  • a window of variable size and location may be generated by the scanning system to enable part (or if desired all) of the area to be scanned.
  • a sub-array of variable size and location may be used.
  • the scanning system is preferably a confocal system
  • the scanning system comprises a rotating Nipkow disc scanner in which excitation light passes through openings in the disc in one direction and light emitted by fluorescence of the specimen passes through the openings in the opposite direction to form an image on the image capture device, and the pattern of openings is such that rotation of the disc through A 0 results in scanning the whole of the area of interest and the said time period is selected to correspond to nA° of rotation of the disc (where n. is equal to or a whole number greater than one).
  • a single Nipkow disc may be employed, but more preferably a 2-disc arrangement is employed in which one of the discs contains one containing microlenses in the openings, as described in the Yokogawa Technical Report No. 33 (2002).
  • References herein to a disc (or disc means or disc arrangement) are intended to include multiple disc assemblies such as described in that Report, as well as single disc arrangements, where the content so admits.
  • one or more lensless discs may be used (for example as described in US Patent 6147798).
  • the rotation of the lensless disc (or discs) corresponds' to rotation of a Nipkow disc.
  • the scanning system may incorporate a pinhole, or several pinholes in a fixed pattern (for example as described in US Patent 5248876 also WO 03/019242) where one complete scan of the pinhole (or pinhole array) corresponds to rotation of a Nipkow disc.
  • the scanning system may incorporate a scanning slit scanner (for example as described in US 6038076) where a scan of the slit corresponds to rotation of a Nipkow disc.
  • Confocality may be achieved by a 2 photon process which includes a 2 photon excitation source and which limits the focal plane of activation (see as described in US Patent 5034613) an wherein one pulse of the 2 photon excitation source corresponds to rotation of a Nipkow disc.
  • confocality may be obtained by a time delay multiplexed process involving pinholes (as described by Bewersdorf, Pick and Hell in a paper entitled “Multifocal Multiphoton Microscope” 1998 Opt Lett. 23(9): 655-657) wherein one complete scan of the pinholes corresponds to rotation of a Nipkow disc.
  • the scanning system may employ an array of independently controllable mirrors and means for adjusting same under the control of the control means, so that in use they synthesise an array of pinholes (see for example EP 0911667 and US 2002,024007) wherein one complete scan using the mirrors to create an image or subimage, corresponds to rotation of a Nipkow disc.
  • the scanning system may include a random or quasi random pattern of transmissive and reflective elements (as described in WO 97/31282 and WO 0043819) which are scanned to produce an image where one complete scan of the transmissive and reflective elements corresponds to rotation of a Nipkow disc.
  • Preferably means is provided to prevent light from reaching the specimen except from the excitation source, and to prevent light from reaching the image capture device except from the specimen via the scanning system.
  • control means also controls the operation of the image capture device whereby it is read out at the end of each said time period and is reset prior to the beginning of the next said time period.
  • Preferably means is provided by which light from the source of excitation light is incident on the specimen for a time precisely equal to each specific time period.
  • control means switches the excitation light source on and off to control the exposure duration, and the image capture device exposure is in turn governed or controlled by the time for which the excitation light source is active.
  • shutter means may be provided which in use is operated by signals from the control means to interrupt light from the excitation source except for when the specimen is to be illuminated.
  • the light may be controlled by an intrinsic (electronic) shutter.
  • a light chopper may be used to control the light.
  • an acousto-optic element may be used to perform the shutter function.
  • second shutter means may be provided between the scanning system and the image capture device, which second shutter means is operated by signals from the control means so that in use light is prevented from reaching at least part of the image capture device sensor, except for the specific periods of time during which excitation light is incident on the specimen, for the purpose of reducing errors which could arise from phosphorescence, afterglow, stray reflections or light from other effects, reaching the capture device.
  • shutter means is provided for both excitation source and image capture device, means is preferably provided whereby in use, they are operated synchronously.
  • the synchronising means may be mechanical or electrical or both.
  • the scanning system preferably focuses the excitation light in a plane which contains or comprises the area of the specimen to be illuminated by the excitation light, and in general comprises the area of interest.
  • the apparatus may also include drive means adapted to move the specimen, the scanning system, or an element of an optical system within the scanning system, along a linear axis (the Z-xis) so that in use the plane can be positioned at different points along the Z-axis, to enable the specimen to be scanned in different (typically parallel) spaced apart planes.
  • drive means adapted to move the specimen, the scanning system, or an element of an optical system within the scanning system, along a linear axis (the Z-xis) so that in use the plane can be positioned at different points along the Z-axis, to enable the specimen to be scanned in different (typically parallel) spaced apart planes.
  • the linear axis drive means is also controlled by signals from the control means.
  • control system operates so that in use linear axis movement is restricted to periods during which at least excitation light is inhibited (or prevented from reaching the specimen) and is preferably restricted to periods during which the image capture device is rendered insensitive to light.
  • control means controls the linear axis drive in use so as to effect the linear axis movement at the end of each said time period, or after a succession of N such time periods, (N being an integer equal to or greater than 1).
  • the movements may be such as to increase or decrease the distance between the specimen and the scanning system, or an element of the scanning system, or an element of an optical system within the scanning system.
  • the control system is preferably adapted to control the distance moved along the linear axis between exposures.
  • Each movement in the linear axis may be same size or may differ in size from those before and/or following.
  • control system is adapted to control the linear axis drive to move in discrete steps each of a predetermined equal size, and in that event each linear axis movement between exposures may be made up of one or more than one of the said discrete steps.
  • the linear axis motion may be continuous. This allows faster motion between different imaging positions without having to wait for the mechanism to settle.
  • the disadvantage is that the imaging plane will vary during the imaging process with the result that the image can be blurred. However this may be compensated for by applying deconvolution to re-sharpen the image.
  • control means is adapted to control the time between exposures or to control the illumination and image capture device exposure by reference to the Z-axis movement such that excitation illumination and exposure is only initiated after a sufficient period of time has elapsed, or after desired linear axis movement has been achieved.
  • Multiple images may be collected over short periods of time (eg 1 minute-60 minutes) or extended periods of time (eg 24-72 hours) as well as intermediate periods (eg 1-24 hours). Such images are often referred to as a stack of images.
  • the apparatus may comprise two or more excitation light sources each producing light of a different wavelength from the, or each, other source, or may comprise a single source which is adjustable to produce light of different wavelengths, and the control means is adapted to select between the source, or to control the single source, to alter the excitation light wavelength, preferably between the end of one exposure and the beginning of the next.
  • control means may be adapted to control the linear axis drive means so that linear axis movement is initiated only after each complete sequence of said steps has been performed, and the next sequence of said steps is only initiated after each linear axis movement has been completed.
  • the specimen is carried by a microscope stage and a stage drive is provided to move the stage (and specimen) in X and Y, to bring into view other portions of a sample such as for example other cells on the same slide, or other samples in a multiwell plate, or other regions of tissue or of a single sample.
  • the X or Y steps may be in the range 10 microns to 10 mm.
  • a number of samples may be held in the wells of a multiwell plate. The samples may all be similar but may be different and may for example differ due to constituents, concentration or age.
  • the linear drive may be controlled so as to produce linear motion alternatively in one direction, and then in another, to save time.
  • Wavelength variations may be achieved by employing two or more light sources of different peak wavelengths and selectively operating the sources, or selectively directing light from the sources in turn, as required, to the scanning device and specimen.
  • the spectrum of a source of light (even when designated as producing light of one wavelength), actually includes light at a number of wavelengths, in which the intensity of the light at and close to the designated wavelength is much greater than other components of light in the source spectrum. In that event the source is said to peak at the designated wavelength.
  • the light sources used in apparatus for performing the invention may have more complex spectral characteristics, for example multiple peaks available from an Argon ion laser with a main line at 488nm, and additional lines at 476nm and 496nm.
  • Individual (peak) wavelengths may be selected by a single code (eg 2 lines to select one of 4 wavelengths as code 00, 01, 10, 11) or as a set of individual signal lines (eg 4 lines for 4 wavelengths), so that several lines may be activated at the same time.
  • the excitation light source may comprise a laser light source, which may comprise one or more than one laser.
  • a single excitation light source may be employed, whose emitted wavelength can be altered, and the control means may be adapted in use to alter the source to produce a desired wavelength.
  • a laser light source which comprises an acousto-optical tuneable filter (AOTF) crystal
  • the control means is adapted to provide in use signals to alter the frequency controlling signal to the crystal, between exposures, to control the wavelength of the emitted light.
  • AOTF acousto-optical tuneable filter
  • the light source may be a directly driven laser diode.
  • any alteration of the frequency of the controlling signal is effected between exposures.
  • the excitation light may be pulsed as by pulsing the source.
  • the excitation light may be polarised, either by using a polarised light source or by using a polarising filter.
  • the excitation light source may be a luminescent or incandescent source and an optical filter or a monochromator may be employed to control the wavelength of the light emitted by the source in use.
  • LED light emitting diode
  • control means may be adapted to adjust in use the intensity of the excitation illumination incident on the specimen, preferably between exposures. This variation may for example be achieved by interposing different neutral density filters in the light path.
  • apparatus may comprise a plurality of neutral density filters and means under the control of the control means, which in use selectively positions one or more of the filters in the light path, (preferably during the time intervals between exposures) to achieve the density variation.
  • the apparatus may comprise an adjustable iris diaphragm in the light path and drive means operated by the control means to open or close the iris as required, preferably in the time intervals between exposures.
  • the excitation light intensity may be controlled by adjusting the power supplied to the excitation light source, and to this end the control means may be adapted to generate signals for controlling the power source for the excitation light source, or the transfer of power thereto, as appropriate.
  • An attenuating element such as an AOTF or LCD shutter may be used to control the intensity of the excitation light incident on the specimen, the AOTF or LCD shutter being controlled by signals from the control means.
  • the excitation light intensity may be controlled by using two or more such intensity varying techniques in combination, typically in series.
  • the control means may be adapted to alter in use the intensity of the illumination between one wavelength and another so as to provide a predetermined intensity of illumination at the specimen for each wavelength, so as to substantially remove variation in intensity as between one wavelength and another, which can otherwise occur.
  • control means is adapted in use to control the power to the excitation light source from one exposure to another as wavelength varies, so as to ensure a substantially similar level of excitation illumination (intensity) at the specimen during each exposure, which level is independent of wavelength.
  • a similar technique may be employed if the emission from the sample differs according to wavelength of the luminescence emitted, and in order to render the emitted light of similar intensity (irrespective of wavelength), the power adjustment and/or attenuation relating to the excitation light source, from one exposure to another, may also, or instead, be adjusted to provide substantially constant intensity luminescence irrespective of the wavelength used.
  • the image capture device may comprise any convenient light sensitive sensor.
  • a preferred image capture device is a CCD camera.
  • a CCD camera is selected which provides a picture signal in digital format as opposed to analogue format.
  • the image capture device is a CCD camera, it is preferably cooled to increase the S/N ratio of the camera output signals.
  • CMOS camera a CID (charge injection device) camera
  • intensified or gated camera a photomultipher tube array
  • photodiode array a photodiode array or an image capture device employing an addressable microcolometer array or a chemical film camera
  • the light presented to the image capture device is capable of forming an image
  • the light to be supplied to the image capture device may be directed instead (or as well) to an eyepiece which will allow the image to be viewed by the human eye, or to projection apparatus which is adapted to project an image onto a screen for viewing.
  • the light path to the image capture device may include a beam-splitting or beam directing device by which light can be split (or divided) between the image capture device, and/or an eyepiece and/or a projection system.
  • One or more image capture devices may be employed each of which may be the same type of device or may be different. Where more than two image capture devices are employed, at least one may differ in type from one or more of the others, and they may all be different.
  • Cameras may be replaced by sensors.
  • the light path thereto may include a beam splitting means or beam directing means as appropriate.
  • the light may be transmitted to the or each image capture device sensor via an optical fibre bundle.
  • the apparatus may include a data storage means adapted to store signals from the image capture device for subsequent analysis by a computer, or displayed on a screen for visual investigation or analysis of an image produced by reading out the stored signals.
  • the apparatus may also include computer means adapted to receive the signals from the image capture device or the data storage means, to permit processing and analysis of the image signals.
  • a signal path to a display device from the image capture device, or the computer may be provided so that an image can be formed using the image capture device output or the data stored in the storage means or from the computer before and/or after processing.
  • a diode laser source may be employed which has beam control built in.
  • reference to a shutter can be considered to refer to switching or modulating a diode laser source.
  • Figure 1 is a schematic diagram of a Confocal microscope system
  • Figure 2 is a system diagram giving details of proprietary hardware which can be connected to the computer based controller of Figure 1 to enable the method of the invention to be performed;
  • Figure 3 is a schematic diagram of an AOTF laser control system
  • Figure 4 is a block schematic diagram showing how the system of Fig 2 is switched through a sequence of different machine states
  • FIG. 5 is a block schematic diagram of the controller board
  • Figs 6A-6C are waveform diagrams showing control signal protocols for different operating systems
  • Fig 7 is a state diagram of a system operated as a phase locked loop
  • Figs 8A and 8B are system and state diagrams of a system in which further control signals are generated by the controller;
  • Figs 9A and (b are system and state diagrams of a system in which triggering of a camera generates trigger acknowledgement signals for feedback to the controller;
  • Figs 10A and 10B are system and state diagrams of a system in which the controller is externally triggered or can allow inputs to be used for external devices.
  • the con-focal scanning system 10 may comprise a Yokogawa confocal scanner (which may be a model CSU 10 or the more recent model CSU21), set to view a sample (not shown) on a stage 12 and provide light to a camera 14 to form an image thereon of fluorescence arising from excitation of the sample by laser light from an AOTF laser source 16.
  • a Yokogawa confocal scanner which may be a model CSU 10 or the more recent model CSU21
  • a controller 18 converts signals from a computer 20 into control signals for operating or controlling the operation of items 10, 12, 14 and 16 and in turn can transmit data from these items to the computer 20, if required.
  • Software 22 is shown loaded on the computer enabling the latter to be instructed to perform particular tasks or control items 10 to 16 in different ways, depending on the sample or experiment to be performed. Alternatively different software can be loaded as required to enable the system to perform different tasks or experiments.
  • Figure 2 shows the various items of proprietary hardware which can be interconnected to constitute an operating example of the system of Figure 1.
  • the controller 18 of Figure 1 is made up of the synchronisation circuit 18' and control board 18" in Figure 2, and the computer 20 is identified as a Dell Dimension GX260 loaded with Windows 2000 as the basic operating system, having a 2.4 GHz processor and 2GB of RAM and a WD Caviar drive, with a dual monitor card for driving two display monitors 21 and 23.
  • the microscope 12 is typically a Nikon eclipse model TE300 and as mentioned in relation to Fig 1 the con-focal scanning unit comprises a Yokogawa model CSU 10 or CSU21. Z-axis adjustment is achieved using a Physik Instrument piezoelectric driver 22 which is controlled by a proprietary control unit 24 provided with analogue control signals froml ⁇ .
  • the laser excitation light source is an Omnichrome Series 43 (3 wavelength) laser as supplied by Melles Griot Laser Group of California operating with an AOTF crystal and controller from NEOS of Florida.
  • the light intensity of the laser is controllable from the Control board 18" which (as indicated above) together with the synchronisation unit 18' makes up the controller 18 of Figure 1.
  • a driver 26 controls the AOTF control 28 for the laser 16 whose power supply is shown at 30.
  • the camera 14 is a Hamamatsu Orca EP CCD camera.
  • a power supply for the driver 26 is shown at 32 and a power supply and interface for the camera 14 is shown at 34.
  • the synchronisation circuit 18' is connected to the computer 20 via a USB connection 36.
  • Figure 3 shows details of the AOTF laser, as comprising an Argon ion laser 38 and auxiliary laser 40.
  • An AOTF crystal 42 controls the wavelength of the light emitted via fibre 44 and the CSU 10 fibre port.
  • the crystal 42 is controlled by an RF signal from the controller 46 which in turn is controlled by TTL and analogue signals from the computer 20 via circuit 18' and driver 26 (see Figure 2).
  • Figure 4 shows how the 1 KHz clock signal controls the different operations required of the system.
  • Figure 4 is a state diagram containing a set of output registers labelled line on/off (48), laser line (50), Z position (52), camera (54), and head sync (56); a duration down counter (58), a state counter (60), and a memory 62 containing a plurality of separate bit pattern, each pattern defining one of the desired machine states.
  • the bit outputs of some of the output registers are connected directly to digital ports on devices which can be controlled by such signals, such as the laser line ON/OFF selection 48 systems, the camera trigger and the CSU scanning disc system synch input.
  • Digital signals from output registers 50 and 52 are converted from digital to analogue signals by DAC's 64, 66 to provide analogue signals to analogue ports on the AOTF system and the piezo stage drive, which typically drives the stage along two different axes.
  • a clock signal is supplied to the duration downcounter 58.
  • the state data is stored in the host computer 20 and is loaded into the memory 62 from the host computer.
  • the state counter 60 is loaded with the number of states.
  • the first state is transferred from the first line in memory 62 to the output registers 48 to 56, so as to set the states of the devices supplied with control signals therefrom.
  • the intended duration of the first state is loaded as a number into the state duration down-counter 58 from state duration memory 68.
  • the numerical value held in the duration counter 58 is decremented by one, and its new value compared with zero. If non-zero, the states of the output registers 48-56 are maintained.
  • the state counter 60 When the numerical value in the duration counter 58 reaches zero, the state counter 60 is clocked by one and now points to the next state bit pattern in the memory 62. This next state is transferred from 62 to the output registers 48 to 56, so as to set the states of the devices they control to the new condition required of the machine and the duration for this next state is transferred from 68 to the duration counter 58 to control the duration of this next state, which is replaced by the next state from memory 62 each time the duration counter 58 numerical value reaches 0.
  • the system operation progresses from one state to the next until the state counter 60 is decremented to zero at which point the operation stops.
  • a stop signal may be generated at this pint and the system may be set up to start again upon generation of this stop signal.
  • This message is a work around to cope with initial lack of a USB vendor ID.
  • the USB master interrogates each unit to find out what type it is.
  • This message is sent before any experiments are conducted, to set the default output state and the confocal head parameters.
  • Z-axis drive position is given by:
  • Pz is the desired Z position and a sensitivity of lO ⁇ m/volt and a 10 volt output span is assumed. Up to 16 bits are available for this value, but the embodiment being described responds only to the most significant 12 bits, which gives a resolution of 25nm.
  • Sync pulse times, number of sectors and camera exposure times are all constrained by the requirement for every event to be synchronised to sector times.
  • a 12 sector disk could have the following parameters.
  • the Yokogawa CSU 10 and CSU21 systems would be limited to 3ms per sector in the present design.
  • the following message is sent before (header) and after (footer) the list of State Data. Any State Data that is already stored is cleared when the header is received. The message is ignored if the synchroniser is running.
  • the messages are referred to as State list headers and State list footers.
  • State data should immediately follow a state list header.
  • the synchroniser is set to check that the correct number of states are received before executing anything.
  • the digital outputs, AOTF blanking and Z stepper may be altered at will.
  • the camera trigger bit (digital output bit 7) is ignored in all immediate data.
  • This message is sent to set the AOTF channel power. It would not be sensible for the AOTF levels to be changed during an experiment, but for simplicity the synchroniser will always respond to them - this enables the levels to be tweaked while in live mode.
  • the system carries out a given state for 'count' clock ticks and outputs persist at given value for this time.
  • the invention provides a control system or synchroniser to sequence a Nipkow disc laser scanning confocal microscope imaging system having a Z-axis drive.
  • the system requires a host computer (20) and controller (18) and is programmable to perform a wide range of tasks and is coimectable to a Nipkow disc confocal microscope hardware via a communication line such as a USB connection.
  • the controller (18) may be constructed as shown in Figure 5, using a 8051 microcontroller which is programmed to function as the state machine described with reference to Figure 4.
  • the unit (18) includes a clock input 69, the DAC's 64 and 66 and output ports as follows, (although it is to be understood that any other suitable microprocessors or programmable logic device could be used to control the subsystem), namely
  • USB port 70 one port for configuration, timing and power.
  • the trigger/enable signal controls the activation of the camera, which alternates between active “on” and inactive “off” states.
  • the "end of scan sync" indicates the end of the pinhole scan sequence corresponding to an entire disc rotation, where each disc consists of a number of sectors.
  • Wavelength select indicates the different wavelengths selected for excitation.
  • Power level indicates when the power is ON and OFF. This is typically switched from OFF to nominal power level "p".
  • the "Z position" waveform of Fig 6A indicates how the control signal determining the different sample scan planes in the Z axis can increase in steps from Zl to Z2 and Z3 before returning to a ZO position ready for the next scan sequence, while the wavelength remains constant.
  • Fig 6B the Z position determining signal ramps at a constant rate from ZO to a maximum value for Z (i.e. X3) and then rapidly reduces in value back to X0 ready for the next scan.
  • Fig 6C shows how the Z position signal varies between Zl and Z3 during two successive scans during each of which the wavelength is altered from XI to X2 during a power OFF interval
  • Fig 7 shows the states of a system such as that of Figs 2-5 when operated as a phase locked loop about the natural frequency of the disc rotation pulse, where the disc rotation speed is set by the CSU controller.
  • the rate of the clock to the counter is adjusted by the actual rate of disc rotation.
  • Disc sync signals are supplied to a phase locked loop clock 76 which controls the duration counter 58 in place of the 1 KHz clock of Fig 4.
  • Figs 8A and 8B relate to an alternative arrangement in which further control signals pass from the controller 18 and the microscope 12 for other control functions such as stage and objective control as depicted by the confirm signal path 78.
  • Figs 9A and 9B relate to another modification of the system of Figs 2-5, in which further control signals pass from the camera 14 to the controller 18 to acknowledge triggering, such as an acknowledge signal along path 80.
  • Figs 10A and 10B show how the controller 18 can be externally triggered or can receive an enable input from an outside device along path 82.

Abstract

A method of imaging light from a specimen in which excitation light passes to the specimen via a scanning system and light emitted by luminescence of the specimen passes in another direction via the scanning system to an image capture device having a sensor having discrete spatially distinct light sensitive regions. The scanning system is operated so as to scan the whole of an area of interest of the specimen, and the excitation light and/or the image capture device are controlled so that light emitted from the specimen is only incident on the image capture device sensor for a specific time period equal to that required for scanning the whole of the area of interest n times (where n is a whole number equal to or greater than 1). The scanning system is a confocal system, and in one example comprises a rotating Nipkow disc scanner and the pattern of openings in the disc is such that rotation of the disc through A° results in scanning the whole of the area of interest and the said specific time period is selected to correspond to nA° of disc rotation. Apparatus for performing the method to produce a video signal for creating an image in a display device or for processing and analysis by a computer, includes control means adapted to control the excitation light and/or the image capture device so that light from the specimen is incident on the image capture device for the specific period of time, and the image capture device is a CCD camera.

Description

Title: Improvements in and relating to imaging
Field of invention
This invention concerns a method and apparatus by which luminescent elements of a specimen or sample can be imaged for analysis.
Background
It is known to use laser excitation confocal imaging, a Nipkow disc scanner (which may be a microlens enhanced disc scanner) and a digital camera, to provide image data in two dimensions, and if controlled Z-axis movement is also provided, three dimensional image data can be obtained. Where a luminescent element is altering with time, a sequence of images can be obtained to provide data in four dimensions, (ie area, depth and time). Where possible, other parameters may also be changed or observed, including excitation wavelength, emission wavelength, polarisation, and/or emission lifetime.
One system which is capable of providing such data about microscopic specimens such as cells and tissue samples is the UltraVIEW live Cell Imager as produced and supplied by Perkin Elmer Life Sciences. This system uses a confocal laser microscope and CCD camera imaging system such as is described in a paper written by Kawamura Negishi Otsuki and Tomosada entitled Confocal Laser Microscope and CCD Camera, published in the Yokogawa Technical Report No. 33 (2002), English Edition and Yokogawa Patent No. EP 0539691 WO 9804946.
It is also known to use one or more lensless discs to achieve confocality as described in US 6147798 to Atto. Here rotation of the lensless disc or discs correspond to the rotation of the Nipkow disc(s). US 5248876 and WO 03/019242 describe another confocal scanning process in which a fixed pattern of pinholes are employed to scan in a linear manner. One complete scan using the pinhole array corresponds to rotation of the Nipkow disc(s).
US 5034613 (Denk) describes another process, known as a 2 photon process, to limit the focal plane of activation and achieve confocality. Here one pulse from the excitation source equates to rotation of the Nipkow disc(s).
Another pinhole-based confocal scanning system is described in 1998 Opt-Leth 23(9): 655- 657 in a report entitled Multifocal Multiphoton Microscopy by Beresdorf et al. Here one complete scan using the pinholes corresponds to rotation of the Nipkow disc(s).
A further confocal scanning system is described in US 2002/024007, EP 0911667, US 5,587,832 and US 6,483,641/EP 1207415. This system employs a controllable array of mirrors to synthesise an array of pinholes. Again one complete scan of the pinholes corresponds to rotation of the Nipkow disc(s).
Lastly transmission and reflective elements arranged in a random or quasi-random pattern can be used for confocal scanning as described in WO 97/31282 and WO 0043819 (Wilson et al). Again one complete scan of the transmission and reflective elements corresponds to the rotation of the Nipkow disc(s).
It is an object of the present invention to provide an imaging system which is an improvement over the systems currently in use and in particular over the current UltraVIEW system, and that described in the aforementioned Yokogawa Technical Report No. 33 (2002) and related Patents EP 0539691 and WO 9804946, EP 1245986, US 5,633,751 and US 6,388,808.
It is also an object of the present invention to provide a control system for more accurately controlling the imaging and data capture process and a method of operation of such a system. It is also an object of the present invention to provide an improved method of capturing light from luminescing elements in a sample or specimen and converting the captured light into data for processing for analysis and/or display and/or storage for subsequent display and/or processing for analysis.
Summary of the invention
According to one aspect of the present invention in a method of imaging light from a specimen in which excitation light passes to the specimen via a scanning system and light emitted by luminescence of the specimen passes in another direction via the scanning system to an image capture device having discrete spatially distinct light sensitive regions wherein the scanning system is operated so as to scan the whole of an area of interest of the specimen the excitation light and/or the image capture device are controlled so that light emitted from the specimen is only incident on the image capture device for a specific time period equal to that required for scanning the whole of the area of interest n times (where n is a whole number equal to or greater than 1).
The area of interest may be the whole of the viewable area of the specimen or a part thereof, and a window of variable size and location may be created by the scanning system to enable some or all of the area to be scanned, and for example a subarray of variable size and location may be used.
In a preferred arrangement the scanning system comprises a rotating a Nipkow disc scanner in which excitation light passes through openings in the disc in one direction and light emitted by luminescence of the specimen passes through the openings in the opposite direction to form an image at the image capture device, and the pattern of openings is such that rotation of the disc through A0 results in scanning the whole of the area of interest and the specific time period is selected to correspond to DA0 of rotation of the disc (where π is a whole number equal to or greater than one). Conveniently the image capture device is a CCD camera.
A single Nipkow disc may be employed, but more preferably a 2-disc arrangement is employed, one containing openings and the other microlenses, as described in the Yokogawa Technical Report No. 33 (2002). References herein to a disc (or disc means or disc arrangement) are intended to include multiple disc assemblies such as described in that Report, as well as single disc arrangements, where the context so admits.
Alternatively one or more lensless discs may be used (for example as described in US Patent 6147798). In this case, the rotation of the lensless disc corresponds to rotation of the Nipkow disc.
Alternatively, light may be scanned using a linear process such as a raster scanning technique, using one pinhole, or several pinholes in a fixed pattern (for example as described in US Patent 5248876 also WO 03/019242) where one complete linear scan of the pinholes corresponds to rotation of the Nipkow disc.
Alternatively a scanning slit scanner may be used (for example as described in US 6038076) where a scan of the slit corresponds to rotation of the Nipkow disc.
Alternatively, confocality may be achieved by a 2 photon process which limits the focal plane of activation (see as described in US Patent 5034613) where one pulse of the 2 photon excitation source corresponds to rotation of the Nipkow disc.
Alternatively confocality may be obtained by a time delay multiplexed process (as described by Bewersdorf, Pick and Hell in a paper entitled "Multifocal Multiphoton Microscope" 1998 Opt Lett. 23(9): 655-657) where one complete scan of the pinholes corresponds to rotation of the Nipkow disc. Alternatively an array of independently controllable mirrors may be used to synthesise the pinholes (see for example EP 0911667 and US 2002,024007) where a complete scan using the mirrors, creates an image or subimage and corresponds to rotation of the Nipkow disc.
Alternatively a random or quasi random pattern on transmissive and reflective elements may be scanned (as described in WO 97/31282 and WO 0043819) where one complete scan of the transmissive and reflective elements corresponds to rotation of the Nipkow disc.
According to another aspect of the present invention, in a method of imaging light from a specimen using an image capture device comprising a sensor containing discrete spatially distinct light sensitive regions, a scanning device is employed by which light is prevented from reaching the specimen except from an excitation source for each of a succession of separated specific periods of time, the image capture device is read out at the end of each said period of time and is reset prior to the beginning of the next said time period, and light from the source of excitation light is supplied for a time precisely equal to each said specific period of time and thereafter is extinguished, so that the duration of the image capture device exposure is controlled by the time for which the excitation light source is active.
In one method embodying the invention the excitation light source is switched on and off to control the duration of the exposure.
Alternatively or additionally, shutter means may be provided to interrupt light from the excitation source except for when the specimen is to be scanned, and the excitation light source may be operated continuously or for longer periods of time than the said specific periods of time.
Alternatively or additionally an intrinsic (electronic) shutter may be used.
Alternatively or additionally a light chopper may be used to interrupt the excitation light. Alternatively an acousto-optic light interrupting element may be used.
Shutter means may be provided between the scanning system and the image capture device to prevent light reaching all or part of the capture device sensor, except for the specific periods of time during which the excitation light is incident on the specimen, thereby to reduce errors which could arise from light arising from phosphorescence, afterglow, stray reflections or other effects, from reaching the device.
If shutter means is provided for both excitation source and image capture device, they are preferably synchronously operated such as by mechanical or electrical means, or electronic pseudo shutter means may be employed or any combination thereof.
Where the specimen is largely transparent it can be scanned and imaged at different spaced apart planes which are also preferably parallel to one another.
Multiple images may be collected over short periods of time (eg 1 minute-60 minutes) or extended periods of time (eg 24-72 hours) as well as intermediate periods (eg 1-24 hours). Such images are often referred to as a stack of images.
The method may thus involve relative movement between the specimen with and the scanning device. This may be achieved for example by displacing the scanning device along an axis (typically its Z axis) which is normal to the scanning plane to be imaged, so that the incident light can be brought to a focus at different points along that axis, each point lying in (and defining) a different focal plane, to enable the specimen to be scanned and imaged in different parallel spaced apart planes. Preferably movement is restricted to periods during which at least excitation light is not incident on the specimen and/or to periods during which the image capture device is also insensitive to light from the specimen luminescence.
Alternatively the optical path may be modified to define the different planes, by moving an objective lens or the specimen, typically by moving a holder containing the specimen. Thus in a preferred arrangement a specimen carrier is displaced to define the spaced apart imaging planes.
The axis of displacement may be at an angle of other than 90° to the focal plane.
Typically the Z-axis movement is performed at the end of each said time period, or after N successive such time periods (N being an integer equal to or greater than 1). The movement may be such as to increase or decrease the distance between the scanning device or optical system element and the specimen.
Each Z-axis movement between exposures may be the same size or may differ from those before and/or following.
Z-axis movement is preferably made in discrete steps, each of a predetermined equal size and in that event, each Z-axis movement between exposures may be made up of M discrete steps, (where M is a whole number equal to or greater than 1).
Alternatively the Z-axis motion may be continuous. This allows faster motion between Z positions without having to wait for the Z mechanism to settle. The disadvantage is that the Z position is varying during the imaging with the result that the image can be blurred in Z. However this may be compensated for by applying deconvolution to re-sharpen the image.
Where the time required to alter the Z-axis spacing is greater than the minimum time needed between exposures, the method preferably includes the step of adjusting the time between exposures or controlling the illumination and image capture device exposure by reference to the Z-axis movement, such that excitation illumination and exposure is only initiated after a sufficient period of time has elapsed or after a desired Z-axis movement has been achieved.
The excitation light may be composed of light having two or more differing wavelengths. Where the method involves variation of the wavelength of the excitation light from one exposure to another, the method preferably also includes the step of altering the excitation light wavelength between the end of one exposure and the beginning of the next.
Where the variation of excitation light wavelength is to be effected whilst focussing the light onto the same plane of the specimen (ie there is no Z-axis movement between each of a succession of two or more excitation and exposure steps making up a sequence of exposures, albeit each employing one or simultaneously two or more different wavelength(s) of excitation light), the Z-axis movement is initiated only after each complete sequence of exposures has been performed, and the next sequence of such steps is only initiated after each Z-axis movement has been completed.
Additionally, the stage of a microscope used in the system, and carrying a specimen, may effect larger scale X or Y motions (10 micron to 10mm) to bring into view other portions of a sample such as for example other cells on the same slide or other regions of tissue or sample.
A number of samples may be held in the wells of a multiwell plate. The samples may all be similar but may be different and may for example differ due to constituents, concentration or age. The multiwell place may be mounted on a microscope stage which is moved so as to bring different wells into registry, or different parts of a single sample in one of the wells into registry.
Additionally, the Z motion may be in one direction and then in another, alternately, to save time.
Wavelength variation may be achieved by employing two or more light sources of different peak wavelengths and selectively operating the sources, or selectively directing light from the sources in turn, as required, to the scanning device and specimen. The light sources used may have more complex spectral characteristics (eg multiple peaks available from an Argon ion laser with a main line at 488nm, and additional lines at 476nm and 496nm).
Where light of more than one wavelength is produced at the same time, the wavelengths may be selected by a single code (eg 2 lines to select one of 4 wavelengths as code 00, 01, 10, 11) or as a set of individual signal lines (eg 4 lines for 4 wavelengths). In this way several lines may be activated at the same time.
According to a preferred feature of the invention the excitation light may be obtained from one or more laser light sources.
Alternatively, the light source may comprise a directly driven laser diode.
In a preferred arrangement a single light source is employed which comprises an acousto optic tuneable filter (AOTF) crystal and the wavelength of the emitted light is altered by altering the frequency controlling signal to the crystal as required. Such an arrangement may contain a single laser source, or two or more laser light sources whose outputs can be optically combined.
Preferably any alteration of the frequency of the controlling signal is effected between exposures.
The excitation light may be pulsed.
The excitation light may be polarised.
A luminescent or incandescent light source may be used as the source of excitation light, and an optical filter or a monochomator employed to control the wavelength of the light emitted by the source. Alternatively a light emitting diode (LED) source may be used which may comprise one or more light-emitting elements.
Where the intensity of the excitation light incident on the specimen is to be adjusted from one exposure to another, the method preferably involves the step of adjusting the intensity of the incident illumination between exposures.
This may for example be achieved by interposing neutral density filters, opening or closing an iris diaphragm in the light path, adjusting the power to the light source, employing an attenuating element such as an AOTF or LCD shutter or any combination thereof.
Where the intensity of the excitation light incident on the specimen at one wavelength, is different from that at another wavelength, such as may be due to inherent intensity variation as between one source and another, or between different modes of operation of a controlled excitation light source, the intensity of the excitation illumination between one wavelength and another may be adjusted so as to provide a predetermined intensity of illumination at the specimen for each wavelength.
Typically but not exclusively, the power adjustment from one exposure to another as wavelength varies, is such as to ensure a substantially similar level (ie intensity) of illumination at the specimen during the scanning making up each exposure, independent of wavelength.
A similar technique may be employed if the emission from the sample differs according to wavelength of the luminescence, and in order to render the emitted light of similar intensity (irrespective of wavelength), the power adjustment and/or attenuation from one exposure to another may also, or instead, be adjusted to provide substantially constant intensity luminescence irrespective of the wavelength thereof.
Preferably a system performing a method embodying the invention is controlled from a single control means such as a control centre which typically includes a programmable computer and one or more interfaces for converting signals produced by the computer into signals suitable for driving, or controlling, the supply of power to drives, or to control power to devices to effect the movements and rotations required by the different steps of the method.
A preferred mage capture device is a CCD camera. Such a camera can provide a picture signal in analogue or digital format. Preferably a camera is selected which produces a picture signal in digital format.
Where the image capture device is a CCD camera, it is preferably cooled to increase the S/N ratio of the camera output signals.
Alternative image capture devices which may be employed are a light sensitive sensor, a CMOS camera, a CID (charge injection device) camera, an intensified or gated camera, a photomultipher tube array, a photodiode array or an image capture device employing an addressable microcolometer array, or a chemical film camera may be used.
Since the light presented to the image capture device is capable of forming an image, the light may be directed instead or as well to an eyepiece which will allow the image to be seen by the human eye, or to optical apparatus adapted to project the image onto a screen for viewing.
The light path to the image capture device may include a beam-splitting or beam directing device by which light can be split (or divided) between the image capture device, an eyepiece, or projection system.
A plurality of image capture devices may be employed each of which is supplied with light from the specimen and each of which may be the same type of device or different from the other device(s).
Cameras may be replaced by sensors. Where one or more image capture devices are provided, the light path thereto may include a beam splitting means or beam directing means as appropriate.
The light image may be transmitted to an image capture device (which may be a sensor) via a fibre bundle.
The signals from the image capture device may be processed and/or analysed in real time, for example using a suitably programmed computer.
Signals from the image capture device may be stored for example in a frame store for subsequent analysis by a computer, or may be displayed in real time (or subsequently by reading out signals from the store) for visual inspection and analysis of an image produced from the signals.
The system may operate using dark field illumination, or Rheinberg illumination, phase contrast illumination, or Differential Interference Contrast (DIC) illumination.
The system may utilise Hoffman Modulation Contrast may be employed.
The illumination may be oblique or axial, and the illuminating light may be polarised and/or from a non-visible part of the spectrum such as infrared light.
Apparatus for imaging light emitted from a specimen, typically due to fluorescence of different parts of the specimen, onto an image capture device to produce a video signal for creating an image in a display device or for processing and analysis, comprises
- means for mounting the specimen,
- a light source for producing excitation light, - a scanning system adapted to scan the specimen with the excitation light (as by directing excitation light in one direction towards, and thereby to scan an area of the specimen) and also adapted to convey light emitted from the specimen as a consequence of the excitation light impinging thereon in another (typically the opposite) direction, which operates in use to scan (typically repeatedly) an area of interest of the specimen,
- an image capture device having discrete spatially distinct light sensitive regions on which the light emitted from the specimen is focussed to form an image after being conveyed (i.e. passing) through the scanning system in the said other direction, and
- control means adapted to control the excitation light and/or the image capture device so that light from the specimen is incident on the image capture device for a time period equal to that required by the scanning system to scan the area of interest n times (where n. is a whole number equal to or greater than 1).
The area of interest may be the whole of the viewable area of the specimen. Alternatively a window of variable size and location may be generated by the scanning system to enable part (or if desired all) of the area to be scanned. Thus a sub-array of variable size and location may be used.
The scanning system is preferably a confocal system
In a preferred arrangement the scanning system comprises a rotating Nipkow disc scanner in which excitation light passes through openings in the disc in one direction and light emitted by fluorescence of the specimen passes through the openings in the opposite direction to form an image on the image capture device, and the pattern of openings is such that rotation of the disc through A0 results in scanning the whole of the area of interest and the said time period is selected to correspond to nA° of rotation of the disc (where n. is equal to or a whole number greater than one). A single Nipkow disc may be employed, but more preferably a 2-disc arrangement is employed in which one of the discs contains one containing microlenses in the openings, as described in the Yokogawa Technical Report No. 33 (2002). References herein to a disc (or disc means or disc arrangement) are intended to include multiple disc assemblies such as described in that Report, as well as single disc arrangements, where the content so admits.
Alternatively one or more lensless discs may be used (for example as described in US Patent 6147798). In this case, the rotation of the lensless disc (or discs) corresponds' to rotation of a Nipkow disc.
The scanning system may incorporate a pinhole, or several pinholes in a fixed pattern (for example as described in US Patent 5248876 also WO 03/019242) where one complete scan of the pinhole (or pinhole array) corresponds to rotation of a Nipkow disc.
Alternatively the scanning system may incorporate a scanning slit scanner (for example as described in US 6038076) where a scan of the slit corresponds to rotation of a Nipkow disc.
Confocality may be achieved by a 2 photon process which includes a 2 photon excitation source and which limits the focal plane of activation (see as described in US Patent 5034613) an wherein one pulse of the 2 photon excitation source corresponds to rotation of a Nipkow disc.
Alternatively confocality may be obtained by a time delay multiplexed process involving pinholes (as described by Bewersdorf, Pick and Hell in a paper entitled "Multifocal Multiphoton Microscope" 1998 Opt Lett. 23(9): 655-657) wherein one complete scan of the pinholes corresponds to rotation of a Nipkow disc.
Alternatively the scanning system may employ an array of independently controllable mirrors and means for adjusting same under the control of the control means, so that in use they synthesise an array of pinholes (see for example EP 0911667 and US 2002,024007) wherein one complete scan using the mirrors to create an image or subimage, corresponds to rotation of a Nipkow disc.
Alternatively the scanning system may include a random or quasi random pattern of transmissive and reflective elements (as described in WO 97/31282 and WO 0043819) which are scanned to produce an image where one complete scan of the transmissive and reflective elements corresponds to rotation of a Nipkow disc.
Preferably means is provided to prevent light from reaching the specimen except from the excitation source, and to prevent light from reaching the image capture device except from the specimen via the scanning system.
Preferably the control means also controls the operation of the image capture device whereby it is read out at the end of each said time period and is reset prior to the beginning of the next said time period.
Preferably means is provided by which light from the source of excitation light is incident on the specimen for a time precisely equal to each specific time period.
In one arrangement the control means switches the excitation light source on and off to control the exposure duration, and the image capture device exposure is in turn governed or controlled by the time for which the excitation light source is active.
Alternatively or additionally, shutter means may be provided which in use is operated by signals from the control means to interrupt light from the excitation source except for when the specimen is to be illuminated.
Alternatively or additionally the light may be controlled by an intrinsic (electronic) shutter.
Alternatively or additionally a light chopper may be used to control the light. Alternatively an acousto-optic element may be used to perform the shutter function.
Alternatively or additionally, second shutter means may be provided between the scanning system and the image capture device, which second shutter means is operated by signals from the control means so that in use light is prevented from reaching at least part of the image capture device sensor, except for the specific periods of time during which excitation light is incident on the specimen, for the purpose of reducing errors which could arise from phosphorescence, afterglow, stray reflections or light from other effects, reaching the capture device.
If shutter means is provided for both excitation source and image capture device, means is preferably provided whereby in use, they are operated synchronously.
The synchronising means may be mechanical or electrical or both.
In use the scanning system preferably focuses the excitation light in a plane which contains or comprises the area of the specimen to be illuminated by the excitation light, and in general comprises the area of interest.
Where the specimen is largely transparent, the apparatus may also include drive means adapted to move the specimen, the scanning system, or an element of an optical system within the scanning system, along a linear axis (the Z-xis) so that in use the plane can be positioned at different points along the Z-axis, to enable the specimen to be scanned in different (typically parallel) spaced apart planes.
Preferably the linear axis drive means is also controlled by signals from the control means.
Preferably the control system operates so that in use linear axis movement is restricted to periods during which at least excitation light is inhibited (or prevented from reaching the specimen) and is preferably restricted to periods during which the image capture device is rendered insensitive to light.
Typically the control means controls the linear axis drive in use so as to effect the linear axis movement at the end of each said time period, or after a succession of N such time periods, (N being an integer equal to or greater than 1). The movements may be such as to increase or decrease the distance between the specimen and the scanning system, or an element of the scanning system, or an element of an optical system within the scanning system.
The control system is preferably adapted to control the distance moved along the linear axis between exposures.
Each movement in the linear axis may be same size or may differ in size from those before and/or following.
Preferably the control system is adapted to control the linear axis drive to move in discrete steps each of a predetermined equal size, and in that event each linear axis movement between exposures may be made up of one or more than one of the said discrete steps.
Alternatively the linear axis motion may be continuous. This allows faster motion between different imaging positions without having to wait for the mechanism to settle. The disadvantage is that the imaging plane will vary during the imaging process with the result that the image can be blurred. However this may be compensated for by applying deconvolution to re-sharpen the image.
Where the time required to alter the linear axis spacing is greater than the minimum time needed between exposures the control means is adapted to control the time between exposures or to control the illumination and image capture device exposure by reference to the Z-axis movement such that excitation illumination and exposure is only initiated after a sufficient period of time has elapsed, or after desired linear axis movement has been achieved.
Multiple images may be collected over short periods of time (eg 1 minute-60 minutes) or extended periods of time (eg 24-72 hours) as well as intermediate periods (eg 1-24 hours). Such images are often referred to as a stack of images.
Where the method involves variation of the wavelength of the excitation light from one exposure to another, the apparatus may comprise two or more excitation light sources each producing light of a different wavelength from the, or each, other source, or may comprise a single source which is adjustable to produce light of different wavelengths, and the control means is adapted to select between the source, or to control the single source, to alter the excitation light wavelength, preferably between the end of one exposure and the beginning of the next.
Where the variation of illumination wavelength is to be effected whilst focussing the light onto the same plane of the specimen (ie there is to be no linear axis movement between each of a succession of two or more exposure steps making up a sequence of said steps, albeit each employing one (or simultaneously two or more) different wavelength(s) of excitation light the control means may be adapted to control the linear axis drive means so that linear axis movement is initiated only after each complete sequence of said steps has been performed, and the next sequence of said steps is only initiated after each linear axis movement has been completed.
Typically the specimen is carried by a microscope stage and a stage drive is provided to move the stage (and specimen) in X and Y, to bring into view other portions of a sample such as for example other cells on the same slide, or other samples in a multiwell plate, or other regions of tissue or of a single sample. To this end the X or Y steps may be in the range 10 microns to 10 mm. A number of samples may be held in the wells of a multiwell plate. The samples may all be similar but may be different and may for example differ due to constituents, concentration or age.
The linear drive may be controlled so as to produce linear motion alternatively in one direction, and then in another, to save time.
Wavelength variations may be achieved by employing two or more light sources of different peak wavelengths and selectively operating the sources, or selectively directing light from the sources in turn, as required, to the scanning device and specimen.
It is to be understood that the spectrum of a source of light (even when designated as producing light of one wavelength), actually includes light at a number of wavelengths, in which the intensity of the light at and close to the designated wavelength is much greater than other components of light in the source spectrum. In that event the source is said to peak at the designated wavelength.
Thus the light sources used in apparatus for performing the invention may have more complex spectral characteristics, for example multiple peaks available from an Argon ion laser with a main line at 488nm, and additional lines at 476nm and 496nm.
Where the excitation light source produces light of more than one wavelength at the same time, Individual (peak) wavelengths may be selected by a single code (eg 2 lines to select one of 4 wavelengths as code 00, 01, 10, 11) or as a set of individual signal lines (eg 4 lines for 4 wavelengths), so that several lines may be activated at the same time.
According to a preferred feature of the invention the excitation light source may comprise a laser light source, which may comprise one or more than one laser. A single excitation light source may be employed, whose emitted wavelength can be altered, and the control means may be adapted in use to alter the source to produce a desired wavelength.
Preferably a laser light source is employed which comprises an acousto-optical tuneable filter (AOTF) crystal, and the control means is adapted to provide in use signals to alter the frequency controlling signal to the crystal, between exposures, to control the wavelength of the emitted light.
The light source may be a directly driven laser diode.
Preferably any alteration of the frequency of the controlling signal is effected between exposures.
The excitation light may be pulsed as by pulsing the source.
The excitation light may be polarised, either by using a polarised light source or by using a polarising filter.
The excitation light source may be a luminescent or incandescent source and an optical filter or a monochromator may be employed to control the wavelength of the light emitted by the source in use.
Alternatively a light emitting diode (LED) source, which may comprise one or more light- emitting elements, may be used as the excitation light source.
Where the intensity of the excitation illumination incident on the specimen is to be adjusted from one exposure to another, the control means may be adapted to adjust in use the intensity of the excitation illumination incident on the specimen, preferably between exposures. This variation may for example be achieved by interposing different neutral density filters in the light path.
Therefore apparatus may comprise a plurality of neutral density filters and means under the control of the control means, which in use selectively positions one or more of the filters in the light path, (preferably during the time intervals between exposures) to achieve the density variation.
Alternatively the apparatus may comprise an adjustable iris diaphragm in the light path and drive means operated by the control means to open or close the iris as required, preferably in the time intervals between exposures.
Alternatively and preferably the excitation light intensity may be controlled by adjusting the power supplied to the excitation light source, and to this end the control means may be adapted to generate signals for controlling the power source for the excitation light source, or the transfer of power thereto, as appropriate.
An attenuating element such as an AOTF or LCD shutter may be used to control the intensity of the excitation light incident on the specimen, the AOTF or LCD shutter being controlled by signals from the control means.
The excitation light intensity may be controlled by using two or more such intensity varying techniques in combination, typically in series.
Where the intensity of the excitation illumination at one wavelength is different from that at another wavelength such as may be due to inherent intensity variation as between one source and another or between different modes of operation of a controlled excitation light source such as an AOTF crystal laser, or of the emission of a crystal due to excitation, the control means may be adapted to alter in use the intensity of the illumination between one wavelength and another so as to provide a predetermined intensity of illumination at the specimen for each wavelength, so as to substantially remove variation in intensity as between one wavelength and another, which can otherwise occur.
Typically but not exclusively, the control means is adapted in use to control the power to the excitation light source from one exposure to another as wavelength varies, so as to ensure a substantially similar level of excitation illumination (intensity) at the specimen during each exposure, which level is independent of wavelength.
A similar technique may be employed if the emission from the sample differs according to wavelength of the luminescence emitted, and in order to render the emitted light of similar intensity (irrespective of wavelength), the power adjustment and/or attenuation relating to the excitation light source, from one exposure to another, may also, or instead, be adjusted to provide substantially constant intensity luminescence irrespective of the wavelength used.
The image capture device may comprise any convenient light sensitive sensor.
A preferred image capture device is a CCD camera. Preferably a CCD camera is selected which provides a picture signal in digital format as opposed to analogue format.
Where the image capture device is a CCD camera, it is preferably cooled to increase the S/N ratio of the camera output signals.
Alternative image capture devices which may be employed are a CMOS camera, a CID (charge injection device) camera, an intensified or gated camera, a photomultipher tube array, a photodiode array or an image capture device employing an addressable microcolometer array or a chemical film camera may be used.
Since the light presented to the image capture device is capable of forming an image, the light to be supplied to the image capture device may be directed instead (or as well) to an eyepiece which will allow the image to be viewed by the human eye, or to projection apparatus which is adapted to project an image onto a screen for viewing.
To this end the light path to the image capture device may include a beam-splitting or beam directing device by which light can be split (or divided) between the image capture device, and/or an eyepiece and/or a projection system.
One or more image capture devices may be employed each of which may be the same type of device or may be different. Where more than two image capture devices are employed, at least one may differ in type from one or more of the others, and they may all be different.
Cameras may be replaced by sensors.
Where one or more image capture devices are provided, the light path thereto may include a beam splitting means or beam directing means as appropriate.
The light may be transmitted to the or each image capture device sensor via an optical fibre bundle.
The apparatus may include a data storage means adapted to store signals from the image capture device for subsequent analysis by a computer, or displayed on a screen for visual investigation or analysis of an image produced by reading out the stored signals.
The apparatus may also include computer means adapted to receive the signals from the image capture device or the data storage means, to permit processing and analysis of the image signals.
A signal path to a display device from the image capture device, or the computer may be provided so that an image can be formed using the image capture device output or the data stored in the storage means or from the computer before and/or after processing. It is to be understood that in place of a laser and AOTF, or a shutter, to control excitation light, a diode laser source may be employed which has beam control built in. In this context reference to a shutter can be considered to refer to switching or modulating a diode laser source.
The invention will now be described by way of example with reference to the accompanying drawings in which:
Figure 1 is a schematic diagram of a Confocal microscope system;
Figure 2 is a system diagram giving details of proprietary hardware which can be connected to the computer based controller of Figure 1 to enable the method of the invention to be performed;
Figure 3 is a schematic diagram of an AOTF laser control system;
Figure 4 is a block schematic diagram showing how the system of Fig 2 is switched through a sequence of different machine states;
Figure 5 is a block schematic diagram of the controller board;
Figs 6A-6C are waveform diagrams showing control signal protocols for different operating systems;
Fig 7 is a state diagram of a system operated as a phase locked loop;
Figs 8A and 8B are system and state diagrams of a system in which further control signals are generated by the controller; Figs 9A and (b are system and state diagrams of a system in which triggering of a camera generates trigger acknowledgement signals for feedback to the controller; and
Figs 10A and 10B are system and state diagrams of a system in which the controller is externally triggered or can allow inputs to be used for external devices.
Reference is made to of the Yokogawa Technical Report No. 33 (2002) and in particular Figures 1 to 3 of that Report and the related description, for a description of the operation of a CSU10 con-focal scanning system.
In Figure 1 the con-focal scanning system 10 may comprise a Yokogawa confocal scanner (which may be a model CSU 10 or the more recent model CSU21), set to view a sample (not shown) on a stage 12 and provide light to a camera 14 to form an image thereon of fluorescence arising from excitation of the sample by laser light from an AOTF laser source 16.
A controller 18 converts signals from a computer 20 into control signals for operating or controlling the operation of items 10, 12, 14 and 16 and in turn can transmit data from these items to the computer 20, if required. Software 22 is shown loaded on the computer enabling the latter to be instructed to perform particular tasks or control items 10 to 16 in different ways, depending on the sample or experiment to be performed. Alternatively different software can be loaded as required to enable the system to perform different tasks or experiments.
Figure 2 shows the various items of proprietary hardware which can be interconnected to constitute an operating example of the system of Figure 1. The controller 18 of Figure 1 is made up of the synchronisation circuit 18' and control board 18" in Figure 2, and the computer 20 is identified as a Dell Dimension GX260 loaded with Windows 2000 as the basic operating system, having a 2.4 GHz processor and 2GB of RAM and a WD Caviar drive, with a dual monitor card for driving two display monitors 21 and 23. The microscope 12 is typically a Nikon eclipse model TE300 and as mentioned in relation to Fig 1 the con-focal scanning unit comprises a Yokogawa model CSU 10 or CSU21. Z-axis adjustment is achieved using a Physik Instrument piezoelectric driver 22 which is controlled by a proprietary control unit 24 provided with analogue control signals fromlδ.
The laser excitation light source is an Omnichrome Series 43 (3 wavelength) laser as supplied by Melles Griot Laser Group of California operating with an AOTF crystal and controller from NEOS of Florida. The light intensity of the laser is controllable from the Control board 18" which (as indicated above) together with the synchronisation unit 18' makes up the controller 18 of Figure 1. A driver 26 controls the AOTF control 28 for the laser 16 whose power supply is shown at 30.
The camera 14 is a Hamamatsu Orca EP CCD camera.
A power supply for the driver 26 is shown at 32 and a power supply and interface for the camera 14 is shown at 34.
The synchronisation circuit 18' is connected to the computer 20 via a USB connection 36.
Figure 3 shows details of the AOTF laser, as comprising an Argon ion laser 38 and auxiliary laser 40. An AOTF crystal 42 controls the wavelength of the light emitted via fibre 44 and the CSU 10 fibre port.
The crystal 42 is controlled by an RF signal from the controller 46 which in turn is controlled by TTL and analogue signals from the computer 20 via circuit 18' and driver 26 (see Figure 2).
The State diagram of Figure 4 shows how the 1 KHz clock signal controls the different operations required of the system. Figure 4 is a state diagram containing a set of output registers labelled line on/off (48), laser line (50), Z position (52), camera (54), and head sync (56); a duration down counter (58), a state counter (60), and a memory 62 containing a plurality of separate bit pattern, each pattern defining one of the desired machine states. The bit outputs of some of the output registers are connected directly to digital ports on devices which can be controlled by such signals, such as the laser line ON/OFF selection 48 systems, the camera trigger and the CSU scanning disc system synch input. Digital signals from output registers 50 and 52 are converted from digital to analogue signals by DAC's 64, 66 to provide analogue signals to analogue ports on the AOTF system and the piezo stage drive, which typically drives the stage along two different axes.
A clock signal, typically of lKHz, is supplied to the duration downcounter 58.
Typically the state data is stored in the host computer 20 and is loaded into the memory 62 from the host computer.
At initialisation, the state counter 60 is loaded with the number of states. The first state is transferred from the first line in memory 62 to the output registers 48 to 56, so as to set the states of the devices supplied with control signals therefrom. The intended duration of the first state is loaded as a number into the state duration down-counter 58 from state duration memory 68.
At the next clock pulse, the numerical value held in the duration counter 58 is decremented by one, and its new value compared with zero. If non-zero, the states of the output registers 48-56 are maintained.
When the numerical value in the duration counter 58 reaches zero, the state counter 60 is clocked by one and now points to the next state bit pattern in the memory 62. This next state is transferred from 62 to the output registers 48 to 56, so as to set the states of the devices they control to the new condition required of the machine and the duration for this next state is transferred from 68 to the duration counter 58 to control the duration of this next state, which is replaced by the next state from memory 62 each time the duration counter 58 numerical value reaches 0.
The system operation progresses from one state to the next until the state counter 60 is decremented to zero at which point the operation stops. A stop signal may be generated at this pint and the system may be set up to start again upon generation of this stop signal.
Messages relevant to different operations/states are set out below.
USB Message Types
Interrogation
This message is a work around to cope with initial lack of a USB vendor ID. The USB master interrogates each unit to find out what type it is.
Figure imgf000029_0001
Initialisation
This message is sent before any experiments are conducted, to set the default output state and the confocal head parameters.
Figure imgf000029_0002
Sector time, ms (see note 2) 1 byte
8 bytes
Z-axis drive
Z-axis drive position is given by:
Pz/(100/xm/216)
Or
Pz/(1.526nm)
Where Pz is the desired Z position and a sensitivity of lOμm/volt and a 10 volt output span is assumed. Up to 16 bits are available for this value, but the embodiment being described responds only to the most significant 12 bits, which gives a resolution of 25nm.
Sector time sychronisation
Sync pulse times, number of sectors and camera exposure times are all constrained by the requirement for every event to be synchronised to sector times.
For example, a 12 sector disk could have the following parameters.
Disk RPM 5000 2500 1666.66
7 Disk Hz 83.3333 41.6666 27.7777 3 7 8
Sector time ms < 1 2 3
Sync Hz Ϊ66.666 83.3333 55.5555 7 3 6
Sync period ms 6 12 18
The Yokogawa CSU 10 and CSU21 systems would be limited to 3ms per sector in the present design.
State data header and footer
The following message is sent before (header) and after (footer) the list of State Data. Any State Data that is already stored is cleared when the header is received. The message is ignored if the synchroniser is running. The messages are referred to as State list headers and State list footers.
Figure imgf000031_0001
State Data
State data should immediately follow a state list header. The synchroniser is set to check that the correct number of states are received before executing anything.
Figure imgf000031_0002
Experiment control
Once State Data has been downloaded, the system can be controlled to perform an experiment.
Message type C 1 byte
Action l byte code:
L Start live mode (immediate data is accepted and retained)
O Start experiment to run once (immediate data is ignored) s Start experiment in continuous loop (immediate data is ignored)
C Stop cleanly (stop execution at the end of the state list) I Stop immediately (stop everything and revert to the initialisation data)
2 bytes Immediate data
If capture is started in live mode, the digital outputs, AOTF blanking and Z stepper may be altered at will. The camera trigger bit (digital output bit 7) is ignored in all immediate data.
Figure imgf000032_0001
AOTF/DAC control
This message is sent to set the AOTF channel power. It would not be sensible for the AOTF levels to be changed during an experiment, but for simplicity the synchroniser will always respond to them - this enables the levels to be tweaked while in live mode.
Figure imgf000032_0002
State machine sample content
The system carries out a given state for 'count' clock ticks and outputs persist at given value for this time.
As described the invention provides a control system or synchroniser to sequence a Nipkow disc laser scanning confocal microscope imaging system having a Z-axis drive. The system requires a host computer (20) and controller (18) and is programmable to perform a wide range of tasks and is coimectable to a Nipkow disc confocal microscope hardware via a communication line such as a USB connection.
The controller (18) may be constructed as shown in Figure 5, using a 8051 microcontroller which is programmed to function as the state machine described with reference to Figure 4. The unit (18) includes a clock input 69, the DAC's 64 and 66 and output ports as follows, (although it is to be understood that any other suitable microprocessors or programmable logic device could be used to control the subsystem), namely
• USB port 70 - one port for configuration, timing and power.
• Sync output port 72 - variable 0-3Vpk-pk, programmable high and low periods in 1ms increments, as described with reference to Initialisation
• TTL output ports 74 - 8 bits for AOTF switching; 67 employing up to 8 bits for camera trigger, shutter control and/or general purpose use; (For example one bit may be dedicated to camera triggering and the rest may be controlled asynchronously when in live mode); and 72 for synchronising disc sector speed.
• An analogue output from DAC 64 - 8 channels, 0-5 volts, 8 bit resolution. For AOTF power setting and/or general use. Not synchronised, but may be controlled asynchronously or synchronously, and
• An analogue output from DAC 66 - 0-10 volts, 12 bit resolution. Typically synchronised to disc sector speed, but may be controlled asynchronously when in live mode. In the control signal protocol diagrams of Figs 6A, 6B and 6C the values of the control signals are shown for a typical system such as described with reference to Figs 2-5.
The trigger/enable signal controls the activation of the camera, which alternates between active "on" and inactive "off" states.
The "end of scan sync" indicates the end of the pinhole scan sequence corresponding to an entire disc rotation, where each disc consists of a number of sectors.
"Wavelength select" indicates the different wavelengths selected for excitation.
"Power level" indicates when the power is ON and OFF. This is typically switched from OFF to nominal power level "p".
The "Z position" waveform of Fig 6A indicates how the control signal determining the different sample scan planes in the Z axis can increase in steps from Zl to Z2 and Z3 before returning to a ZO position ready for the next scan sequence, while the wavelength remains constant.
In Fig 6B the Z position determining signal ramps at a constant rate from ZO to a maximum value for Z (i.e. X3) and then rapidly reduces in value back to X0 ready for the next scan.
Fig 6C shows how the Z position signal varies between Zl and Z3 during two successive scans during each of which the wavelength is altered from XI to X2 during a power OFF interval
Fig 7 shows the states of a system such as that of Figs 2-5 when operated as a phase locked loop about the natural frequency of the disc rotation pulse, where the disc rotation speed is set by the CSU controller. In this system, the rate of the clock to the counter is adjusted by the actual rate of disc rotation. Disc sync signals are supplied to a phase locked loop clock 76 which controls the duration counter 58 in place of the 1 KHz clock of Fig 4.
Figs 8A and 8B relate to an alternative arrangement in which further control signals pass from the controller 18 and the microscope 12 for other control functions such as stage and objective control as depicted by the confirm signal path 78.
Figs 9A and 9B relate to another modification of the system of Figs 2-5, in which further control signals pass from the camera 14 to the controller 18 to acknowledge triggering, such as an acknowledge signal along path 80.
Figs 10A and 10B show how the controller 18 can be externally triggered or can receive an enable input from an outside device along path 82.

Claims

1. A method of imaging light from a specimen in which excitation light passes to the specimen via a scanning system and light emitted by luminescence of the specimen passes in another direction via the scanning system to an image capture device having a sensor having discrete spatially distinct light sensitive regions, and the scanning system is operated so as to scan the whole of an area of interest of the specimen, wherein the excitation light and/or the image capture device are controlled so that light emitted from the specimen is only incident on the image capture device sensor for a specific time period equal to that required for scanning the whole of the area of interest n. times (where n is a whole number equal to or greater than 1).
2. A method as claimed in claim 1 wherein the area of interest is the whole of the viewable area of the specimen.
3. A method as claimed in claim 1 wherein the area of interest is a part of the visible area of the specimen, defined by a window of variable size and location created by the scanning system.
4. A method as claimed in any of claims 1 to 3 wherein the scanning system is a confocal system
5. A method as claimed in any of claims 1 to 4 wherein the scanning system comprises a rotating Nipkow disc scanner in which excitation light passes through openings in the disc in one direction and light emitted by luminescence of the specimen passes through the openings in the opposite direction to form an image at the image capture device.
6. A method as claimed in claim 5 wherein the pattern of openings is such that rotation of the disc through A0 results in scanning the whole of the area of interest and the said specific time period is selected to correspond to nA° of rotation of the disc (where n is a whole number equal to or greater than one).
7. A method as claimed in claim 5 or 6 wherein the Nipkow disc scanner includes two discs.
8. A method as claimed in claim 7 wherein one of the two discs contains openings and the other microlenses.
9. A method as claimed in any of claims 1 to 4 wherein the scanning is effected in a series of lines in the form of a raster scan.
10. A method as claimed in claim 9 wherein the scanning is effected using a pinhole.
11. A method as claimed in claim 9 wherein the scanning is effected using a plurality of pinholes in a fixed pattern.
12. A method as claimed in any of claims 1 to 4 wherein the scanning is effected using a scanning slit scanner.
13. A method as claimed in any of claims 1 to 4 wherein confocality is achieved by a 2 photon process which limits the focal plane of activation.
14. A method as claimed in any of claims 1 to 4 wherein confocality is obtained by a time delay multiplexed process.
15. A method as claimed in any of claims 1 to 4 wherein an array of independently controllable mirrors is used to effect the scanning.
16. A method as claimed in any of claims 1 to 4 wherein the scanning is effected using a random or quasi random pattern of transmissive and reflective elements.
17. A method of as claimed in any of claims 1 to 16 wherein excitation light is prevented from reaching the specimen except for each of a succession of separated specific periods of time and the image capture device is read out at the end of each specific period of time or at the end of a plurality of consecutive specific periods of time.
18. A method as claimed in claim 17 wherein the image capture device is only receptive of light emitted by the specimen during each specific period of time, and after the image signals are read out from the capture device, the capture device is reset.
19. A method as claimed in any of claims 1 to 18 in which the light source is switched on and off to control the duration of the exposure.
20. A method as claimed in any of claims 1 to 18 wherein shutter means is provided to interrupt light from the excitation source except for when the specimen is to be scanned.
21. A method as claimed in claim 20 wherein an intrinsic (electronic) shutter is used to interrupt the excitation light.
22. A method as claimed in any of claims 1 to 18 wherein a light chopper is used to interrupt the excitation light.
23. A method as claimed in any of claims 1 to 18 wherein an acousto-optic light interrupting element is used.
24. A method as claimed in any of claims 20 to 23 wherein the excitation light source operates to produce light for periods of time corresponding to but of linger duration than the said specific periods of time.
25. A method as claimed in any of claims 20 to 23 wherein the excitation light source is operated continuously.
26. A method as claimed in any of claims 1 to 25 wherein shutter means is provided for both excitation source and image capture device.
27. A method as claimed in claim 26 wherein both shutter means are synchronously operated.
28. A method as claimed in claim 26 wherein electronic pseudo shutter means is employed.
29. A method as claimed in any of claims 1 to 25 wherein shutter means is provided which in use operates to prevent light reaching at least part of the image capture device sensor, except for the said specific periods of time during which the excitation light is incident on the specimen, for the purpose of reducing errors which can arise from light arising from phosphorescence, afterglow, stray reflections or other effects, from reaching the capture device sensor.
30. A method as claimed in claim 29 wherein the shutter means prevents light from reaching all of the image capture device sensor.
31. A method as claimed in any of claims 1 to 30 wherein the specimen is at least in part transparent and a plurality of images are formed by scanning the specimen in a plurality of different spaced apart planes.
32. A method as claimed in claim 31 wherein the different planes are produced by relative movement between the specimen and a scanning device forming part of the scanning system.
33. A method as claimed in claim 32 wherein the specimen movement is achieved by moving a holder containing the specimen.
34. A method as claimed in claim 31 wherein the different planes are produced by movement of at least one part of an optical system forming part of the scanning system so that light is brought to a focus in the specimen at different spaced apart points, each point therefore defining the position of a focal plane of the scanning system.
35. A method as claimed in claim 34 wherein the different focal planes are obtained by moving an objective lens in the optical system.
36. A method as claimed in any of claims 32 to 35 wherein movement is restricted to periods during which excitation light is not incident on the specimen.
37. A method as claimed in claim 34 wherein movement is restricted to periods during which the image capture device is rendered insensitive to light.
38. A method as claimed in any of claims 32 to 37 wherein the axis of displacement is normal to the or each focal plane of the scanning device.
39. A method as claimed in any of claims 32 to 37 wherein the axis of displacement subtends an angle of other than 90° to the or each focal plane of the scanning device.
40. A method as claimed in any of claims 32 to 39 wherein the movement occurs at the end of each said specific time period or after N successive such time periods (N being an integer equal to or greater than 1).
41. A method as claimed in claim 40 wherein each movement between exposures is the same size.
42. A method as claimed in claim 40 wherein the size of each movement differs from that of a preceding or following movement.
43. A method as claimed in claim 40 wherein each movement is composed of a succession of discrete steps, each of a predetermined equal size.
44. A method as claimed in claim 43 wherein each movement between exposures is made up of M discrete steps (where M is a whole number equal to or greater than 1).
45. A method as claimed in any of claims 32 to 44 wherein the method includes the step of controlling the excitation illumination or the image capture device exposure, or both, by reference to the said movements, such that excitation illumination and/or exposure is only initiated after each movement has been completed.
46. A method as claimed in any of claims 32 to 44 wherein the time between excitation and/or exposures is controlled so as to be at least equal to the time required to complete each movement.
47. A method as claimed in any of claims 32 to 39 wherein the movement is continuous for the purpose of speeding up the scanning of a specimen.
48. A method as claimed in claim 47 wherein the continuous movement during the imaging results in blurring of the image, and the method includes the step of applying deconvolution to re-sharpen the image.
49. A method as claimed in any of claims 32 to 48 wherein the excitation light is composed of light having two or more different wavelength(s).
50. A method as claimed in any of claims 32 to 49 wherein the wavelength of the excitation light is varied between one excitation and/or exposure and the next.
51. A method as claimed in claim 50 wherein the wavelength of the excitation light is varied continuously during a succession of excitations and exposures.
52. A method as claimed in claim 50 wherein the excitation light wavelength is varied between the end of one excitation and/or exposure and the beginning of the next.
53. A method as claimed in claim 50 or 51 wherein the variation of excitation light wavelength is effected whilst imaging the same plane of the specimen.
54. A method as claimed in any of claims 49 to 53 wherein there is no movement within the optical system or of the specimen between each of a succession of two or more excitation and exposure steps making up a sequence of exposures, and the said relative movement is initiated only after each said sequence of exposures has been performed, and the next sequence of such excitation and exposure steps is only initiated after a movement has been completed.
55. A method as claimed in any of claims 32 to 54 wherein the said movement is alternately first in one direction and then in another.
56. A method as claimed in any of claims 50 to 55 wherein wavelength variation is achieved by employing two or more light sources of different peak wavelengths and selectively operating the sources or selectively interrupting light therefrom.
57. A method as claimed in any of claims 49 to 55 wherein two or more light sources having different peak wavelengths are employed, and light is selectively directed from the sources in turn, as required, to the scanning device and specimen.
58. A method as claimed in any of claims 49 to 55 wherein the or each of the light sources used has a complex spectral characteristic.
59. A method as claimed in any of claims 49 to 58 wherein the excitation light is obtained from one or more laser light sources.
60. A method as claimed in claim 59 wherein the or each light source is a directly driven laser diode.
61. A method as claimed in any of claims 49 to 55 wherein a single excitation light source is employed which comprises an acousto optic tuneable filter (AOTF) crystal and the wavelength of the emitted light is varied by altering the frequency controlling signal to the crystal as required.
62. A method as claimed in claim 61 wherein any alteration of the frequency of the controlling signal is effected between exposures.
63. A method as claimed in any of claims 49 to 55 in which the excitation light source comprises a single laser light source, or two or more laser light sources whose outputs are optically combined.
64. A method as claimed in any of claims 1 to 63 wherein the excitation light is pulsed.
65. A method as claimed in any of claims 1 to 64 wherein the excitation light is polarised.
66. A method as claimed in any of claims 1 to 58 wherein a luminescent or incandescent light source is used as the source of excitation light, and an optical filter or a monochromator is employed to control the wavelength of the light emitted by the source.
67. A method as claimed in any of claims 1 to 58 wherein a light emitting (LED) source is used which comprises one or more light-emitting elements.
68. A method as claimed in any of claims 1 to 67 wherein the intensity of the excitation light incident on the specimen is adjusted from one exposure to another.
69. A method as claimed in any of claims 1 to 67 wherein the method involves the step of adjusting the intensity of the incident excitation light between exposures.
70. A method as claimed in claim 68 or 69 wherein the intensity of the incident excitation light is adjusted by interposing neutral density filters, or opening or closing an iris diaphragm in the light path, adjusting the power to the light source, or employing an attenuating element such as an AOTF or LCD shutter, or any combination thereof.
71. A method as claimed in claim 69 or 70 wherein the intensity of the excitation light is adjusted so as to provide a predetermined intensity of illumination at the specimen.
72. A method as claimed in claim 71 wherein the specimen is illuminated by light at different wavelengths and the intensity is adjusted to produce a predetermined level of excitation intensity at the specimen for each wavelength.
73. A method as claimed in claim 71 or 72 wherein the adjustment produces a substantially similar level of intensity at the specimen for each different wavelength.
74. A method as claimed in any of claims 71 to 73 wherein the intensity adjustment is achieved by varying the power to the or each excitation light source.
75. A method as claimed in any of claims 71 to 73 wherein the intensity adjustment is achieved by attenuating excitation light from the or each excitation light source.
76. A method as claimed in claim 74 or 75 wherein the power adjustment or attenuation is adjusted to provide substantially constant intensity luminescence from the specimen irrespective of wavelength.
77. A method as claimed in any of claims 1 to 76 wherein a single control centre produces signals suitable for driving, or controlling power to drives, or to control power to devices to effect movements and rotations required by the different steps of the method.
78. A method as claimed in any of claims 1 to 77 wherein the image capture device is a CCD which provides image data in analogue or digital format.
79. A method as claimed in claim 78 wherein the CCD camera is cooled to increase the S/N ratio of the camera output signals.
80. A method as claimed in any of claims 1 to 77 wherein the image capture device is a CMOS camera, a CID (charge injection device) camera, an intensified or gated camera, a photomultipher tube array, a photodiode array or an image capture device employing an addressable microcolometer array, or a chemical film camera, or other light sensitive sensor.
81. A method as claimed in any of claims 1 to 80 further comprising the step of forming an image using the light emitted by the specimen which in use is viewed through an eyepiece or is projected by a projection system onto a screen for viewing.
82. A method as claimed in claim 81 wherein the light from the specimen is split by a beam-splitting or beam directing device whereby the light can be split (or divided) between the image capture device and an eyepiece or projection system.
83. A method as claimed in any of claims 1 to 82 wherein a plurality of image capture devices are employed, each of which is supplied with light from the specimen.
84. A method as claimed in claim 83 wherein the or each image capture device is similar to the other image capture device(s).
85. A method as claimed in claim 83 wherein at least one of the image capture devices is of a different type from at least one of the other image capture devices.
86. A method as claimed in any of claims 83 to 85 wherein light from the specimen is split between the plurality of image capture devices.
87. A method as claimed in any of claims 83 to 85 wherein the light from the specimen is directed in different directions so as to be separately received by each of the plurality of image capture devices.
88. A method as claimed in any of claims 1 to 87 wherein image signals from the or each image capture device are supplied to a computer programmed to process and/or analyse the image signals.
89. A method as claimed of claim 88 wherein image signals from the image capture device and/or the computer produce an image in or on a display device or a projected image, for visual inspection.
90. A method as claimed in any of claims 1 to 87 wherein the image capture device signals are stored and subsequently read out for processing and analysis by a computer and/or to produce an image in or on a display device or a projected image, for visual inspection.
91. A method as claimed in any of the preceding claims wherein the excitation light is directed obliquely or axially towards the specimen.
92. A method as claimed in any of the preceding claims in which the excitation illumination of the specimen is dark field illumination, Rheinberg illumination, phase contrast illumination, or Differential Interference Contrast (DIC) illumination.
93. A method as claimed in any of the preceding claims wherein Hoffman Modulation contrast is employed.
94. A method as claimed in any of claims 1 to 91 wherein the excitation light is polarised.
95. A method as claimed in any of claims 1 to 90 wherein the excitation light is in the non- visible part of the spectrum.
96. A method as claimed in claim 95 wherein the excitation light is infrared light.
97. Apparatus by which light emitted from a specimen is imaged by an image capture device to produce a video signal for creating an image in a display device or for processing and analysis, comprising :-
- means for mounting the specimen,
- a light source for producing excitation light,
- a scanning system adapted to direct excitation light in one direction towards, and thereby to scan an area of the specimen and also adapted to convey light emitted from the specimen as a consequence of the excitation light incident thereon, in another direction, which operates in use to scan typically repeatedly an area of interest of the specimen,
- an image capture device having discrete spatially distinct light sensitive regions on which light emitted from the specimen is focussed to form an image after being conveyed through the scanning system in the said other direction, and
- control means adapted to control the excitation light and/or the image capture device so that light from the specimen is incident on the image capture device for a specific time period equal to that required by the scanning system to scan the area of interest n. times (where n is a whole number equal to or greater than 1).
98. Apparatus as claimed in claim 97 wherein the area of interest is the whole of the viewable area of the specimen.
99. Apparatus as claimed in claim 97 the scanning system is adapted to generate a window of variable size and location to enable some part of the area of the specimen to be scanned, to restrict the area of interest to part of the viewable area of the specimen.
100. Apparatus as claimed in claim 97, 98 or 99 wherein the scanning system is a confocal system.
101. Apparatus as claimed in any of claims 97 to 100 wherein the scanning system comprises a rotating Nipkow disc scanner in which excitation light passes through openings in the disc in one direction and light emitted by the specimen passes through the openings in the opposite direction to form an image on a sensor in the image capture device, and the pattern of openings is such that rotation of the disc through A0 results in scanning the whole of the area of interest, and the said specific time period is selected to correspond to nA° of rotation of the disc (where n is equal to one or a whole number greater than one).
102. Apparatus as claimed in claim 100 wherein the Nipkow disc scanner comprises a 2- disc arrangement.
103. Apparatus as claimed in claim 102 in which one of the discs contains microlenses in its openings.
104. Apparatus as claimed in any of claims 97 to 100 wherein the scanning system incorporates a pinhole and one complete scan using the pinhole corresponds to rotation of a Nipkow disc.
105. Apparatus as claimed in any of claims 97 to 100 wherein the scanning system incorporates a plurality of pinholes arranged in a fixed pattern, and one complete scan using the fixed pattern of pinholes corresponds to rotation of a Nipkow disc.
106. Apparatus as claimed in any of claims 97 to 100 wherein the scanning system incorporates a scanning slit scanner.
107. Apparatus as claimed in any of claims 97 to 100 wherein confocality is achieved by a 2 photon process which includes a 2 photon excitation source and limits the focal plane of activation, and wherein one pulse of the 2 photon excitation source corresponds to rotation of a Nipkow disc.
108. Apparatus as claimed in claim 97 to 100 wherein confocality is obtained by a time delay multiplexed process involving pinholes, wherein one complete scan of the pinholes corresponds to rotation of a Nipkow disc.
109. Apparatus as claimed in any of claims 97 to 100 wherein the scanning system employs an array of independently controllable mirrors and means for adjusting same, which in use synthesise an array of pinholes, and wherein one complete scan of the mirrors to create an image or subimage corresponds to rotation of a Nipkow disc.
110. Apparatus as claimed in any of claims 97 to 100 wherein the scanning system employs a random or quasi random pattern of transmissive and reflective elements which are scanned to produce an image, where one complete scan of the transmissive and reflective elements corresponds to rotation of a Nipkow disc.
111. Apparatus as claimed in any of claims 97 to 110 further comprising means which prevents light from reaching the specimen except from the excitation source, via the scanning system.
112. Apparatus as claimed in claim 111 further comprising means which prevents light from reaching the image capture device except from the specimen, via the scanning system.
113. Apparatus as claimed in any of claims 97 to 112 wherein means is provided by which light from the excitation light source is only incident on the specimen during each said specific time period.
114. Apparatus as claimed in any of claims 97 to 113 wherein the control means also controls the operation of the image capture device whereby it is read out at the end of each said specific time period and is reset prior to the beginning of the next specific time period.
115. Apparatus as claimed in claim 113 wherein the control means switches the excitation light source on and off to control the exposure duration so that the image capture device exposure is in turn governed or controlled by the time for which the excitation light source is active.
116. Apparatus as claimed in claim 113, 114 or 115 further comprising shutter means which in use is operated by signals from the control means to interrupt light from the excitation source except for when the specimen is to be illuminated.
117. Apparatus as claimed in claim 116 wherein the shutter means comprises an acousto- optic element.
118. Apparatus as claimed in any of claims 113 to 116 wherein the light is controlled by an intrinsic shutter.
119. Apparatus as claimed in any of claims 113 to 118 further comprising a light chopper for controlling the passage of excitation light to the specimen.
120. Apparatus as claimed in any of claims 113 to 119 further comprising second shutter means between the scanning system and the image capture device, which second shutter means is operated by signals from the control means so that in use light is prevented from reaching at least part of the image capture device sensor, except for the specific periods of time during which excitation light is incident on the specimen, for the purpose of reducing errors which could arise from phosphorescence, afterglow, stray reflections or light due to other effects, reaching the capture device.
121. Apparatus as claimed in claim 120 in so far as it is dependent on any of claims 116 to 119 wherein synchronising means is provided whereby in use, the two shutter means are operated synchronously.
122. Apparatus as claimed in any of claims 97 to 121 wherein the scanning system focuses the excitation light in a plane which contains or comprises the area of the specimen to be illuminated by the excitation light.
123. Apparatus as claimed in claim 122 which further includes drive means adapted to move the specimen, the scanning system, or an element of an optical system within the scanning system, along a linear axis (the Z axis) so that in use the position of the plane can adjusted relative to the specimen.
124. Apparatus as claimed in claim 123 wherein the linear axis drive means is also controlled by signals from the control means.
125. Apparatus as claimed in claim 123 or 124 wherein in use the control system operates so as to restrict movement along the linear axis to periods during which light is prevented from reaching the image capture device.
126. Apparatus as claimed in claim 123, 124 or 125 wherein in use the control system only produces movement along the linear axis during periods in which the excitation source light is inhibited or prevented from reaching the specimen.
127. Apparatus as claimed in any of claims 123 to 126 wherein the control means controls the linear axis drive in use so as to effect the linear axis movement at the end of each said specific time period, or after a succession of N such said specific time periods (N being an integer equal to or greater than 1).
128. Apparatus as claimed in any of claims 123 to 127 wherein the control system is adapted to control the distance moved by the specimen or scanning system or element thereof, along the linear axis.
129. Apparatus as claimed in claim 128 wherein in use the control system controls the linear axis drive means so that each movement of the specimen, or scanning system, or element thereof, produced by the drive means along the linear axis, is of the same size.
130. Apparatus as claimed in any of claims 123 to 127 wherein in use the control system controls the size of each movement of the specimen, or scanning system, or element thereof, along the linear axis, whereby each movement therealong may differ in size from those before and/or following.
131. Apparatus as claimed in any of claims 123 to 130 wherein the control system is adapted in use to control the linear axis drive means to move in discrete steps each of a predetermined equal size, and each linear axis movement of the specimen, or scanning system, or element thereof, is made up of one, or more than one, of the said discrete steps.
132. Apparatus as claimed in any of claims 123 to 131 wherein in use the control means controls the specimen illumination and image capture device exposure, by reference to the linear axis movement such that excitation illumination and image capture device exposure is only initiated after a linear movement has been completed.
133. Apparatus as claimed in any of claims 123 to 131 wherein in use the control means controls the time between exposures so that a sufficient period of time is provided in which the linear axis movement between exposures can be completed.
134. Apparatus as claimed in claim 123 or 124 wherein the linear axis motion of the specimen, or scanning system, or element thereof, is continuous.
135. Apparatus as claimed in claim 134 further comprising means by which deconvolution is applied to re-sharpen the image at the image capture device, or an image produced by signals from the image capture device, which is otherwise blurred due to the said continuous motion.
136. Apparatus as claimed in any of claims 97 to 135 wherein in use the wavelength of the excitation light is required to vary from one exposure to another, and the apparatus comprises two or more excitation light sources each producing excitation light of a different wavelength from the or each other source, and the control means is adapted in use to select the source to provide light of appropriate wavelength for each exposure.
137. Apparatus as claimed in any of claims 97 to 135 wherein in use the wavelength of the excitation light is required to vary from one exposure to another and the apparatus comprises a single source of excitation light which is adjustable to produce light of different wavelengths and the control means is adapted to adjust the source to produce light having the required wavelength for each exposure.
138. Apparatus as claimed in claim 136 or 137 wherein the control means is adapted in use to effect the wavelength change between the end of one exposure and the beginning of the next.
139. Apparatus as claimed in any of claims 123 to 138 wherein the control means is adapted in use to control the linear drive mans so that linear axis motion is alternatively in one direction and then in another
140. Apparatus as claimed in any of claims 97 to 139 wherein the specimen is carried by a microscope stage and means is provided to drive the stage along X and Y axes to bring into view other portions of a sample such as for example other cells on the same slide or in a multiwell plate, or other regions of an area of tissue, or of a single sample.
141. Apparatus as claimed in any of claims 97 to 140 wherein the excitation light source produces light of more than one wavelength at the same time.
142. Apparatus as claimed in claim 141 wherein the intensity of the light at the different wavelengths differs but peaks in intensity at one or a number of the different wavelengths.
143. Apparatus as claimed in any of claims 97 to 142 wherein the excitation light source comprises one or more laser light sources.
144. Apparatus as claimed in any of claims 97 to 142 wherein a single excitation light source is employed, the wavelength or wavelengths of the light emitted therefrom can be altered, and the control means is adapted in use to adjust the source to produce light of a desired wavelength or wavelengths.
145. Apparatus as claimed in claim 144 wherein the light source is a laser light source which comprises an acousto-optical tuneable filter (AOTF) crystal, and the control means is adapted to provide in use signals to alter the frequency controlling signal to the crystal, to control the wavelength (or wavelengths) of the emitted light.
146. Apparatus as claimed in claim 144 or 145 wherein in use the control means is adapted to alter the wavelength or wavelengths only between image capture device exposures or excitations.
147. Apparatus as claimed in any of claims 97 to 142 wherein the excitation light source is a luminescent or incandescent light source and an optical filter or a monochromator is provided which in use controls the wavelength or wavelengths of the light emitted by the source.
148. Apparatus as claimed in any of claims 97 to 142 wherein the excitation light source is a directly driven laser diode.
149. Apparatus as claimed in any of claims 97 to 147 wherein in use the excitation light source is operated so as to produce pulses of light.
150. Apparatus as claimed in any of claims 97 to 149 wherein in use the excitation light source produces polarised light.
151. Apparatus as claimed in any of claims 97 to 146 wherein the excitation light source is a light emitting diode (LED) source.
152. Apparatus as claimed in any of claims 97 to 151 wherein in use the control means is adapted to adjust the intensity of the excitation illumination incident on the specimen.
153. Apparatus as claimed in claim 152 further comprising a plurality of neutral density filters and means under the control of the control means, which in use selectively positions one or more of the neutral density filters in the light path, to achieve the intensity variation.
154. Apparatus as claimed in claim 152 further comprising an adjustable iris diaphragm in the light path and drive means operated by the control means, to open or close the iris as required.
155. Apparatus as claimed in claim 152 wherein in use the control means controls the excitation light intensity by adjusting the power to the excitation light source.
156. Apparatus as claimed in claim 152 wherein the excitation light intensity is controlled by means of an attenuating element and the control means is adapted in use to control or position the attenuating element as appropriate.
157. Apparatus as claimed in claim 156 wherein the attenuating element is an AOTF or LCD shutter.
158. Apparatus as claimed in any of claims 152 to 157 wherein the control means is adapted in use to alter the intensity of the illumination so as to provide a predetermined intensity of illumination at the specimen for each wavelength, to remove variation in intensity from one wavelength to another as can occur due to inherent intensity variation as between one source and another or between different modes of operation of the excitation light source.
159. Apparatus as claimed in any of claims 97 to 158 wherein in use the control means is adapted to adjust the power to the excitation light source and/or control attenuation of light therefrom, from one exposure to another, to provide substantially constant intensity luminescence, to reduce variation in the intensity of the light incident on the image capture device sensor due to differing wavelengths of excitation light, or to render the light emitted due to luminescence of similar intensity irrespective of wavelength, or both.
160. Apparatus as claimed in any of claims 152 to 159 wherein the intensity variation is only altered between exposures.
161. Apparatus as claimed in any of claims 97 to 160 wherein the image capture device is a CCD camera which provides a picture signal in analogue or digital format or both.
162. Apparatus as claimed in claim 160 wherein means is provided to cool the CCD camera, to increase the S/N ratio of the camera output signals.
163. Apparatus as claimed in any of claims 97 to 160 wherein the image capture device is a CMOS camera, a CID (charge injection device) camera, an intensified or gated camera, a photomultipher tube array, a photodiode array or an image capture device employing an addressable microcolometer array, or a chemical film camera, or any other light sensitive sensor.
164. Apparatus as claimed in any of claims 97 to 163 further comprising image forming means by which the light from the specimen is formed in use into an image, which can be viewed by the human eye through an eyepiece, or can be projected onto a screen.
165. Apparatus as claimed in claim 164 further comprising a beam-splitting or beam directing device in the light path to the image capture device by which light is split or divided between the image capture device and the image forming means.
166. Apparatus as claimed in any of claims 97 to 164 further comprising two or more image capture devices.
167. Apparatus as claimed in claim 166 wherein at least one of the image capture devices is different from the other device or from at least one of the other devices.
168. Apparatus as claimed in claim 166 or 167 further comprising a beam splitting means or beam directing means in the light path to the one or more image capture devices.
169. Apparatus as claimed in any of claims 97 to 168 further comprising an optical fibre bundle by which light is transmitted to the, or each, image capture device sensor.
170. Apparatus as claimed in any of claims 97 to 169 further comprising a data storage means adapted to store signals from the or each image capture device.
171. Apparams as claimed in any of claims 97 to 170 further comprising computer means programmed to process and analyse the signals from the or each image capture device or data storage means.
172. Apparatus as claimed in any of claims 97 to 171 further comprising a display device and means for supplying signals from the or each image capture device or from data storage means for displaying an image of the signals for visual analysis.
PCT/GB2003/004486 2002-10-16 2003-10-15 Improvements in and relating to imaging WO2004036898A2 (en)

Priority Applications (7)

Application Number Priority Date Filing Date Title
CA2502701A CA2502701C (en) 2002-10-16 2003-10-15 Improvements in and relating to imaging
AU2003301487A AU2003301487B2 (en) 2002-10-16 2003-10-15 Improvements in and relating to imaging
KR1020057006667A KR101160356B1 (en) 2002-10-16 2003-10-15 Improvements in and relating to imaging
US10/531,007 US8289620B2 (en) 2002-10-16 2003-10-15 Imaging
DE60312717T DE60312717T2 (en) 2002-10-16 2003-10-15 Apparatus and method for image formation
JP2004544480A JP4829499B2 (en) 2002-10-16 2003-10-15 Improvements related to imaging
EP03756579A EP1552333B1 (en) 2002-10-16 2003-10-15 Improvements in and relating to imaging

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
GBGB0224067.9A GB0224067D0 (en) 2002-10-16 2002-10-16 Improvements in and relating to imaging
GB0224067.9 2002-10-16

Publications (2)

Publication Number Publication Date
WO2004036898A2 true WO2004036898A2 (en) 2004-04-29
WO2004036898A3 WO2004036898A3 (en) 2004-06-17

Family

ID=9946015

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/GB2003/004486 WO2004036898A2 (en) 2002-10-16 2003-10-15 Improvements in and relating to imaging

Country Status (10)

Country Link
US (1) US8289620B2 (en)
EP (1) EP1552333B1 (en)
JP (1) JP4829499B2 (en)
KR (1) KR101160356B1 (en)
AT (1) ATE357679T1 (en)
AU (1) AU2003301487B2 (en)
CA (1) CA2502701C (en)
DE (1) DE60312717T2 (en)
GB (2) GB0224067D0 (en)
WO (1) WO2004036898A2 (en)

Cited By (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2005106561A1 (en) * 2004-04-28 2005-11-10 Perkinelmer Singapore Pte Ltd. Improvements in and relating to image capture
WO2006008637A1 (en) * 2004-07-23 2006-01-26 Ge Healthcare Niagara, Inc. Method and apparatus for fluorescent confocal microscopy
WO2006125674A1 (en) * 2005-05-25 2006-11-30 Stiftelsen Universitetsforskning Bergen Microscope system and screening method for drugs, physical therapies and biohazards
GB2413719B (en) * 2004-04-28 2007-07-18 Perkinelmer Improvements in and relating to image capture
EP1863228A1 (en) * 2006-05-31 2007-12-05 Carl Zeiss MicroImaging GmbH Laser scanning microscope with high-speed data processing
US10429304B2 (en) 2006-02-28 2019-10-01 Perkinelmer Singapore Pte Ltd. Apparatus and methods for imaging and modification of biological samples

Families Citing this family (20)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR101286216B1 (en) * 2004-09-01 2013-07-15 퍼킨엘머 싱가포르 피티이 리미티드 A method of analysing a sample and apparatus therefor
JP2007132794A (en) * 2005-11-10 2007-05-31 Olympus Corp Multiphoton excitation type observation device, and light source device for multiphoton excitation type observation
WO2009155499A2 (en) * 2008-06-19 2009-12-23 University Of Florida Research Foundation, Inc. Floating-element shear-stress sensor
US20120267549A1 (en) * 2009-05-07 2012-10-25 President And Fellows Of Havard College Methods and apparatus for fluorescence sensing employing fresnel zone plates
EP2550522B1 (en) 2010-03-23 2016-11-02 California Institute of Technology Super resolution optofluidic microscopes for 2d and 3d imaging
US9569664B2 (en) 2010-10-26 2017-02-14 California Institute Of Technology Methods for rapid distinction between debris and growing cells
JP2013542468A (en) * 2010-10-26 2013-11-21 カリフォルニア インスティチュート オブ テクノロジー Scanning projection lensless microscope system
US9643184B2 (en) 2010-10-26 2017-05-09 California Institute Of Technology e-Petri dishes, devices, and systems having a light detector for sampling a sequence of sub-pixel shifted projection images
CN103534627A (en) 2011-03-03 2014-01-22 加州理工学院 Light guided pixel
DE102011007751B4 (en) * 2011-04-20 2023-10-19 Carl Zeiss Microscopy Gmbh Wide-field microscope and method for wide-field microscopy
US9127861B2 (en) * 2011-10-31 2015-09-08 Solarreserve Technology, Llc Targets for heliostat health monitoring
JP6157155B2 (en) * 2012-03-15 2017-07-05 オリンパス株式会社 Microscope system, driving method and program
JP6108908B2 (en) * 2013-03-29 2017-04-05 オリンパス株式会社 Inverted microscope system
DE102013218795A1 (en) * 2013-09-19 2015-03-19 Carl Zeiss Microscopy Gmbh Laser scanning microscope and method for correcting aberrations, in particular in high-resolution scanning microscopy
FR3028867B1 (en) * 2014-11-26 2016-12-09 Intelligence Artificielle Applications METHOD AND DEVICE FOR DETECTING SOWING AND AUTOMATED SOWING INSTALLATION EQUIPPED WITH SUCH A DETECTION DEVICE
US10078778B2 (en) * 2015-01-15 2018-09-18 Massachusetts Institute Of Technology Systems, methods, and apparatus for in vitro single-cell identification and recovery
DE102016215177A1 (en) * 2016-08-15 2018-02-15 Carl Zeiss Microscopy Gmbh Method and arrangement for capturing image data
KR20180077781A (en) * 2016-12-29 2018-07-09 에이치피프린팅코리아 주식회사 Image scanning apparatus and method for scanning thereof
US11143855B2 (en) 2018-07-17 2021-10-12 Huron Technologies International Inc. Scanning microscope using pulsed illumination and MSIA
CN116744123B (en) * 2022-12-14 2024-01-23 深圳市中图仪器股份有限公司 Multi-well plate for confocal measurement system

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US4566029A (en) * 1984-03-23 1986-01-21 Rca Corporation Shuttered CCD camera with low noise
US4910606A (en) * 1981-12-29 1990-03-20 Canon Kabushiki Kaisha Solid state pick-up having particular exposure and read-out control
DE19627568A1 (en) * 1996-07-09 1998-01-15 Zeiss Carl Jena Gmbh Arrangement for confocal microscopy with top and lower carrier discs
US5969846A (en) * 1996-11-28 1999-10-19 Olympus Optical Co., Ltd. Confocal microscope
WO1999063381A1 (en) * 1998-05-30 1999-12-09 Carl Zeiss Jena Gmbh System and method for the microscopic generation of object images
US20020097490A1 (en) * 1999-03-23 2002-07-25 Olympus Optical Co., Ltd. Confocal microscope

Family Cites Families (33)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US4972258A (en) * 1989-07-31 1990-11-20 E. I. Du Pont De Nemours And Company Scanning laser microscope system and methods of use
JPH02266674A (en) * 1989-04-06 1990-10-31 Kyocera Corp Solid-state image pickup device
US5067805A (en) 1990-02-27 1991-11-26 Prometrix Corporation Confocal scanning optical microscope
EP0727684B1 (en) * 1991-10-31 2000-12-06 Yokogawa Electric Corporation Confocal optical scanner
JP3343276B2 (en) * 1993-04-15 2002-11-11 興和株式会社 Laser scanning optical microscope
JPH06317526A (en) * 1993-04-30 1994-11-15 Olympus Optical Co Ltd Multiple-wavelength light measuring instrument
AU3152795A (en) * 1994-07-28 1996-02-22 Victor B. Kley Scanning probe microscope assembly
JPH0943147A (en) 1995-07-28 1997-02-14 Bunshi Bio Photonics Kenkyusho:Kk Dark-field vertical illuminating type fluorescene microscope device
JP3019754B2 (en) * 1995-09-11 2000-03-13 横河電機株式会社 Nipkow disk type optical scanner
JPH09319408A (en) 1996-05-29 1997-12-12 Keyence Corp Interrupt signal monitor circuit and programmable controller
US6122396A (en) * 1996-12-16 2000-09-19 Bio-Tech Imaging, Inc. Method of and apparatus for automating detection of microorganisms
JPH10282426A (en) * 1997-04-01 1998-10-23 Nikon Corp Laser microscope
JP3612946B2 (en) * 1997-07-15 2005-01-26 ミノルタ株式会社 Display characteristic measuring device for color display device
JPH1196334A (en) * 1997-09-17 1999-04-09 Olympus Optical Co Ltd Image processor
JP3670839B2 (en) 1998-05-18 2005-07-13 オリンパス株式会社 Confocal microscope
JP2000098259A (en) * 1998-09-22 2000-04-07 Olympus Optical Co Ltd Photographic device for confocal microscope
JP2000275542A (en) * 1999-03-24 2000-10-06 Olympus Optical Co Ltd Confocal microscope
JP2000275534A (en) * 1999-03-23 2000-10-06 Olympus Optical Co Ltd Confocal microscope
JP4397993B2 (en) 1999-03-24 2010-01-13 オリンパス株式会社 Photomicroscope
JP2000275527A (en) * 1999-03-24 2000-10-06 Olympus Optical Co Ltd Image detecting device
US6371370B2 (en) * 1999-05-24 2002-04-16 Agilent Technologies, Inc. Apparatus and method for scanning a surface
JP2001091839A (en) * 1999-09-20 2001-04-06 Olympus Optical Co Ltd Confocal microscope
JP4418058B2 (en) 1999-09-22 2010-02-17 オリンパス株式会社 Scanning laser microscope
CA2330433A1 (en) * 2000-01-21 2001-07-21 Symagery Microsystems Inc. Smart exposure determination for imagers
JP2002090628A (en) * 2000-09-18 2002-03-27 Olympus Optical Co Ltd Confocal microscope
US6433929B1 (en) 2000-06-12 2002-08-13 Olympus Optical Co., Ltd. Scanning optical microscope and method of acquiring image
DE20122783U1 (en) * 2000-06-17 2007-11-15 Leica Microsystems Cms Gmbh Arrangement for examining microscopic specimens with a scanning microscope and illumination device for a scanning microscope
EP1164401B1 (en) 2000-06-17 2005-03-09 Leica Microsystems Heidelberg GmbH Entangled-photon microscope
US7062092B2 (en) 2000-08-22 2006-06-13 Affymetrix, Inc. System, method, and computer software product for gain adjustment in biological microarray scanner
JP2002075815A (en) * 2000-08-23 2002-03-15 Sony Corp Pattern tester and aligner control system using the same
DE10050529B4 (en) * 2000-10-11 2016-06-09 Leica Microsystems Cms Gmbh Method for beam control in a scanning microscope, arrangement for beam control in a scanning microscope and scanning microscope
JP4932076B2 (en) * 2000-10-30 2012-05-16 オリンパス株式会社 Scanning laser microscope
JP4256585B2 (en) * 2000-12-22 2009-04-22 富士フイルム株式会社 Jitter correction method for bidirectional scanning scanner and bidirectional scanning scanner capable of correcting jitter

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US4910606A (en) * 1981-12-29 1990-03-20 Canon Kabushiki Kaisha Solid state pick-up having particular exposure and read-out control
US4566029A (en) * 1984-03-23 1986-01-21 Rca Corporation Shuttered CCD camera with low noise
DE19627568A1 (en) * 1996-07-09 1998-01-15 Zeiss Carl Jena Gmbh Arrangement for confocal microscopy with top and lower carrier discs
US5969846A (en) * 1996-11-28 1999-10-19 Olympus Optical Co., Ltd. Confocal microscope
WO1999063381A1 (en) * 1998-05-30 1999-12-09 Carl Zeiss Jena Gmbh System and method for the microscopic generation of object images
US20020097490A1 (en) * 1999-03-23 2002-07-25 Olympus Optical Co., Ltd. Confocal microscope

Non-Patent Citations (3)

* Cited by examiner, † Cited by third party
Title
KAWAMURA S ET AL: "CONFOCAL LASER MICROSCOPE SCANNER AND CCD CAMERA" YOKOGAWA TECHNICAL REPORT ENGLISH EDITION , [Online] no. 33, 2002, XP002277034 Retrieved from the Internet: <URL:http://www.yokogawa.com/rd/pdf/TR/rd- tr-r00033-005.pdf> [retrieved on 2004-04-15] cited in the application *
PATENT ABSTRACTS OF JAPAN vol. 015, no. 018 (E-1023), 16 January 1991 (1991-01-16) -& JP 02 266674 A (KYOCERA CORP), 31 October 1990 (1990-10-31) *
TANAAMI T ET AL: "HIGH-SPEED 1-FRAME/MS SCANNING CONFOCAL MICROSCOPE WITH A MICROLENS AND NIPKOW DISKS" APPLIED OPTICS, OPTICAL SOCIETY OF AMERICA,WASHINGTON, US, vol. 41, no. 22, 1 August 2002 (2002-08-01), pages 4704-4708, XP001131422 ISSN: 0003-6935 *

Cited By (11)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2005106561A1 (en) * 2004-04-28 2005-11-10 Perkinelmer Singapore Pte Ltd. Improvements in and relating to image capture
GB2413719B (en) * 2004-04-28 2007-07-18 Perkinelmer Improvements in and relating to image capture
US8159531B2 (en) 2004-04-28 2012-04-17 Perkinelmer Singapore Pte Ltd. Controlling operations in an image formation process in confocal microscope
WO2006008637A1 (en) * 2004-07-23 2006-01-26 Ge Healthcare Niagara, Inc. Method and apparatus for fluorescent confocal microscopy
US7335898B2 (en) 2004-07-23 2008-02-26 Ge Healthcare Niagara Inc. Method and apparatus for fluorescent confocal microscopy
JP2008507719A (en) * 2004-07-23 2008-03-13 ジーイー・ヘルスケア・ナイアガラ・インク Confocal fluorescence microscopy and equipment
AU2005264061B2 (en) * 2004-07-23 2009-05-21 Ge Healthcare Niagara, Inc. Method and apparatus for fluorescent confocal microscopy
WO2006125674A1 (en) * 2005-05-25 2006-11-30 Stiftelsen Universitetsforskning Bergen Microscope system and screening method for drugs, physical therapies and biohazards
US10429304B2 (en) 2006-02-28 2019-10-01 Perkinelmer Singapore Pte Ltd. Apparatus and methods for imaging and modification of biological samples
EP1863228A1 (en) * 2006-05-31 2007-12-05 Carl Zeiss MicroImaging GmbH Laser scanning microscope with high-speed data processing
US7869123B2 (en) 2006-05-31 2011-01-11 Carl Zeiss Microimaging Gmbh Laser scanning microscope with high-speed data processing

Also Published As

Publication number Publication date
DE60312717T2 (en) 2007-12-06
DE60312717D1 (en) 2007-05-03
EP1552333A2 (en) 2005-07-13
GB2395265A (en) 2004-05-19
CA2502701C (en) 2012-09-18
AU2003301487A1 (en) 2004-05-04
JP4829499B2 (en) 2011-12-07
US8289620B2 (en) 2012-10-16
GB0224067D0 (en) 2002-11-27
GB2395265B (en) 2005-08-24
EP1552333B1 (en) 2007-03-21
KR101160356B1 (en) 2012-06-26
WO2004036898A3 (en) 2004-06-17
AU2003301487B2 (en) 2009-10-01
GB0324250D0 (en) 2003-11-19
JP2006503283A (en) 2006-01-26
CA2502701A1 (en) 2004-04-29
US20060124870A1 (en) 2006-06-15
ATE357679T1 (en) 2007-04-15
KR20050083776A (en) 2005-08-26

Similar Documents

Publication Publication Date Title
CA2502701C (en) Improvements in and relating to imaging
EP1580586B1 (en) Scanning confocal microscope
US6426835B1 (en) Confocal microscope
US6038067A (en) Scanning computed confocal imager
US5923466A (en) Light modulated confocal optical instruments and method
US7532323B2 (en) Spatial light modulator apparatus and method
JP3343276B2 (en) Laser scanning optical microscope
EP1431795A1 (en) Confocal microscope
US5969846A (en) Confocal microscope
US6927903B2 (en) Rapidly changing dichroic beamsplitter
CN107167929A (en) Double mode optical ultra-discrimination microscopic imaging device and method based on DMD
WO2010109811A1 (en) Observation device
JP2009532732A (en) Confocal microscope having a two-dimensional array of light emitting diodes
JP2006504140A (en) Random access high-speed confocal microscope
JP2971554B2 (en) Laser scanning retinal camera
WO1992017806A1 (en) Multiple path scanning microscope
JP2000275534A (en) Confocal microscope
JPH09189864A (en) Optical scanning type microscope
JPH11237554A (en) Scanning type optical microscope
JP4632479B2 (en) Microscope equipment
JPH09166750A (en) Observing method and microscope
CN116897309A (en) Digital microscope and method of operating a digital microscope
JP2006030280A (en) Illumination device and method for microscope, and computer program
JPH02207211A (en) Scanning type optical microscope device
Ma et al. A video rate laser scanning confocal microscope

Legal Events

Date Code Title Description
AK Designated states

Kind code of ref document: A2

Designated state(s): AE AG AL AM AT AU AZ BA BB BG BR BY BZ CA CH CN CO CR CU CZ DE DK DM DZ EC EE ES FI GB GD GE GH GM HR HU ID IL IN IS JP KE KG KP KR KZ LC LK LR LS LT LU LV MA MD MG MK MN MW MX MZ NO NZ OM PH PL PT RO RU SC SD SE SG SK SL TJ TM TN TR TT TZ UA UG US UZ VC VN YU ZA ZM ZW

AL Designated countries for regional patents

Kind code of ref document: A2

Designated state(s): GH GM KE LS MW MZ SD SL SZ TZ UG ZM ZW AM AZ BY KG KZ MD RU TJ TM AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HU IE IT LU MC NL PT RO SE SI SK TR BF BJ CF CG CI CM GA GN GQ GW ML MR NE SN TD TG

121 Ep: the epo has been informed by wipo that ep was designated in this application
DFPE Request for preliminary examination filed prior to expiration of 19th month from priority date (pct application filed before 20040101)
WWE Wipo information: entry into national phase

Ref document number: 2003301487

Country of ref document: AU

WWE Wipo information: entry into national phase

Ref document number: 2502701

Country of ref document: CA

Ref document number: 2003756579

Country of ref document: EP

Ref document number: 2004544480

Country of ref document: JP

WWE Wipo information: entry into national phase

Ref document number: 1020057006667

Country of ref document: KR

WWP Wipo information: published in national office

Ref document number: 2003756579

Country of ref document: EP

WWP Wipo information: published in national office

Ref document number: 1020057006667

Country of ref document: KR

ENP Entry into the national phase

Ref document number: 2006124870

Country of ref document: US

Kind code of ref document: A1

WWE Wipo information: entry into national phase

Ref document number: 10531007

Country of ref document: US

WWP Wipo information: published in national office

Ref document number: 10531007

Country of ref document: US

WWG Wipo information: grant in national office

Ref document number: 2003756579

Country of ref document: EP