WO1998046007A1 - Imaging system & method - Google Patents

Imaging system & method Download PDF

Info

Publication number
WO1998046007A1
WO1998046007A1 PCT/AU1998/000250 AU9800250W WO9846007A1 WO 1998046007 A1 WO1998046007 A1 WO 1998046007A1 AU 9800250 W AU9800250 W AU 9800250W WO 9846007 A1 WO9846007 A1 WO 9846007A1
Authority
WO
WIPO (PCT)
Prior art keywords
mask
apertures
image
opaque
masking
Prior art date
Application number
PCT/AU1998/000250
Other languages
French (fr)
Inventor
Donald James Bone
Original Assignee
Commonwealth Scientific And Industrial Research Organisation
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Commonwealth Scientific And Industrial Research Organisation filed Critical Commonwealth Scientific And Industrial Research Organisation
Priority to AU68139/98A priority Critical patent/AU6813998A/en
Publication of WO1998046007A1 publication Critical patent/WO1998046007A1/en

Links

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N25/00Circuitry of solid-state image sensors [SSIS]; Control thereof
    • H04N25/48Increasing resolution by shifting the sensor relative to the scene
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N25/00Circuitry of solid-state image sensors [SSIS]; Control thereof
    • GPHYSICS
    • G02OPTICS
    • G02BOPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B2207/00Coding scheme for general features or characteristics of optical elements and systems of subclass G02B, but not including elements and systems which would be classified in G02B6/00 and subgroups
    • G02B2207/129Coded aperture imaging
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N1/00Scanning, transmission or reproduction of documents or the like, e.g. facsimile transmission; Details thereof
    • H04N1/04Scanning arrangements, i.e. arrangements for the displacement of active reading or reproducing elements relative to the original or reproducing medium, or vice versa
    • H04N1/19Scanning arrangements, i.e. arrangements for the displacement of active reading or reproducing elements relative to the original or reproducing medium, or vice versa using multi-element arrays
    • H04N1/195Scanning arrangements, i.e. arrangements for the displacement of active reading or reproducing elements relative to the original or reproducing medium, or vice versa using multi-element arrays the array comprising a two-dimensional array or a combination of two-dimensional arrays
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N2201/00Indexing scheme relating to scanning, transmission or reproduction of documents or the like, and to details thereof
    • H04N2201/04Scanning arrangements
    • H04N2201/0402Arrangements not specific to a particular one of the scanning methods covered by groups H04N1/04 - H04N1/207
    • H04N2201/0458Additional arrangements for improving or optimising scanning resolution or quality

Definitions

  • This invention relates to imaging systems and methods .
  • imaging system and “imaging method” refer to systems and methods in which radiation is detected and an image produced.
  • radiation is to be given a broad meaning and includes the emission of any rays, wave motion, or particles from a source. It includes light and other form of electromagnetic radiation.
  • image is also to be given a broad meaning and includes all forms of representation of detected radiation including mathematical, digital and analog models representing an actual image, wherein the image is represented by a plurality of distributed signals. The invention has application to improving the resolution of high definition imaging systems and methods .
  • the invention has particular but not exclusive application to imaging systems such as those which utilise charge coupled devices (CCDs) ie digital cameras, camcorders etc and for illustrative purposes reference will be made herein to such devices.
  • CCDs charge coupled devices
  • the invention is also applicable to other imaging systems such as spectrometry for example.
  • imaging systems which improve the signal to noise in an image by using a plurality of different masks on each detector element and combining the results from these masks to construct an image at higher resolution than the detector system.
  • These systems are generally derived from Hadamard matrices and applied in spectroscopic imaging.
  • the present invention aims to provide an alternative to known imaging systems in which radiation is detected and an image which is represented by a plurality of distributed signals is produced, and to known methods of improving the resolution of such imaging systems .
  • This invention in one aspect resides broadly in a method of improving the resolution of an imaging system in which radiation is detected and an image which is represented by a plurality of distributed signals is produced, the method including:- improving the signal to noise ratio of the image.
  • this invention resides broadly in an imaging system in which radiation is detected and an image which is represented by a plurality of distributed signals is produced, the system including:- means for improving the signal to noise ratio of the image .
  • Masking matrices can be constructed which produce a low uniform error. However these so-called S matrices have inconvenient dimensions (3, 7, 15, 19, 23, 31, 35,
  • n x n square masks and hierarchical refinement of the resolution cannot be utilised. Accordingly it is preferred that the masks are chosen so as to allow for square (n x n) arrays of aperture elements for each detector and so that the apertures can be arranged as an embedded set which facilitate heirarchical refinement of the resolution.
  • the distribution of the signal to noise ratio of the image is uniform.
  • the radiation is detected by a charge coupled device having a two-dimensional array of light sensitive detector elements and resolution is enhanced by sequentially masking discrete areas of each detector element with an apertured opaque mask, it is preferred that the signal to noise ratio of the image is improved by means of a coded aperture system.
  • coded aperture system means an aperture system which utilises a series of apertures to sample an image or other extended signal.
  • the apertures modulate the signal on the detector element such that the detector integrates the modulated result over the aperture.
  • the size of the apertured opaque mask substantially corresponds with that of the light sensitive detector elements and that the mask comprises a two-dimensional array of apertures substantially aligned with each detector element, each aperture comprising a two-dimensional array of transparent and/or opaque aperture portions whereby the configuration of the mask can be represented mathematically by a masking matrix, the transparent and opaque aperture portions being represented in the matrix by +1 and 0 respectively.
  • the configuration of the apertured opaque mask is determined by stochastically searching the space of sets of apertures achieved by complementing individual apertures in the set.
  • complementing means changing opaque regions to transparent regions and vice versa. It is preferred that the stochastic searching commences with a canonical set of apertures which does not produce spatially uniform signal-to-noise response in the reconstructed image and progresses until a suitable set of apertures is achieved.
  • this invention resides broadly in a method of determining the configuration of an apertured opaque mask for improving the resolution of an imaging system in which radiation is detected and an image which is represented by a plurality of distributed signals is produced, the size of the mask substantially corresponding with that of the light sensitive detector elements and the mask comprising a two-dimensional array of apertures substantially aligned with each detector element, each aperture comprising a two-dimensional array of transparent and/or opaque aperture portions, the method including:- representing the configuration of the mask mathematically by a masking matrix in which said transparent and opaque portions are represented by +1 and 0 respectively; inverting the masking matrix, and stochastically searching the space of masking matrices achieved by complementing rows of the masking matrix.
  • this invention also resides in an apertured opaque mask for improving the resolution of an imaging system in which radiation is detected and an image which is represented by a plurality of distributed signals is produced, the mask including:- a two-dimensional array of apertures each comprising a two-dimensional array of transparent and/or opaque aperture portions, and the size of the mask substantially corresponding with that of the light sensitive detector elements; wherein the configuration of the transparent and opaque portions is determined in accordance with the method defined above.
  • FIGS 1,3 and 5 illustrate the Haar wave-packet basis (also known as the Hadamard- alsh basis) for 2 x 2, 4 4 and 8 x 8 image blocks respectively;
  • FIGS 2 and 4 illustrate the division of the CCD elements into pixels and the relationship of the pixels to the transform coefficients for the 2 x 2 and 4 x 4 image blocks respectively;
  • FIG 6 illustrates an arrangement of masked detector elements for a linear scanning detector
  • FIG 7 illustrates a set of 4 x 4 pixel apertures with uniform noise sensitivity.
  • This high resolution image block contained within each CCD pixel is sampled by means of the Haar wave-packet expansion.
  • the term "element” will be used to refer to the CCD detector elements and the term "pixel” used to refer to the N x N sub-elements into which the CCD element is divided.
  • Haar wave-packet expansion If the N x N pixels are broken into 2 x 2 blocks, each block can be represented in terms of a basis illustrated in FIG 1. In each of these four weighting functions, the weights are either +1 (black) or -1 (white). Applying these weights to the 2 2 image block will give four coefficients from which the image block samples can be exactly reconstructed.
  • the basis for the 2 x 2 Haar wave-packet transform can be represented with a matrix in which the rows of the matrix are the basis vectors.
  • the division of the CCD element into pixels and the relationship of the pixels to the transform coefficients is illustrated for the case above by FIG 2.
  • the shaded coefficients are drawn from the shaded set of pixels by the transformation in equation 1.
  • the reconstruction of the pixel values from the basis coefficients for a single block is given by equation 2.
  • the N x N pixel image block can therefore be represented as four N/2 x N/2 sub-band image blocks.
  • Each N/2 x N/2 sub-band block can itself be encoded as four N/4 x N/4 sub-band blocks, using the same 2 x 2 block coding scheme.
  • this can be viewed as a single step encoding of the original N x N block by breaking the block into 4 x 4 pixel blocks and filtering with the weighting filters illustrated in FIG 3 which is equivalent to a two-dimensional Hadamard/ alsh basis.
  • each weighting function consists of a 4 x 4 array.
  • the blocking of the pixels in the CCD element is illustrated in FIG 4.
  • the pixels in the shaded region are used to generate the shaded coefficients.
  • the matrix form of the 4 x 4 block coding is given in equation 3.
  • a row of the matrix corresponds to a single block in the mask (one of the 4 x 4 regions) and yet the whole matrix has the same pattern as in the mask.
  • N 2 weighting functions each of N x N values and the resulting sub-bands consist of single values.
  • the matrix form has the same pattern of 1 and -1 elements as the set of masks, with black interpreted as 1 and white interpreted as -1. Because the coefficients are single values the masks can be used to sample the image, one coefficient value being derived from a detector masked by one of each of the masks. Given this sampling of an image block, the image block can be constructed from the samples by using the inverse of the matrix.
  • the matrix is easily constructed by a process which starts with just the first row vector, which is all l's.
  • the process is illustrated with the Matlab source code below: -
  • A ones ( l,xSz) ;
  • the family of matrices generated by this algorithm is referred to as ⁇ N 2 .
  • the family of matrices can serve as either a one-dimensional linear basis for vectors of length N 2 or, through the unusual symmetry mentioned above, as a two-dimensional basis for blocks of N x N pixels .
  • the inverse of the matrix is the same as the matrix except for a factor of l/N 2 .
  • an image block can be sampled with multiplicative intensity masks corresponding to an orthogonal basis for images within the block.
  • intensity measured by the detector element is strictly positive, negative values in the intensity mask are difficult to support. Practical difficulties also mean that a continuously variable mask is difficult to achieve with any accuracy.
  • the Haar wave-packet basis described above is strictly binary valued with a weighting factor of 1 or -1. If the basis is modified slightly and all the -1 masking factors set to zero, the resulting mask can easily be achieved with opaque masking.
  • This set of weighting functions is a complete (although non-orthogonal) basis for the image block.
  • the matrix representation of the resulting basis for 4 4 blocks is given in equation 5.
  • Equation 5 is more succinctly written as
  • the inverse matrix M AXT is in general
  • Q -.N 2 is an ⁇ 2 x ⁇ 2 matrix with zeros everywhere except in the top left coefficient which is 1. This can be verified by checking the product
  • I k is the k x k identity matrix.
  • the sampling process for the k th n x n block of pixels in the image (of the size of a CCD element) consists of integrating the intensity through each of the N 2 masks represented by the matrix vi 2 to derive the set of coefficients c ⁇
  • the pixel values can then be recovered by simply applying the transform
  • the arrangement of the blocks for most efficient acquisition of the image depends on the application. For many applications, the most efficient acquisition is achieved when the masks are arranged so that each sequence of N 2 masks is in a row with the masks in each column being identical. This sequence could be repeated to reduce the scan size if necessary. However if the total acquisition time is not critical the scanning head need only be N 2 elements wide and could be as high as is necessary to cover the image.
  • the array is moved in a linear scan, as indicated in FIG 6, in steps of the CCD element separation. The output of each element can be recorded at each step to build a set of coefficients for each block.
  • the masks in FIG 6 are arranged in scale order so that the first 4 elements can be used to reconstruct to a resolution of 1/2 the CCD element size; the first 16 elements can be used to reconstruct to a resolution of 1/4 the CCD element size etc. This allows variable (dyadic) resolution scanning with identical scanning geometry from the same detector.
  • each detector element has associated with it zero-mean additive Gaussian-distributed noise. This is a reasonable approximation to the behaviour of a real detector because much of the noise is due to thermal processes and is substantially independent of the light falling on the detector. The signal then looks like
  • Each pixel is subject to the noise from a single measurement.
  • the noise from a single measurement.
  • This spatially variable noise can be corrected without affecting the mean square response by redistributing the noise on the reconstructed image.
  • N 2 x N 2 matrix X N 2 , ⁇ when multiplied on the left of the masking matrix M ⁇ . complements the i th masking vectors ie the complementing process turns l's to 0 ' s and 0 ' s to l's in one row of M N . - X n ⁇ , i will be the identity matrix with the i h row modified so that the first element is 1 and the diagonal element is -1. This produces a modified masking matrix
  • Ntf 'O.'i .,] X N , ⁇ X N , i, X N- ⁇ M ⁇ A ⁇ - (28)
  • ⁇ ⁇ 1 [ 0 c, ... c N2 _ (30)
  • Equation 34 then becomes
  • N must be an even integer.
  • N is a power of 2
  • a row, i, of the masking matrix which has already been complemented is then randomly chosen together with a row, j, of the masking matrix which has not been complemented. These two rows are then effectively complemented leaving the masking matrix with the same total number of complemented rows with respect to M .
  • the first column of the inverse of the masking matrix is then checked and if it has the same magnitude for all components, a set of masks has been derived which produce the desired uniform noise sensitivity in the reconstruction.
  • FIG 7. An example of a set of masks configured by this process is illustrated in FIG 7. It can be seen that the masks have the same form as the original masks illustrated in FIG 3 except that five of them are the complements of the original masks.
  • the method and system of the present invention has a number of advantages over known imaging systems in which radiation is detected and an image which is represented by a plurality of distributed signals is produced, and over known methods of improving the resolution of such imaging systems .
  • the performance of high definition cameras incorporating the system and method of the present invention has the advantage of using the same number of samples but in such a way that each aperture transmits at least 50% of the incoming flux onto the CCD. This reduces the lighting requirements and at the same time improves the signal to noise ratio.
  • the present invention permits the use of a linearly scanned imaging detector with larger sensing elements than the required resolution. This allows the use of coarser features in the integrated circuits of the detector than would be required for a fixed resolution detector of equivalent effective resolution. This results in higher yields and cheaper production technology for the chips, whereby apparatus in accordance with the invention can be fabricated at lower cost than standard devices with similar resolution.
  • the scanning of the detector consists of a single linear scan of the device across the image plane. This simpler geometry has advantages in terms of the mechanical system required and the speed with which it can be effectively scanned, thus allowing the device to take advantage of the improved signal to noise performance.
  • the set of masks can be arranged such that the first four masks can be used to reconstruct an image with twice the resolution and the first 16 masks can be used to construct an image with four times the resolution etc .
  • This embedded construction allows for adaptive resolution changes with a single set of masks.
  • Reduced exposure times means that the device can more easily be used on live subjects and in more normal lighting conditions than prior art technology.
  • the linear scan means that the technology is suitable for use in scanning imaging devices such as flat bed scanners, drum scanners, or film scanners .

Abstract

A method is disclosed of improving the resolution of an imaging system in which radiation is detected and an image which is represented by a plurality of distributed signals is produced, wherein the method includes improving the signal to noise ratio of the image. Radiation is detected by a charge coupled device having a two-dimensional array of light sensitive detector elements and resolution is enhanced by sequentially masking discrete areas of each detector element with an apertured opaque mask chosen so as to allow for square (n x n) arrays of aperture elements for each detector and so that the apertures can be arranged as an embedded set which facilitate heirarchical refinement of the resolution.

Description

"IMAGING SYSTEM AND METHOD"
Technical Field This invention relates to imaging systems and methods .
As used herein the expressions "imaging system" and "imaging method" refer to systems and methods in which radiation is detected and an image produced. As used herein the expression "radiation" is to be given a broad meaning and includes the emission of any rays, wave motion, or particles from a source. It includes light and other form of electromagnetic radiation. As used herein the expression "image" is also to be given a broad meaning and includes all forms of representation of detected radiation including mathematical, digital and analog models representing an actual image, wherein the image is represented by a plurality of distributed signals. The invention has application to improving the resolution of high definition imaging systems and methods . The invention has particular but not exclusive application to imaging systems such as those which utilise charge coupled devices (CCDs) ie digital cameras, camcorders etc and for illustrative purposes reference will be made herein to such devices. However it will be appreciated that the invention is also applicable to other imaging systems such as spectrometry for example.
Background of Invention
It is known that some high definition cameras achieve a higher resolution than the detector element array used in their detection system by masking each detector element array element with an opaque mask which allows light through a small central aperture. By moving this aperture around an area the size of the detector element, it is possible to progressively build a full sampling of the pixel area at the resolution defined by the aperture .
It is also known that imaging systems exist which improve the signal to noise in an image by using a plurality of different masks on each detector element and combining the results from these masks to construct an image at higher resolution than the detector system. These systems are generally derived from Hadamard matrices and applied in spectroscopic imaging.
Summary of Invention
The present invention aims to provide an alternative to known imaging systems in which radiation is detected and an image which is represented by a plurality of distributed signals is produced, and to known methods of improving the resolution of such imaging systems .
This invention in one aspect resides broadly in a method of improving the resolution of an imaging system in which radiation is detected and an image which is represented by a plurality of distributed signals is produced, the method including:- improving the signal to noise ratio of the image. In another aspect this invention resides broadly in an imaging system in which radiation is detected and an image which is represented by a plurality of distributed signals is produced, the system including:- means for improving the signal to noise ratio of the image .
Masking matrices can be constructed which produce a low uniform error. However these so-called S matrices have inconvenient dimensions (3, 7, 15, 19, 23, 31, 35,
43,47, 63, 71, 79, 83 ) none of which are power of two (2k) and none of which are square integer (k2) . This has disadvantages in that n x n square masks and hierarchical refinement of the resolution cannot be utilised. Accordingly it is preferred that the masks are chosen so as to allow for square (n x n) arrays of aperture elements for each detector and so that the apertures can be arranged as an embedded set which facilitate heirarchical refinement of the resolution.
Most preferably the distribution of the signal to noise ratio of the image is uniform.
In an embodiment in which the radiation is detected by a charge coupled device having a two-dimensional array of light sensitive detector elements and resolution is enhanced by sequentially masking discrete areas of each detector element with an apertured opaque mask, it is preferred that the signal to noise ratio of the image is improved by means of a coded aperture system.
As used herein the expression "coded aperture system" means an aperture system which utilises a series of apertures to sample an image or other extended signal. (The apertures modulate the signal on the detector element such that the detector integrates the modulated result over the aperture. By combining the results from a number of different apertures or from displaced versions of the same aperture, the signal can be reconstructed at a higher resolution than the aperture dimensions would normally allow) .
It is preferred that the size of the apertured opaque mask substantially corresponds with that of the light sensitive detector elements and that the mask comprises a two-dimensional array of apertures substantially aligned with each detector element, each aperture comprising a two-dimensional array of transparent and/or opaque aperture portions whereby the configuration of the mask can be represented mathematically by a masking matrix, the transparent and opaque aperture portions being represented in the matrix by +1 and 0 respectively.
The two dimensional arrays may be other than square arrays and the sub-elements or pixel array need not necessarily be constrained to a power of two configuration, but it is preferred that there are N x N sub-elements or pixels in the mask where N = 2n with n an integer. It will be appreciated that the analysis which can be applied to a 4 x 4 array can also be applied to an 8 x 2 or l6 x l array .
In a preferred embodiment the configuration of the apertured opaque mask is determined by stochastically searching the space of sets of apertures achieved by complementing individual apertures in the set. As used herein the expression "complementing" means changing opaque regions to transparent regions and vice versa. It is preferred that the stochastic searching commences with a canonical set of apertures which does not produce spatially uniform signal-to-noise response in the reconstructed image and progresses until a suitable set of apertures is achieved.
In another aspect this invention resides broadly in a method of determining the configuration of an apertured opaque mask for improving the resolution of an imaging system in which radiation is detected and an image which is represented by a plurality of distributed signals is produced, the size of the mask substantially corresponding with that of the light sensitive detector elements and the mask comprising a two-dimensional array of apertures substantially aligned with each detector element, each aperture comprising a two-dimensional array of transparent and/or opaque aperture portions, the method including:- representing the configuration of the mask mathematically by a masking matrix in which said transparent and opaque portions are represented by +1 and 0 respectively; inverting the masking matrix, and stochastically searching the space of masking matrices achieved by complementing rows of the masking matrix.
In a further aspect this invention also resides in an apertured opaque mask for improving the resolution of an imaging system in which radiation is detected and an image which is represented by a plurality of distributed signals is produced, the mask including:- a two-dimensional array of apertures each comprising a two-dimensional array of transparent and/or opaque aperture portions, and the size of the mask substantially corresponding with that of the light sensitive detector elements; wherein the configuration of the transparent and opaque portions is determined in accordance with the method defined above.
Description of Drawings In order that this invention may be more easily understood and put into practical effect, reference will now be made to the accompanying drawings which illustrate a preferred embodiment of the invention, wherein:-
FIGS 1,3 and 5 illustrate the Haar wave-packet basis (also known as the Hadamard- alsh basis) for 2 x 2, 4 4 and 8 x 8 image blocks respectively;
FIGS 2 and 4 illustrate the division of the CCD elements into pixels and the relationship of the pixels to the transform coefficients for the 2 x 2 and 4 x 4 image blocks respectively;
FIG 6 illustrates an arrangement of masked detector elements for a linear scanning detector, and
FIG 7 illustrates a set of 4 x 4 pixel apertures with uniform noise sensitivity.
Description of Preferred Embodiment of Invention
For the purpose of the description of the preferred embodiment of the invention and an explanation of the underlying theory, each CCD pixel or element is considered to consist of an array of higher resolution sub-pixels or sub-elements (say N x N where N = 2π with n an integer). This high resolution image block contained within each CCD pixel is sampled by means of the Haar wave-packet expansion. Throughout the specification in general, the term "element" will be used to refer to the CCD detector elements and the term "pixel" used to refer to the N x N sub-elements into which the CCD element is divided. Haar wave-packet expansion If the N x N pixels are broken into 2 x 2 blocks, each block can be represented in terms of a basis illustrated in FIG 1. In each of these four weighting functions, the weights are either +1 (black) or -1 (white). Applying these weights to the 2 2 image block will give four coefficients from which the image block samples can be exactly reconstructed.
The basis for the 2 x 2 Haar wave-packet transform can be represented with a matrix in which the rows of the matrix are the basis vectors. The division of the CCD element into pixels and the relationship of the pixels to the transform coefficients is illustrated for the case above by FIG 2. The shaded coefficients are drawn from the shaded set of pixels by the transformation in equation 1. The reconstruction of the pixel values from the basis coefficients for a single block is given by equation 2.
Figure imgf000008_0002
Figure imgf000008_0004
Figure imgf000008_0001
Figure imgf000008_0003
Figure imgf000008_0005
Figure imgf000008_0006
The N x N pixel image block can therefore be represented as four N/2 x N/2 sub-band image blocks. Each N/2 x N/2 sub-band block can itself be encoded as four N/4 x N/4 sub-band blocks, using the same 2 x 2 block coding scheme. Alternatively this can be viewed as a single step encoding of the original N x N block by breaking the block into 4 x 4 pixel blocks and filtering with the weighting filters illustrated in FIG 3 which is equivalent to a two-dimensional Hadamard/ alsh basis.
In the basis illustrated in FIG 3 the weighting functions only take the values of 1 or -1, but now each weighting function consists of a 4 x 4 array. The blocking of the pixels in the CCD element is illustrated in FIG 4. The pixels in the shaded region are used to generate the shaded coefficients. The matrix form of the 4 x 4 block coding is given in equation 3.
Figure imgf000009_0001
An unusual symmetry is observed between the row/column ordered coefficients of the matrix and the masks in FIG 3. A row of the matrix corresponds to a single block in the mask (one of the 4 x 4 regions) and yet the whole matrix has the same pattern as in the mask.
This process can be continued until there are N2 weighting functions each of N x N values, and the resulting sub-bands consist of single values. The full set for N=8 is illustrated in FIG 5. The matrix form has the same pattern of 1 and -1 elements as the set of masks, with black interpreted as 1 and white interpreted as -1. Because the coefficients are single values the masks can be used to sample the image, one coefficient value being derived from a detector masked by one of each of the masks. Given this sampling of an image block, the image block can be constructed from the samples by using the inverse of the matrix.
The matrix is easily constructed by a process which starts with just the first row vector, which is all l's. The process is illustrated with the Matlab source code below: -
n = 4; xSz = 2Λn; n = log(xSz) /log(2) ; ySz = 2; jO = 2; k = 2;
A = ones ( l,xSz) ;
A(2,:) = [A(l,l:2:xSz) ,-A( 1, 1 : 2 :xSz ) ]; for j = l:n-l, for i = jO:ySz, k= k+1;
A(k,:) = [A(i,l:2:xSz) ,A(i, 1: 2 :xSz ) ] ; k = k+1;
A(k,:) = [A(i,l:2:xSz) , -A(i, 1:2 :xSz ) ] ; end jO = ySz+1; ySz = 2*ySz; end
The family of matrices generated by this algorithm is referred to as ΛN2. The family of matrices can serve as either a one-dimensional linear basis for vectors of length N2 or, through the unusual symmetry mentioned above, as a two-dimensional basis for blocks of N x N pixels .
The inverse of the matrix is the same as the matrix except for a factor of l/N2.
Figure imgf000010_0001
Masking
In principle an image block can be sampled with multiplicative intensity masks corresponding to an orthogonal basis for images within the block. However, because the intensity measured by the detector element is strictly positive, negative values in the intensity mask are difficult to support. Practical difficulties also mean that a continuously variable mask is difficult to achieve with any accuracy. However the Haar wave-packet basis described above is strictly binary valued with a weighting factor of 1 or -1. If the basis is modified slightly and all the -1 masking factors set to zero, the resulting mask can easily be achieved with opaque masking.
This set of weighting functions is a complete (although non-orthogonal) basis for the image block. The matrix representation of the resulting basis for 4 4 blocks is given in equation 5.
(5)
Figure imgf000011_0001
Equation 5 is more succinctly written as
C-k = ^16 (6) where
= ^ + V/2 (7) where 016 is a 16 x 16 matrix of l's.
'It can be seen by inspection that the inverse transformation is given by
Figure imgf000012_0001
Zk ^~l6-c k (9)
The inverse matrix M AXT is in general
Figure imgf000012_0002
Where Q -.N 2 is an Ν2 x Ν2 matrix with zeros everywhere except in the top left coefficient which is 1. This can be verified by checking the product
a^* = 2(A-TA)/W2 ' (A+ °A2
I N2
_ -j- (11)
N2 2 N2
- V 2 + QV ~ ~2~
= where Ik is the k x k identity matrix.
Sampling Process
The sampling process for the kth n x n block of pixels in the image (of the size of a CCD element) consists of integrating the intensity through each of the N2 masks represented by the matrix vi 2 to derive the set of coefficients c^ The pixel values can then be recovered by simply applying the transform
Pk = M~^ck . (12)
The arrangement of the blocks for most efficient acquisition of the image depends on the application. For many applications, the most efficient acquisition is achieved when the masks are arranged so that each sequence of N2 masks is in a row with the masks in each column being identical. This sequence could be repeated to reduce the scan size if necessary. However if the total acquisition time is not critical the scanning head need only be N2 elements wide and could be as high as is necessary to cover the image. The array is moved in a linear scan, as indicated in FIG 6, in steps of the CCD element separation. The output of each element can be recorded at each step to build a set of coefficients for each block.
The masks in FIG 6 are arranged in scale order so that the first 4 elements can be used to reconstruct to a resolution of 1/2 the CCD element size; the first 16 elements can be used to reconstruct to a resolution of 1/4 the CCD element size etc. This allows variable (dyadic) resolution scanning with identical scanning geometry from the same detector.
Noise Sensitivity
Prior art sampling processes use masks which effectively have only one pixel area exposed. This corresponds to using the identity matrix instead of M -, in the sampling and produces a trivial reconstruction problem. The advantages of the sampling process in accordance with the present invention become evident when noise sensitivity is considered.
For the purposes of simplifying the analysis it is assumed that each detector element has associated with it zero-mean additive Gaussian-distributed noise. This is a reasonable approximation to the behaviour of a real detector because much of the noise is due to thermal processes and is substantially independent of the light falling on the detector. The signal then looks like
Figure imgf000014_0001
where Pk is a vector of length N2 with zero mean Gaussian distributed random values _ with a scalar variance of σ2 • The reconstructed image will be
Pk = M-^ck + M^ k • (14)
= ? + MXpk So the noise in the reconstructed image is
Figure imgf000014_0002
If the matrix M , is written as
At
Figure imgf000014_0003
where Rk is the kth row of M~ 2 , then the noise in the reconstructed image becomes
Figure imgf000015_0001
1 = 1
where ei is a column vector which is zero everywhere except the ith element which is 1. But if the noise in each coefficient is independent zero-mean Gaussian noise with uniform variance σ~, then the noise in the reconstructed signal will also be Gaussian with a variance in element i of ||Λ 2σ2 . The mean squared error in the signal is then simply
Figure imgf000015_0002
where *tø is the sum of the square of the coefficients of the matrix M~ . But from equation 10 it is clear that all of the elements of N—2 ~ have a magnitude of 1 except the f rst element whic 2h h Na~s a magnitude of N1 1 . The mean square error for the reconstructed image block is then
N4 -
CN4' ] +r 1 /N2
(19)
= A.(5N2 - 4) c N4
The mean squared error in the "reconstructed" image pixels from a masked camera which uses masks which cover all but the area of one pixel, as is the case with known prior art devices is
Figure imgf000015_0003
Each pixel is subject to the noise from a single measurement. For the system disclosed here there is a root mean square gain in the signal to noise ratio for constant illumination of
Figure imgf000016_0001
Remarkably, for a system with N=2 (2 2 pixels per CCD element) there is no gain in the sensitivity. For a system with N=4 (4 4 pixels per CCD element) this would represent a sensitivity gain of 5.3dB over a single pixel masked system with the same resolution enhancement, the same illumination and the same number of exposures per element.
Spatially Variable Sensitivity
To obtain an accurate picture of the response of the system to noise, it is necessary to look at the distribution of the noise in the reconstructed image as well as the mean square error. The variance p in the reconstructed pixels will be
Figure imgf000016_0002
where the variance in the individual coefficients vc is simply σ2 for each coefficient and -V is a matrix with each of its elements being the square of the elements of M~ N,2 .
However this is simply
Figure imgf000016_0003
The variance on the reconstructed image is then
Figure imgf000017_0001
The variance of the reconstructed components is clearly not uniform except for N=2. This presents a problem. Although most of the pixels actually have slightly lower noise than the means square error, the first component has no signal to noise gain over a pixel asking scheme .
Correcting the Spatially Variable Sensitivity
This spatially variable noise can be corrected without affecting the mean square response by redistributing the noise on the reconstructed image.
This is achieved by selectively complementing individual masking patterns .
Thus the N2 x N2 matrix XN2 , Ϊ when multiplied on the left of the masking matrix M^. complements the ith masking vectors ie the complementing process turns l's to 0 ' s and 0 ' s to l's in one row of MN. - Xnτ, i will be the identity matrix with the ih row modified so that the first element is 1 and the diagonal element is -1. This produces a modified masking matrix
^N i ~ XN i^N- (25)
The inverse of this modified masking matrix will be
*tø.« = MjkXjh. i (26)
The intuitive result that
Figure imgf000017_0002
is its own inverse can easily be verified and thus
Xjh. l = M XfP. i (27) Any of the basis vectors can be complemented (except the first for which the complement would be zero). The new matrix is thus
Ntf 'O.'i .,] = X N , ■ XN , i,XN- ■ M Ό AΓ- (28)
and the inverse will be
AΛ/2, A* = ~ M M NXixN- X X 3, .X A2, (29)
Empirical observation suggests that complementing any combination of the rows of NZ (except the first row) has no effect on the mean squared error in the reconstruction. Complementing row i of N2 is equivalent to multiplying MN2 on the right by the matrix XN2 k . This adds the kth column of M~ NZ. to the first column and then multiplies the kth column by -1. Complementing several of the masks (rows of ^μ ) has the effect of adding those columns of MN ~ 2 to the first column of ~ N2 and multiplying those columns by -1. It can be shown that this has no effect on the total squared error.
If the matrix MN2 is written as
^ 1 = [0 c, ... cN2_ (30)
where C.- is the ith column of M~ n ' , then the total squared error in the reconstruction becomes
σ2 = (||^||2σ2)/N2
Figure imgf000018_0001
However the complementing operations change only the sign of columns 2 to N2, and there is no change in the contribution of these columns to |ffl^UI2. Thus the change in the total error in the reconstruction is simply that due to the first column which gives
Figure imgf000019_0001
Now
Figure imgf000019_0002
So
Figure imgf000019_0003
But
Figure imgf000019_0004
where 1 is vector with all elements equal to 1. This vector and the column vectors Q- (i=2...Ν2) are all mutually orthogonal so
Figure imgf000019_0005
2 f=l, >l
N2 (36)
— 0 i > \ , j > 1, i≠y
Figure imgf000019_0006
Equation 34 then becomes
σc 2 N2 N2 (37)
= 0
thus proving that complementing the basis functions in this way does not change the mean square error in the reconstruction .
Given this result, constraints can be found which must be satisfied for complemented masks to produce uniform noise sensitivity in the reconstruction.
It is assumed that I of the basis masks in an Ν2 x
Ν2 matrix ^-N2, [j j2 j,] have been complemented, and that this set of masks produces a uniform noise sensitivity. Therefore all elements of the first column must have the same magnitude. But if the mean squared error in the reconstruction is unchanged after complementing the basis vectors then the magnitude of the first elements
Figure imgf000020_0001
However these values all result from summing integers so N must be an even integer. Given that it has been assumed for the purposes of the construction of the basis that N is a power of 2, this is not a restrictive constraint. (This analysis has only been tested for N equal to a power of 2 and it is less clear what the constraints would be for more general Hadamard matrices . If I basis masks have been complemented then the first element of the first column must be (l-N/2+1) which gives
N2 N 1 (38) —
and thus for a given n there are only two possible choices for the number of basis masks which must be complemented to achieve a uniform noise sensitivity.
Figure imgf000021_0001
Configuring the masks
The above analysis illustrates that there are constraints on the sets of masks which must be satisfied to produce uniform noise sensitivity.
To find a set of masks a search is performed over the space of possible masks. This search is constrained by the result embodied in equation 39. Random rows (excepting the first) of a masking matrix N2 are complemented with the constraint that the number of complemented rows satisfies the constraint given by equation 39. This constraint is derived from consideration of the first element of the first column of the inverse of the masking matrix. Further constraints could be identified by considering the other elements of the first column of this matrix. An exhaustive search could then be performed, however for coding efficiency a stochastic search is performed. The inverse of this matrix is calculated and tested for uniform magnitude of the elements of the first column. A row, i, of the masking matrix which has already been complemented is then randomly chosen together with a row, j, of the masking matrix which has not been complemented. These two rows are then effectively complemented leaving the masking matrix with the same total number of complemented rows with respect to M . The first column of the inverse of the masking matrix is then checked and if it has the same magnitude for all components, a set of masks has been derived which produce the desired uniform noise sensitivity in the reconstruction.
An example of a set of masks configured by this process is illustrated in FIG 7. It can be seen that the masks have the same form as the original masks illustrated in FIG 3 except that five of them are the complements of the original masks.
It will be appreciated that the method and system of the present invention has a number of advantages over known imaging systems in which radiation is detected and an image which is represented by a plurality of distributed signals is produced, and over known methods of improving the resolution of such imaging systems .
High definition cameras which achieve a higher resolution than the CCD pixel array used in their detection system by sequentially masking each CCD array element with an apertured opaque mask suffer because the signal from each element is reduced in proportion to the aperture size. Such cameras therefore require very bright lighting to operate. As the CCD elements are sensitive to the infra-red, heating of the opaque mask by the intense lighting required can degrade signal to noise performance or lead to relatively long exposures.
On the other hand the performance of high definition cameras incorporating the system and method of the present invention has the advantage of using the same number of samples but in such a way that each aperture transmits at least 50% of the incoming flux onto the CCD. This reduces the lighting requirements and at the same time improves the signal to noise ratio.
The present invention permits the use of a linearly scanned imaging detector with larger sensing elements than the required resolution. This allows the use of coarser features in the integrated circuits of the detector than would be required for a fixed resolution detector of equivalent effective resolution. This results in higher yields and cheaper production technology for the chips, whereby apparatus in accordance with the invention can be fabricated at lower cost than standard devices with similar resolution.
In comparison with known scanned imaging technology, other advantages of the present invention include:
* The signal to noise performance is improved and results in reduced exposure time or reduced lighting requirements.
* The scanning of the detector consists of a single linear scan of the device across the image plane. This simpler geometry has advantages in terms of the mechanical system required and the speed with which it can be effectively scanned, thus allowing the device to take advantage of the improved signal to noise performance.
* The set of masks can be arranged such that the first four masks can be used to reconstruct an image with twice the resolution and the first 16 masks can be used to construct an image with four times the resolution etc . This embedded construction allows for adaptive resolution changes with a single set of masks.
* Reduced exposure times means that the device can more easily be used on live subjects and in more normal lighting conditions than prior art technology.
* The linear scan means that the technology is suitable for use in scanning imaging devices such as flat bed scanners, drum scanners, or film scanners .
* The nature of the signal produced makes it more amenable to hardware/software based compression of the resulting image with potential for continuously variable fidelity in a lossy scheme.
It will of course be realised that whilst the above has been given by way of an illustrative example of this invention, all such and other modifications and variations hereto, as would be apparent to persons skilled in the art, are deemed to fall within the broad scope and ambit of this invention as is herein set forth.

Claims

Claims
1. A method of improving the resolution of an imaging system in which radiation is detected and an image which is represented by a plurality of distributed signals is produced, said method including : - improving the signal to noise ratio of said image.
2. A method as claimed in claim 1, wherein the radiation is detected by a charge coupled device having a two-dimensional array of light sensitive detector elements and resolution is enhanced by sequentially masking discrete areas of each detector element with an apertured opaque mask.
3. A method as claimed in claim 2, wherein said mask is chosen so as to allow for square (n x n) arrays of aperture elements for each detector and so that the apertures can be arranged as an embedded set which facilitate heirarchical refinement of the resolution.
4. A method as claimed in claim 3, wherein the distribution of the signal to noise ratio of said image is uniform.
5. A method as claimed in claim 2, wherein the signal to noise ratio of said image is improved by means of a coded aperture system.
6. A method as claimed in claim 5 in which method the size of the apertured opaque mask substantially, corresponds with that of the light sensitive detector elements and the mask comprises a two-dimensional array of apertures substantially aligned with each detector element, each aperture comprising a two-dimensional array of transparent and/or opaque aperture portions whereby the configuration of the mask can be represented mathematically by a masking matrix, the transparent and opaque aperture portions being represented in the matrix by +1 and 0 respectively.
7. A method as claimed in claim 6, wherein there are N x N sub-elements or pixels in said mask where N = 2n with n an integer.
8. A method as claimed in claim 7, wherein the configuration of said apertured opaque mask is determined by stochastically searching the space of sets of apertures achieved by complementing individual apertures in the set .
9. A method as claimed in claim 8, wherein the stochastic searching commences with a canonical set of apertures which does not produce spatially uniform signal-to-noise response in the reconstructed image and progresses until a suitable set of apertures is achieved.
10. An imaging system in which radiation is detected and an image which is represented by a plurality of distributed signals is produced, said system including :- means for improving the signal to noise ratio of said image.
11. An imaging system as claimed in claim 10 and including: - a charge coupled device having a two-dimensional array of light sensitive detector elements for detecting the radiation, and masking means for sequentially masking discrete areas of each detector element.
12. An imaging system as claimed in claim 11, wherein said masking means is an apertured opaque mask.
13. An imaging system as claimed in claim 11, wherein said masking means is chosen so as to allow for square
(n x n) arrays of aperture elements for each detector and so that the apertures can be arranged as an embedded set which facilitate heirarchical refinement of the resolution.
14. An imaging system as claimed in claim 12, wherein size of the apertured opaque mask substantially corresponds with that of the light sensitive detector elements and the mask comprises a two-dimensional array of apertures substantially aligned with each detector element, each aperture comprising a two-dimensional array of transparent and/or opaque aperture portions whereby the configuration of the mask can be represented mathematically by a masking matrix, the transparent and opaque aperture portions being represented in the matrix by +1 and 0 respectively.
15. An imaging system as claimed in claim 14, wherein there are N x N sub-elements or pixels in said mask where N = 2π with n an integer.
16. An imaging system as claimed in claim 15, wherein the configuration of said apertured opaque mask is determined by stochastically searching the space of sets of apertures achieved by complementing individual apertures in the set.
17. An imaging system as claimed in claim 16, wherein the stochastic searching commences with a canonical set of apertures which does not produce spatially uniform signal-to-noise response in the reconstructed image and progresses until a suitable set of apertures is achieved.
18. A method of determining the configuration of an apertured opaque mask for improving the resolution of an imaging system in which radiation is detected and an image which is represented by a plurality of distributed signals is produced, the size of the mask substantially corresponding with that of the light sensitive detector elements and the mask comprising a two-dimensional array of apertures substantially aligned with each detector element, each aperture comprising a two-dimensional array of transparent and/or opaque aperture portions, said method including :- representing the configuration of the mask mathematically by a masking matrix in which said transparent and opaque portions are represented by +1 and 0 respectively; inverting said masking matrix, and stochastically searching the space of masking matrices achieved by complementing rows of said masking matrix.
19. A method as claimed in claim 18, wherein the stochastic searching commences with a canonical matrix which does not produce spatially uniform signal-to-noise response in the reconstructed image and progresses until a suitable masking matrix is achieved.
20. An apertured opaque mask for improving the resolution of an imaging system in which radiation is detected and an image which is represented by a plurality of distributed signals is produced, said mask including :- a two-dimensional array of apertures each comprising a two-dimensional array of transparent and/or opaque aperture portions, and the size of the mask substantially corresponding with that of the light sensitive detector elements; wherein the configuration of said transparent and opaque portions is determined in accordance with the method claimed in claim 18.
PCT/AU1998/000250 1997-04-10 1998-04-09 Imaging system & method WO1998046007A1 (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
AU68139/98A AU6813998A (en) 1997-04-10 1998-04-09 Imaging system & method

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
AUPO6152A AUPO615297A0 (en) 1997-04-10 1997-04-10 Imaging system and method
AUPO6152 1997-04-10

Publications (1)

Publication Number Publication Date
WO1998046007A1 true WO1998046007A1 (en) 1998-10-15

Family

ID=3800448

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/AU1998/000250 WO1998046007A1 (en) 1997-04-10 1998-04-09 Imaging system & method

Country Status (2)

Country Link
AU (1) AUPO615297A0 (en)
WO (1) WO1998046007A1 (en)

Cited By (24)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP1198119A2 (en) * 2000-10-11 2002-04-17 Charles E. Parsons Improved resolution for an electric image sensor array
WO2004102958A1 (en) * 2003-05-13 2004-11-25 Xceed Imaging Ltd. Optical method and system for enhancing image resolution
GB2434934A (en) * 2006-02-06 2007-08-08 Qinetiq Ltd Processing coded aperture image data by applying weightings to aperture functions and data frames
US7888626B2 (en) 2005-05-23 2011-02-15 Qinetiq Limited Coded aperture imaging system having adjustable imaging performance with a reconfigurable coded aperture mask
US7923677B2 (en) 2006-02-06 2011-04-12 Qinetiq Limited Coded aperture imager comprising a coded diffractive mask
US7969639B2 (en) 2006-02-06 2011-06-28 Qinetiq Limited Optical modulator
EP2354840A1 (en) * 2010-02-05 2011-08-10 Siemens Aktiengesellschaft An apparatus and a method for performing a difference measurement of an object image
US8017899B2 (en) 2006-02-06 2011-09-13 Qinetiq Limited Coded aperture imaging using successive imaging of a reference object at different positions
US8035085B2 (en) 2006-02-06 2011-10-11 Qinetiq Limited Coded aperture imaging system
US8068680B2 (en) 2006-02-06 2011-11-29 Qinetiq Limited Processing methods for coded aperture imaging
CN102566324A (en) * 2005-08-31 2012-07-11 Asml荷兰有限公司 Lithographic apparatus and device manufacturing method that compensates for reticle induced CDU
US8229165B2 (en) 2006-07-28 2012-07-24 Qinetiq Limited Processing method for coded aperture sensor
US8243353B1 (en) 2008-04-07 2012-08-14 Applied Science Innovations, Inc. Holography-based device, system and method for coded aperture imaging
CN102890974A (en) * 2012-10-16 2013-01-23 中国科学院高能物理研究所 Coded aperture imaging system and coding code plate thereof
EP2590399A1 (en) * 2011-11-07 2013-05-08 Raytheon Company Hadamard enhanced sensor
US8463048B2 (en) 2010-02-05 2013-06-11 Siemens Aktiengesellschaft Method and an apparatus for difference measurement of an image
WO2013171738A1 (en) 2012-05-13 2013-11-21 Elbit Systems Electro-Optics Elop Ltd. Infrared detector with increased image resolution
JP2015510110A (en) * 2012-01-03 2015-04-02 アセンティア イメージング, インコーポレイテッド Coding localization system, method and apparatus
EP2987181A4 (en) * 2013-12-13 2016-11-30 Bio Rad Laboratories Digital imaging with masked pixels
US9736388B2 (en) 2013-12-13 2017-08-15 Bio-Rad Laboratories, Inc. Non-destructive read operations with dynamically growing images
US9774804B2 (en) 2013-12-13 2017-09-26 Bio-Rad Laboratories, Inc. Digital imaging with masked pixels
EP3496392A1 (en) * 2017-12-08 2019-06-12 Nokia Technologies Oy Complementary apertures to reduce diffraction effect
CN112236715A (en) * 2018-06-27 2021-01-15 三星电子株式会社 Apparatus and method for augmented reality
US11861849B2 (en) 2020-05-03 2024-01-02 Elbit Systems Electro-Optics Elop Ltd Systems and methods for enhanced motion detection, object tracking, situational awareness and super resolution video using microscanned images

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US4589030A (en) * 1983-07-25 1986-05-13 Kley Victor B Solid state camera
US5243351A (en) * 1992-06-25 1993-09-07 Hughes Aircraft Company Full aperture image synthesis using rotating strip aperture image measurements
WO1995014245A1 (en) * 1993-11-19 1995-05-26 Ail Systems, Inc. Gamma ray imaging system
GB2313512A (en) * 1996-05-23 1997-11-26 Hewlett Packard Co CCD imager

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US4589030A (en) * 1983-07-25 1986-05-13 Kley Victor B Solid state camera
US5243351A (en) * 1992-06-25 1993-09-07 Hughes Aircraft Company Full aperture image synthesis using rotating strip aperture image measurements
WO1995014245A1 (en) * 1993-11-19 1995-05-26 Ail Systems, Inc. Gamma ray imaging system
GB2313512A (en) * 1996-05-23 1997-11-26 Hewlett Packard Co CCD imager

Non-Patent Citations (3)

* Cited by examiner, † Cited by third party
Title
CHEN et al., "Three-Dimensional Reconstruction of Laser-Irradiated Targets Using URA Coded Aperture Cameras", OPTICS COMMUNICATIONS, Volume 71, #5, pages 249-255. *
CLINTHORNE et al., "Time-Coded Apertures for Imaging in High-Background Environments", NUCLEAR SCIENCE SYMPOSIUM, Volume 1, 1995, pages 70-74. *
RESS et al., "A Time-Resolved X-Ray Ring Coded-Aperture Microscope for Inertial Confinement Fusion Applications", REV. SCI. INSTRUM., Volume 64, #6, pages 1404-1406. *

Cited By (34)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP1198119A3 (en) * 2000-10-11 2004-05-26 Charles E. Parsons Improved resolution for an electric image sensor array
EP1198119A2 (en) * 2000-10-11 2002-04-17 Charles E. Parsons Improved resolution for an electric image sensor array
WO2004102958A1 (en) * 2003-05-13 2004-11-25 Xceed Imaging Ltd. Optical method and system for enhancing image resolution
US7800683B2 (en) 2003-05-13 2010-09-21 Xceed Imaging Ltd. Optical method and system for enhancing image resolution
US7888626B2 (en) 2005-05-23 2011-02-15 Qinetiq Limited Coded aperture imaging system having adjustable imaging performance with a reconfigurable coded aperture mask
CN102566324A (en) * 2005-08-31 2012-07-11 Asml荷兰有限公司 Lithographic apparatus and device manufacturing method that compensates for reticle induced CDU
US8035085B2 (en) 2006-02-06 2011-10-11 Qinetiq Limited Coded aperture imaging system
GB2434934A (en) * 2006-02-06 2007-08-08 Qinetiq Ltd Processing coded aperture image data by applying weightings to aperture functions and data frames
US8017899B2 (en) 2006-02-06 2011-09-13 Qinetiq Limited Coded aperture imaging using successive imaging of a reference object at different positions
US7969639B2 (en) 2006-02-06 2011-06-28 Qinetiq Limited Optical modulator
US8068680B2 (en) 2006-02-06 2011-11-29 Qinetiq Limited Processing methods for coded aperture imaging
US8073268B2 (en) 2006-02-06 2011-12-06 Qinetiq Limited Method and apparatus for coded aperture imaging
US7923677B2 (en) 2006-02-06 2011-04-12 Qinetiq Limited Coded aperture imager comprising a coded diffractive mask
US8229165B2 (en) 2006-07-28 2012-07-24 Qinetiq Limited Processing method for coded aperture sensor
US8243353B1 (en) 2008-04-07 2012-08-14 Applied Science Innovations, Inc. Holography-based device, system and method for coded aperture imaging
EP2354840A1 (en) * 2010-02-05 2011-08-10 Siemens Aktiengesellschaft An apparatus and a method for performing a difference measurement of an object image
US8463048B2 (en) 2010-02-05 2013-06-11 Siemens Aktiengesellschaft Method and an apparatus for difference measurement of an image
EP2590399A1 (en) * 2011-11-07 2013-05-08 Raytheon Company Hadamard enhanced sensor
US10110834B2 (en) 2011-11-07 2018-10-23 Raytheon Company Hadamard enhanced sensors
JP2015510110A (en) * 2012-01-03 2015-04-02 アセンティア イメージング, インコーポレイテッド Coding localization system, method and apparatus
US9894292B2 (en) 2012-05-13 2018-02-13 Elbit Systems Electro-Optics Elop Ltd. Infrared detector with increased image resolution and method for use thereof
WO2013171738A1 (en) 2012-05-13 2013-11-21 Elbit Systems Electro-Optics Elop Ltd. Infrared detector with increased image resolution
US10547799B2 (en) 2012-05-13 2020-01-28 Elbit Systems Electro-Optics Elop Ltd. Infrared detector with increased image resolution
CN102890974A (en) * 2012-10-16 2013-01-23 中国科学院高能物理研究所 Coded aperture imaging system and coding code plate thereof
CN102890974B (en) * 2012-10-16 2015-09-02 中国科学院高能物理研究所 Coded aperture imaging system and coding code plate thereof
US9774804B2 (en) 2013-12-13 2017-09-26 Bio-Rad Laboratories, Inc. Digital imaging with masked pixels
US9736388B2 (en) 2013-12-13 2017-08-15 Bio-Rad Laboratories, Inc. Non-destructive read operations with dynamically growing images
US10104307B2 (en) 2013-12-13 2018-10-16 Bio-Rad Laboratories, Inc. Non-destructive read operations with dynamically growing images
EP2987181A4 (en) * 2013-12-13 2016-11-30 Bio Rad Laboratories Digital imaging with masked pixels
US10326952B2 (en) 2013-12-13 2019-06-18 Bio-Rad Laboratories, Inc. Digital imaging with masked pixels
EP3496392A1 (en) * 2017-12-08 2019-06-12 Nokia Technologies Oy Complementary apertures to reduce diffraction effect
CN112236715A (en) * 2018-06-27 2021-01-15 三星电子株式会社 Apparatus and method for augmented reality
CN112236715B (en) * 2018-06-27 2023-04-04 三星电子株式会社 Apparatus and method for augmented reality
US11861849B2 (en) 2020-05-03 2024-01-02 Elbit Systems Electro-Optics Elop Ltd Systems and methods for enhanced motion detection, object tracking, situational awareness and super resolution video using microscanned images

Also Published As

Publication number Publication date
AUPO615297A0 (en) 1997-05-08

Similar Documents

Publication Publication Date Title
WO1998046007A1 (en) Imaging system & method
Correa et al. Spatiotemporal blue noise coded aperture design for multi-shot compressive spectral imaging
Willett et al. Sparsity and structure in hyperspectral imaging: Sensing, reconstruction, and target detection
EP2899690B1 (en) Random imaging
US6765611B1 (en) Method for compressing an image from a sparsely sampled extended dynamic range image sensing device
EP2354840A1 (en) An apparatus and a method for performing a difference measurement of an object image
US20100309467A1 (en) Single-Shot Spectral Imager
US20070097363A1 (en) Coding and modulation for hyperspectral imaging
US20150116563A1 (en) Adaptive Sensing of a Programmable Modulator System
US20140198236A1 (en) Generating Modulation Patterns for the Acquisition of Multiscale Information in Received Signals
EP2590399B1 (en) Hadamard enhanced sensor
Lapray et al. Energy balance in Spectral Filter Array camera design
CN115307733B (en) Space dimension coding spectrum polarization integrated imaging system and design method thereof
CN102158659B (en) A method and an apparatus for difference measurement of an image
US7558442B2 (en) System and method for anti-moire' imaging in a one dimensional sensor array
Pitsianis et al. Compressive imaging sensors
US20160286097A1 (en) Methods and System for Sparse Blue Sampling
Poletto et al. Enhancing the spatial resolution of a two-dimensional discrete array detector
CN108801457B (en) Three-dimensional map acquisition and reconstruction method based on coding sampling plate design and secondary energy constraint correction
Rueda et al. Compressive spectral imaging based on colored coded apertures
Picone et al. Joint demosaicing and fusion of multiresolution coded acquisitions: A unified image formation and reconstruction method
Burns Image signal modulation and noise characteristics of charge-coupled device imagers
Gottesman et al. Adaptive coded apertures: bridging the gap between non-diffractive and diffractive imaging systems
Arguello et al. Colored coded apertures optimization in compressive spectral imaging by restricted isometry property
KR102258774B1 (en) Infrared image measurement devices and method

Legal Events

Date Code Title Description
AK Designated states

Kind code of ref document: A1

Designated state(s): AL AM AT AU AZ BA BB BG BR BY CA CH CN CU CZ DE DK EE ES FI GB GE GH GM GW HU ID IL IS JP KE KG KP KR KZ LC LK LR LS LT LU LV MD MG MK MN MW MX NO NZ PL PT RO RU SD SE SG SI SK SL TJ TM TR TT UA UG US UZ VN YU ZW

AL Designated countries for regional patents

Kind code of ref document: A1

Designated state(s): GH GM KE LS MW SD SZ UG ZW AM AZ BY KG KZ MD RU TJ TM AT BE CH CY DE DK ES FI FR GB GR IE IT LU MC NL PT SE BF BJ CF CG CI CM GA GN ML MR NE SN TD TG

DFPE Request for preliminary examination filed prior to expiration of 19th month from priority date (pct application filed before 20040101)
121 Ep: the epo has been informed by wipo that ep was designated in this application
REG Reference to national code

Ref country code: DE

Ref legal event code: 8642

NENP Non-entry into the national phase

Ref country code: JP

Ref document number: 1998542155

Format of ref document f/p: F

122 Ep: pct application non-entry in european phase
NENP Non-entry into the national phase

Ref country code: CA