US5555464A - Red/near-infrared filtering for CCD cameras - Google Patents

Red/near-infrared filtering for CCD cameras Download PDF

Info

Publication number
US5555464A
US5555464A US08/506,987 US50698795A US5555464A US 5555464 A US5555464 A US 5555464A US 50698795 A US50698795 A US 50698795A US 5555464 A US5555464 A US 5555464A
Authority
US
United States
Prior art keywords
red
pixels
infrared
green
blue
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Expired - Lifetime
Application number
US08/506,987
Inventor
John D. Hatlestad
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Lockheed Martin Corp
Original Assignee
Lockheed Martin Corp
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Lockheed Martin Corp filed Critical Lockheed Martin Corp
Priority to US08/506,987 priority Critical patent/US5555464A/en
Assigned to LORAL CORPORATION reassignment LORAL CORPORATION ASSIGNMENT OF ASSIGNORS INTEREST (SEE DOCUMENT FOR DETAILS). Assignors: HATLESTAD, JOHN D.
Application granted granted Critical
Publication of US5555464A publication Critical patent/US5555464A/en
Assigned to LOCKHEED MARTIN TACTICAL SYSTEMS, INC. reassignment LOCKHEED MARTIN TACTICAL SYSTEMS, INC. MERGER (SEE DOCUMENT FOR DETAILS). Assignors: LORAL CORPORATION
Assigned to LOCKHEED MARTIN CORPORATION reassignment LOCKHEED MARTIN CORPORATION MERGER (SEE DOCUMENT FOR DETAILS). Assignors: LOCKHEED MARTIN TACTICAL SYSTEMS, INC.
Anticipated expiration legal-status Critical
Expired - Lifetime legal-status Critical Current

Links

Images

Classifications

    • A—HUMAN NECESSITIES
    • A01—AGRICULTURE; FORESTRY; ANIMAL HUSBANDRY; HUNTING; TRAPPING; FISHING
    • A01M—CATCHING, TRAPPING OR SCARING OF ANIMALS; APPARATUS FOR THE DESTRUCTION OF NOXIOUS ANIMALS OR NOXIOUS PLANTS
    • A01M7/00—Special adaptations or arrangements of liquid-spraying apparatus for purposes covered by this subclass
    • A01M7/0089—Regulating or controlling systems
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/10—Cameras or camera modules comprising electronic image sensors; Control thereof for generating image signals from different wavelengths
    • H04N23/11—Cameras or camera modules comprising electronic image sensors; Control thereof for generating image signals from different wavelengths for generating image signals from visible and infrared light wavelengths
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/10—Cameras or camera modules comprising electronic image sensors; Control thereof for generating image signals from different wavelengths
    • H04N23/13—Cameras or camera modules comprising electronic image sensors; Control thereof for generating image signals from different wavelengths with multiple sensors
    • H04N23/16—Optical arrangements associated therewith, e.g. for beam-splitting or for colour correction
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N5/00—Details of television systems
    • H04N5/30—Transforming light or analogous information into electric information
    • H04N5/33—Transforming infrared radiation

Definitions

  • the current invention relates to a conventional charge-coupled-device (CCD) camera that is optimized for the detection of living plants (green biomass) against a possibly complex (non-homogeneous) background by use of a single filter that does not require a specialized design for the CCD camera.
  • CCD charge-coupled-device
  • a number of articles in the literature teach that living green plants can be detected by use of a ratio, or a normalized ratio, of the reflectance of incident light in the near-infrared (NIR) region to reflected light in the red (R) region.
  • NIR near-infrared
  • R red
  • One such article is entitled “Visible and Near-infrared Plant, Soil and Crop Residue Reflectivity for Weed Sensor Design,” by B. B. Nitsch, K. Von Bargen, G. E. Meyer and D. A. Mortensen, which was delivered at the ASAE 1991 Summer Meeting, Paper No. 913006.
  • the current invention is for a video sensor that can provide the information necessary to compute such ratios.
  • the ratio of the reflection of light from the near-infrared (NIR) and the red (R) portions of the spectrum is a reliable detector of living plants against various backgrounds of soil and crop residue. For example, this information is conveyed in the Nitsch et al. article. This ratio of NIR/R signal strength is called in this paper the "vegetative index.” Alternative ratios of R and NIR may be used, one of which is the ratio of NIR-R/NIR+R, which is termed the normalized difference ratio which is described in this same article.
  • the ratio of NIR/R may be utilized where the NIR intensity is obtained from a portion of the spectrum from approximately 700 nm to 850 nm, and the R intensity is obtained from a region around 600 nm to 650 nm. This may be used to differentiate plant growth from background soil and crop residue.
  • ratios are employed in the agricultural field for the detection and identification of vegetation and growing crops, and data for these ratios are collected by three methods.
  • an optical fiber with a wide field of view lens is used to transmit the light to an optical beam-splitter.
  • the beam-splitter divides the light into two channels.
  • An NIR filter is applied to one channel and an R filter to the other channel.
  • a ratio of the response in the two channels is used to form the NIR to R components of the intensity ratio that is selected to detect the vegetation.
  • two separate sensors are directly employed so that the optical fiber and optical beam-splitter are not needed. Since the resolution is coarse in this version, an accurate registration of the two sensors is not necessary. This technique is described in the paper entitled "A Microprocessor Controlled Technology to Selectivity Spot Spray Weeds," by W. L. Fenton, A. F. Doss, P. G. Nash and K. R. McCIoy, Automated Agriculture for the 21st Century, Proceedings of the 1991 Symposium, 16-17 Dec., 1991, Chicago, published by ASAE.
  • a spectroradiometer is employed to provide the frequency selectivity. This technique is described in the Nitsch et al. article.
  • a brochure for the Sony Model XC-711/711P R.G.B. Primary Color Filter Camera discloses primary color red/green/blue pixels for CCD cameras. For this XC-711 camera, these pixels are arranged into primary color vertical stripes, as shown in FIG. 1. In some other color cameras, the pixels are arranged in a mosaic pattern, as shown in FIG. 2.
  • the reflection from the vegetation is considered to be clutter.
  • One of the wavelength ranges is selected so that the reflection characteristics of the object and of the surrounding natural vegetation are as similar as possible.
  • the second wavelength is selected so that there is the greatest possible difference between the reflection behavior or the object to be detected and that of the vegetation.
  • the first wavelength which is selected so that the characteristics of the object and the natural vegetation are as similar as possible, lies in the near-infrared (NIR) range. This wavelength is equal to, or greater than, the range of 0.7 ⁇ m to 2 ⁇ m.
  • the second wavelength which is utilized to distinguish the background of the object, lies between 0.2 ⁇ m and 0.6 ⁇ m.
  • a conventional color CCD camera having a lens of a multitude of red and near-infrared responsive, green and near-infrared responsive, and blue and near-infrared responsive pixels arranged in a predefined pattern is converted to a vegetation-detecting camera by placing a filter over the CCD pixels.
  • the filter is constructed so that it filters out light other than red, including near-infrared, from reaching the red and nearlo infrared responsive pixels, and allows only near-infrared light to reach the green and near-infrared responsive and the blue and near-infrared responsive pixels.
  • Red, green and blue output lines then provide signals which are representative of the red and near-infrared input light, and these are supplied to a signal processor where they are utilized to detect vegetation or other objects.
  • the camera is converted directly back to use for color images merely by removing the added filter adapter.
  • FIG. 1 is a diagram that illustrates a portion of the red, green and blue pixels of a primary color CCD camera that is implemented with the pixels aligned in a vertical stripe filter pattern;
  • FIG. 2 is a diagram that illustrates a portion of the red, green and blue pixels of a primary color CCD camera that is implemented with the pixels aligned in a mosaic pattern;
  • FIG. 3 is a diagram that illustrates a portion of a filter that is used to implement the invention with a camera of the type shown in FIG. 1;
  • FIG. 4 is a diagram that illustrates a portion of a filter that is used to implement the invention with a camera of the type shown in FIG. 2;
  • FIG. 5 is a block diagram of a CCD camera system that employs the invention.
  • the present invention is used to modify the characteristics of a conventional CCD camera or video sensor that has primary red, green and blue color responses and provides signal outputs on the green and blue output lines which represents received near-infrared (NIR) light intensity which is approximately from 800-850 nanometers in wavelength, and a signal output on the red output line which represents received R light intensity which is approximately from 600-650 nanometers in wavelength.
  • NIR near-infrared
  • Conventional color CCD cameras employ a multitude of primary color red, green and blue responsive pixels which are selected to respectively respond to the intensity of red, green and blue color light that impinges thereon. The pixels are also responsive to near-infrared light.
  • red pixels, green pixels and blue pixels in this document are also respectively equivalent to the terms red and near-infrared responsive pixels, green and near-infrared responsive pixels, and blue and near-infrared responsive pixels, which are also used in this document.
  • the invention involves the making of a filter that has defined areas where red (R) and near-infrared (NIR) light are respectively allowed to pass and light of other colors is blocked.
  • filters may be made in a number of ways. One way is to deposit interference filter coatings on a piece of glass or plastic in any conventionally known manner over the red, green and blue bandpass filters of a conventional CCD camera based on the passband and attenuation characteristics of the desired filters.
  • the filters can be utilized to carry out the purpose of the invention which is to allow conventional primary color CCD cameras to be used for detecting vegetation by converting such cameras to R and NIR sensors in an inexpensive but effective manner.
  • the pixel geometry of the CCD array is obtained from the manufacturer of the CCD camera or through precise measurement under a microscope and is utilized to determine the desired pattern of R and NIR areas. Masks are prepared to precisely define these areas.
  • the filter coatings are then applied through the masks to the glass or plastic overlays that are to be secured over the lens of the CCD camera in order to match the pixel geometry. If desired, the coatings may be directly applied to the face of the CCD, but then the camera could not be used for normal color viewing by merely revising the filter coatings.
  • the filters cover all, or at least a portion of the active pixel area of the CCD camera, to provide R and NIR signals sufficient to detect vegetation.
  • the R filter coating is applied over what would have been the red pixels of an unmodified camera, and is constructed to allow R color wavelengths to pass and to block NIR wavelengths since the pixels of CCD cameras respond to light within the wavelength range of approximately 400-1000 nm, including both visible light and NIR wavelengths.
  • the NIR filter coatings allow for the passage of only a narrow band of NIR wavelength in the region of approximately 750-1000 nm. These coatings are applied over what would have been the blue and green pixels of an unmodified camera to allow for the passage of only NIR wavelengths to which these pixels also respond and to block red, blue and green colors and other wavelengths that ordinarily might cause a response in these pixels.
  • FIG. 1 shows the pixels in a greatly enlarged view of a small area of a primary color red, green and blue pixel color CCD filter that is arranged into a vertical stripe pattern with red, green and blue pixels aligned in their own stripes. Horizontal stripe patterns may also be employed.
  • FIG. 3 shows the filter pattern that is applied to implement the invention with the pixel pattern shown in FIG. 1 where the filter stripes labeled R overlay the red pixels and the filter stripes labeled NIR overlay the blue and green pixels.
  • the CCD camera then produces signals on the red, green and blue output lines which, respectively, provide R and NIR values.
  • the output strength of the NIR signal will be approximately twice as large as the output strength of the R signal assuming the response of the CCD pixels is equal for R and NIR light.
  • Most CCD cameras have lower response to NIR light than to visible light, so this larger area can help compensate for the reduced sensitivity of the CCD to NIR light.
  • This sensitivity imbalance can be handled in a signal processor or by adjusting the bandwidth or passband gain of the R and NIR filters to achieve the appropriate ratio.
  • FIG. 2 shows the pixels in a greatly enlarged view of an area of primary red, green and blue pixels that are arranged into a mosaic pattern.
  • FIG. 4 shows the filter pattern that is applied to implement the invention with the pixel pattern shown in FIG. 2 where again the filter areas labeled R overlay the red pixels, and the filter areas labeled NIR overlay the blue and green pixels.
  • FIG. 5 is a block diagram of a CCD camera system 10 in which the invention is implemented.
  • a conventional CCD camera 12 has a CCD array 13 and a filter 14 located behind the lens 15 which directs the received image onto the filter 14.
  • the CCD array 13 has red, green and blue output lines labeled 16, 18, 20, respectively. Because of the presence of the filter 14, the output of the line labeled R is a signal whose amplitude depends upon the intensity of light from only the R bandwidth, while the output of the lines 18, 20 depend upon the intensity of light from only the NIR bandwidth.
  • the red, green and blue signals may be encoded onto a single line composite video and then decoded at the signal processor.
  • the signal processor 22 which is coupled to the lines 16, 18 and 20 utilizes the signals on these lines to develop signals that represent relationships of R and NIR values that are known to be useful to detect the presence of vegetation from background objects.
  • the present invention provides for the separation of NIR and R filters on the pixels of the CCD camera to allow for optimal green plant detection on a pixel-by-pixel basis. It has advantages over the first two methods described above in that it can form multiple, high-resolution, well-registered pixels into an image of the scene in the field of view of the camera. The invention has advantages over prior systems in that it can process non-stationary scenes without pixel registration problems.
  • the invention has advantages over conventional black and white or color image gathering in that the use of the NIR to R ratios provides a more reliable means of detecting green biomass against a possibly complex (non-homogeneous) background, and it has the additional advantage that it can utilize currently available color video equipment for image transmission, storage, retrieval and processing.

Abstract

A CCD camera is adapted for detecting red and near-infrared wavelengths by employing filters that are constructed to allow for the passage of only red light in certain areas and near-infrared light in other areas of the filter. The areas are designed to match the pixel geometry of the lens of a primary color CCD camera that has a predefined pattern of red, blue and green pixels. The match is such that the red bandpass filter areas overlay the red pixels, and the near-infrared bandpass filter areas match the blue and green pixel areas. The red, green and blue output lines of the CCD camera are supplied to a signal processor which uses the signals on these lines to provide combinations of red and near-infrared magnitude that are capable of detecting vegetation from a background. The camera is suitable for full color use again merely by removing the filter that provides R and NIR sensing without otherwise disabling or modifying the camera.

Description

BACKGROUND OF THE INVENTION
1. Field of the Invention
The current invention relates to a conventional charge-coupled-device (CCD) camera that is optimized for the detection of living plants (green biomass) against a possibly complex (non-homogeneous) background by use of a single filter that does not require a specialized design for the CCD camera.
2. Discussion of Background Information
A number of articles in the literature teach that living green plants can be detected by use of a ratio, or a normalized ratio, of the reflectance of incident light in the near-infrared (NIR) region to reflected light in the red (R) region. One such article is entitled "Visible and Near-infrared Plant, Soil and Crop Residue Reflectivity for Weed Sensor Design," by B. B. Nitsch, K. Von Bargen, G. E. Meyer and D. A. Mortensen, which was delivered at the ASAE 1991 Summer Meeting, Paper No. 913006. The current invention is for a video sensor that can provide the information necessary to compute such ratios.
The ratio of the reflection of light from the near-infrared (NIR) and the red (R) portions of the spectrum is a reliable detector of living plants against various backgrounds of soil and crop residue. For example, this information is conveyed in the Nitsch et al. article. This ratio of NIR/R signal strength is called in this paper the "vegetative index." Alternative ratios of R and NIR may be used, one of which is the ratio of NIR-R/NIR+R, which is termed the normalized difference ratio which is described in this same article. The ratio of NIR/R may be utilized where the NIR intensity is obtained from a portion of the spectrum from approximately 700 nm to 850 nm, and the R intensity is obtained from a region around 600 nm to 650 nm. This may be used to differentiate plant growth from background soil and crop residue.
These ratios are employed in the agricultural field for the detection and identification of vegetation and growing crops, and data for these ratios are collected by three methods.
In the first method an optical fiber with a wide field of view lens is used to transmit the light to an optical beam-splitter. The beam-splitter divides the light into two channels. An NIR filter is applied to one channel and an R filter to the other channel. A ratio of the response in the two channels is used to form the NIR to R components of the intensity ratio that is selected to detect the vegetation. In a variation of this system, two separate sensors are directly employed so that the optical fiber and optical beam-splitter are not needed. Since the resolution is coarse in this version, an accurate registration of the two sensors is not necessary. This technique is described in the paper entitled "A Microprocessor Controlled Technology to Selectivity Spot Spray Weeds," by W. L. Fenton, A. F. Doss, P. G. Nash and K. R. McCIoy, Automated Agriculture for the 21st Century, Proceedings of the 1991 Symposium, 16-17 Dec., 1991, Chicago, published by ASAE.
In the second method, a spectroradiometer is employed to provide the frequency selectivity. This technique is described in the Nitsch et al. article.
In the third method, video cameras are employed to gather the data with the wavelength selectivity provided by manually inserting filters in front of the camera. This requires that the camera and the subject be stationary over the time it takes to replace one filter with the other. This technique is described in a paper entitled "The Use of Local Spectral Properties of Leaves as an Aid for Identifying Weed Seedlings in Digital Images," by e. Franz, M. R. Gebhardt and K. B. Unkesbay, ASAE 1990 International Summer Meeting, Paper No. 90-7044.
A brochure for the Sony Model XC-711/711P R.G.B. Primary Color Filter Camera discloses primary color red/green/blue pixels for CCD cameras. For this XC-711 camera, these pixels are arranged into primary color vertical stripes, as shown in FIG. 1. In some other color cameras, the pixels are arranged in a mosaic pattern, as shown in FIG. 2.
The difficulty of utilizing infrared (IR) imaging devices for the detection of cold targets is recognized in U.S. Pat. No. 5,132,802 which issued Jul. 21, 1992 to Osthues et al., and is entitled "High Contrast Image Apparatus Employing Optical Filters to Cause Each Image Pick-Up Element to have its Maximum Sensitivity in a Different Spectral Range." The apparatus of the Osthues et al. patent is described in the embodiment which is directed to the detection of military objects which may be surrounded by natural vegetation and may be camouflaged. The system of the Osthues et al. patent utilizes two image pick-ups which are selected to have two different wavelength ranges. In this patent the reflection from the vegetation is considered to be clutter. One of the wavelength ranges is selected so that the reflection characteristics of the object and of the surrounding natural vegetation are as similar as possible. The second wavelength is selected so that there is the greatest possible difference between the reflection behavior or the object to be detected and that of the vegetation.
Two separate CCD cameras are utilized in the Osthues et al. patent so that each camera receives and operates on one of the two wavelengths. The first wavelength, which is selected so that the characteristics of the object and the natural vegetation are as similar as possible, lies in the near-infrared (NIR) range. This wavelength is equal to, or greater than, the range of 0.7 μm to 2 μm. The second wavelength, which is utilized to distinguish the background of the object, lies between 0.2 μm and 0.6 μm.
Specialized CCD camera designs are shown in U.S. Pat. Nos. 4,651,001 entitled "Visible/Infrared Imaging Device with Stacked Cell Structure," issued Mar. 17, 1987 to Nozomu Harada, et al., and 4,663,656, entitled "High-Resolution CCD Imagers Using Area-Array CCD's for Sensing Spectral Components of an Optical Line Image," issued May 5, 1987 to Hammam Elabd, et al., which show infrared sensing along with visible light sensing. U.S. Pat. No. 5,350,490 entitled "Forming a Color Filter on a Semiconductor Substrate," issued Sep. 27, 1994 to Hyung S. Lee, shows how a color filter may be formed on a semiconductor substrate for CCD or bucket brigade device (BBD). The CCD device of this patent is an interline-transfer charge coupled device (IT-CCD).
SUMMARY OF THE INVENTION
A conventional color CCD camera having a lens of a multitude of red and near-infrared responsive, green and near-infrared responsive, and blue and near-infrared responsive pixels arranged in a predefined pattern is converted to a vegetation-detecting camera by placing a filter over the CCD pixels. The filter is constructed so that it filters out light other than red, including near-infrared, from reaching the red and nearlo infrared responsive pixels, and allows only near-infrared light to reach the green and near-infrared responsive and the blue and near-infrared responsive pixels. Red, green and blue output lines then provide signals which are representative of the red and near-infrared input light, and these are supplied to a signal processor where they are utilized to detect vegetation or other objects. The camera is converted directly back to use for color images merely by removing the added filter adapter.
BRIEF DESCRIPTION OF THE DRAWINGS
The invention is shown by reference to the drawings in which:
FIG. 1 is a diagram that illustrates a portion of the red, green and blue pixels of a primary color CCD camera that is implemented with the pixels aligned in a vertical stripe filter pattern;
FIG. 2 is a diagram that illustrates a portion of the red, green and blue pixels of a primary color CCD camera that is implemented with the pixels aligned in a mosaic pattern;
FIG. 3 is a diagram that illustrates a portion of a filter that is used to implement the invention with a camera of the type shown in FIG. 1;
FIG. 4 is a diagram that illustrates a portion of a filter that is used to implement the invention with a camera of the type shown in FIG. 2; and
FIG. 5 is a block diagram of a CCD camera system that employs the invention.
TECHNICAL DESCRIPTION OF THE INVENTION
The present invention is used to modify the characteristics of a conventional CCD camera or video sensor that has primary red, green and blue color responses and provides signal outputs on the green and blue output lines which represents received near-infrared (NIR) light intensity which is approximately from 800-850 nanometers in wavelength, and a signal output on the red output line which represents received R light intensity which is approximately from 600-650 nanometers in wavelength. Conventional color CCD cameras employ a multitude of primary color red, green and blue responsive pixels which are selected to respectively respond to the intensity of red, green and blue color light that impinges thereon. The pixels are also responsive to near-infrared light. Therefore, the terms red pixels, green pixels and blue pixels in this document are also respectively equivalent to the terms red and near-infrared responsive pixels, green and near-infrared responsive pixels, and blue and near-infrared responsive pixels, which are also used in this document.
The invention involves the making of a filter that has defined areas where red (R) and near-infrared (NIR) light are respectively allowed to pass and light of other colors is blocked. Such filters may be made in a number of ways. One way is to deposit interference filter coatings on a piece of glass or plastic in any conventionally known manner over the red, green and blue bandpass filters of a conventional CCD camera based on the passband and attenuation characteristics of the desired filters.
Once the filters are constructed, they can be utilized to carry out the purpose of the invention which is to allow conventional primary color CCD cameras to be used for detecting vegetation by converting such cameras to R and NIR sensors in an inexpensive but effective manner. The pixel geometry of the CCD array is obtained from the manufacturer of the CCD camera or through precise measurement under a microscope and is utilized to determine the desired pattern of R and NIR areas. Masks are prepared to precisely define these areas. The filter coatings are then applied through the masks to the glass or plastic overlays that are to be secured over the lens of the CCD camera in order to match the pixel geometry. If desired, the coatings may be directly applied to the face of the CCD, but then the camera could not be used for normal color viewing by merely revising the filter coatings. The filters cover all, or at least a portion of the active pixel area of the CCD camera, to provide R and NIR signals sufficient to detect vegetation.
The R filter coating is applied over what would have been the red pixels of an unmodified camera, and is constructed to allow R color wavelengths to pass and to block NIR wavelengths since the pixels of CCD cameras respond to light within the wavelength range of approximately 400-1000 nm, including both visible light and NIR wavelengths. The NIR filter coatings allow for the passage of only a narrow band of NIR wavelength in the region of approximately 750-1000 nm. These coatings are applied over what would have been the blue and green pixels of an unmodified camera to allow for the passage of only NIR wavelengths to which these pixels also respond and to block red, blue and green colors and other wavelengths that ordinarily might cause a response in these pixels.
FIG. 1 shows the pixels in a greatly enlarged view of a small area of a primary color red, green and blue pixel color CCD filter that is arranged into a vertical stripe pattern with red, green and blue pixels aligned in their own stripes. Horizontal stripe patterns may also be employed. FIG. 3 shows the filter pattern that is applied to implement the invention with the pixel pattern shown in FIG. 1 where the filter stripes labeled R overlay the red pixels and the filter stripes labeled NIR overlay the blue and green pixels. The CCD camera then produces signals on the red, green and blue output lines which, respectively, provide R and NIR values. Since the NIR signal-producing area is approximately twice as large as the R signal-producing area, the output strength of the NIR signal will be approximately twice as large as the output strength of the R signal assuming the response of the CCD pixels is equal for R and NIR light. Most CCD cameras have lower response to NIR light than to visible light, so this larger area can help compensate for the reduced sensitivity of the CCD to NIR light. This sensitivity imbalance can be handled in a signal processor or by adjusting the bandwidth or passband gain of the R and NIR filters to achieve the appropriate ratio.
FIG. 2 shows the pixels in a greatly enlarged view of an area of primary red, green and blue pixels that are arranged into a mosaic pattern. FIG. 4 shows the filter pattern that is applied to implement the invention with the pixel pattern shown in FIG. 2 where again the filter areas labeled R overlay the red pixels, and the filter areas labeled NIR overlay the blue and green pixels.
FIG. 5 is a block diagram of a CCD camera system 10 in which the invention is implemented. A conventional CCD camera 12 has a CCD array 13 and a filter 14 located behind the lens 15 which directs the received image onto the filter 14. The CCD array 13 has red, green and blue output lines labeled 16, 18, 20, respectively. Because of the presence of the filter 14, the output of the line labeled R is a signal whose amplitude depends upon the intensity of light from only the R bandwidth, while the output of the lines 18, 20 depend upon the intensity of light from only the NIR bandwidth. Alternatively, the red, green and blue signals may be encoded onto a single line composite video and then decoded at the signal processor. The signal processor 22 which is coupled to the lines 16, 18 and 20 utilizes the signals on these lines to develop signals that represent relationships of R and NIR values that are known to be useful to detect the presence of vegetation from background objects.
The present invention provides for the separation of NIR and R filters on the pixels of the CCD camera to allow for optimal green plant detection on a pixel-by-pixel basis. It has advantages over the first two methods described above in that it can form multiple, high-resolution, well-registered pixels into an image of the scene in the field of view of the camera. The invention has advantages over prior systems in that it can process non-stationary scenes without pixel registration problems.
The invention has advantages over conventional black and white or color image gathering in that the use of the NIR to R ratios provides a more reliable means of detecting green biomass against a possibly complex (non-homogeneous) background, and it has the additional advantage that it can utilize currently available color video equipment for image transmission, storage, retrieval and processing.

Claims (3)

What is claimed is:
1. A CCD camera system for detecting red (R) and near-infrared (NIR) wavelengths, comprising:
a) a color CCD camera comprising a multitude of pixels comprising red and near-infrared responsive pixels, green and near-infrared responsive pixels and blue and near-infrared responsive pixels arranged in a predefined pattern and constructed to provide signals on three output lines, at least a first one of which is representative of said R wavelengths, and at least a second one of which is representative of said NIR wavelengths,
b) filter means overlying said multitude of pixels comprising first defined areas which allow red light to pass and which block near-infrared light and other light, and second defined areas which allow the near-infrared light to pass and which block other light, wherein said first defined areas are configured to cover only said red and near-infrared responsive pixels, and said second defined areas are configured to cover only said green and near-infrared responsive pixels and said blue and near-infrared responsive pixels of said CCD camera, and
c) signal processing means coupled to said at least first and said at least second of said output lines to receive the signals therefrom which is constructed to provide predefined combinations of values which are dependent on the signals said signal processing means receives.
2. A CCD camera system as claimed in claim 1 wherein said at least said second of said output lines comprises a blue output signal line and a green output signal line for providing a first output signal on said blue output signal line which is representative of blue and near-infrared responsive signals and a second output signal on said green output signal line which is representative of green and near infrared responsive signals, and said multitude of pixels are arranged so that said red and near-infrared responsive pixels are aligned in a first row, said green and near-infrared responsive pixels are aligned in a second row, and said blue and near-infrared responsive pixels are aligned in a third row.
3. A CCD camera system as claimed in claim 1 wherein said at least said second of said output lines comprises a blue output signal line and a green output signal line for providing a first output Signal on said blue output signal line which is representative of blue and near-infrared responsive signals and a second output signal on said green output signal line which is representative of green and near-infrared responsive signals, and said multitude of pixels are configured into a mosaic pattern.
US08/506,987 1995-07-28 1995-07-28 Red/near-infrared filtering for CCD cameras Expired - Lifetime US5555464A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
US08/506,987 US5555464A (en) 1995-07-28 1995-07-28 Red/near-infrared filtering for CCD cameras

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
US08/506,987 US5555464A (en) 1995-07-28 1995-07-28 Red/near-infrared filtering for CCD cameras

Publications (1)

Publication Number Publication Date
US5555464A true US5555464A (en) 1996-09-10

Family

ID=24016823

Family Applications (1)

Application Number Title Priority Date Filing Date
US08/506,987 Expired - Lifetime US5555464A (en) 1995-07-28 1995-07-28 Red/near-infrared filtering for CCD cameras

Country Status (1)

Country Link
US (1) US5555464A (en)

Cited By (36)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5661817A (en) * 1995-07-21 1997-08-26 Lockheed Martin Corporation Single charge-coupled-device camera for detection and differentiation of desired objects from undesired objects
US5992758A (en) * 1996-09-23 1999-11-30 Agro-Mack Enterprises Ltd. Proximity detector for ground-based implements
EP1004240A1 (en) * 1998-11-27 2000-05-31 Amazonen-Werke H. Dreyer GmbH & Co. KG Device for recognizing plants and/or forms applied to agriculture
US6167469A (en) * 1998-05-18 2000-12-26 Agilent Technologies, Inc. Digital camera having display device for displaying graphical representation of user input and method for transporting the selected digital images thereof
US6363366B1 (en) * 1998-08-31 2002-03-26 David L. Henty Produce identification and pricing system for checkouts
DE10118628C1 (en) * 2001-04-12 2002-12-05 Aeg Infrarot Module Gmbh Detecting spectrally selective infrared radiator involves acquiring broadband image and image in sub-band of broadband image in immediate succession using infrared detector
US20030048361A1 (en) * 1998-05-29 2003-03-13 Safai Mohammad A. Digital camera
US20030058357A1 (en) * 2001-09-19 2003-03-27 Fuji Photo Film Co., Ltd. Color image pickup apparatus with light source distinguishing function
US6577336B2 (en) 1998-05-29 2003-06-10 Agilent Technologies, Inc. Authentication stamping in a digital camera
DE10220825A1 (en) * 2002-05-08 2003-07-03 Audi Ag Image pickup device for motor vehicle driver assistance system, has image pickup element corresponding to pixel of image detection device
US6593963B1 (en) 1998-05-29 2003-07-15 Agilent Technologies, Inc. Programmable control of operational signals in a digital camera
US6596996B1 (en) 2001-07-24 2003-07-22 The Board Of Regents For Oklahoma State University Optical spectral reflectance sensor and controller
US20030169354A1 (en) * 2002-03-05 2003-09-11 Fuji Photo Film Co., Ltd. Solid state image pickup device capable of distinguishing between light sources and image pickup apparatus using such solid state image pickup device
US20050001912A1 (en) * 2003-07-02 2005-01-06 Nikon Corporation Color photographing device
US20050134697A1 (en) * 2003-12-17 2005-06-23 Sami Mikkonen Imaging device and method of creating image file
US20060071156A1 (en) * 2004-10-06 2006-04-06 Funai Electric Co., Ltd. Infrared imaging apparatus
US20070110284A1 (en) * 2003-12-18 2007-05-17 Rieul Francois Method and apparatus for iris recognition
US7236196B1 (en) * 1999-09-08 2007-06-26 Fujifilm Corporation Solid-state image pickup apparatus for reading out image signals with pixels reduced in a horizontal direction and a signal reading method for the same
US7379590B2 (en) * 2003-01-17 2008-05-27 University Of New Brunswick Method for generating natural colour satellite images
US20090147112A1 (en) * 2007-12-05 2009-06-11 Electro Scientific Industries, Inc. Method and apparatus for achieving panchromatic response from a color-mosaic imager
US20090316025A1 (en) * 2008-06-18 2009-12-24 Hideaki Hirai Image pickup
DE102008031593A1 (en) * 2008-07-03 2010-01-07 Hella Kgaa Hueck & Co. Camera system for use in motor vehicle to assist driver during e.g. reversing vehicle, has filter system formed from red, green, blue and weight color filters, and evaluation arrangement with compensating unit to compensate infrared parts
US7806335B2 (en) 2000-11-24 2010-10-05 Metrologic Instruments, Inc. Digital image capturing and processing system for automatically recognizing objects in a POS environment
US7841533B2 (en) 2003-11-13 2010-11-30 Metrologic Instruments, Inc. Method of capturing and processing digital images of an object within the field of view (FOV) of a hand-supportable digitial image capture and processing system
US20100314543A1 (en) * 2009-06-10 2010-12-16 Siliconfile Technologies Inc. Image sensor for measuring illumination, proximity and color temperature
DE202008018010U1 (en) 2008-01-14 2011-05-05 Henty, David L., Irvine Fruits and vegetables Identification and pricing system for cash registers
DE102011100350A1 (en) * 2011-05-03 2012-11-08 Conti Temic Microelectronic Gmbh Image sensor with adjustable resolution
US20130217439A1 (en) * 2012-02-21 2013-08-22 Trimble Navigation Limited Cell phone NDVI sensor
US20130222603A1 (en) * 2012-02-28 2013-08-29 Aptina Imaging Corporation Imaging systems for infrared and visible imaging
US20140009647A1 (en) * 2012-07-06 2014-01-09 Fujifilm Corporation Color imaging element and imaging apparatus
US20140192177A1 (en) * 2011-09-02 2014-07-10 Koninklijke Philips N.V. Camera for generating a biometrical signal of a living being
WO2016151240A1 (en) * 2015-03-23 2016-09-29 Université de Bourgogne Imaging of a macroscopic plant object
DE102008003791B4 (en) * 2008-01-10 2017-03-16 Robert Bosch Gmbh Method for processing and evaluating a color image and associated driver assistance system
DE102016105579A1 (en) * 2016-03-24 2017-09-28 Connaught Electronics Ltd. Optical filter for a camera of a motor vehicle, camera for a driver assistance system, driver assistance system and motor vehicle train with a driver assistant system
US20180278857A1 (en) * 2017-03-23 2018-09-27 JVC Kenwood Corporation Imaging device and imaging method
US10963751B2 (en) 2018-06-07 2021-03-30 Cnh Industrial Canada, Ltd. Measuring crop residue from imagery using a machine-learned classification model

Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US4037048A (en) * 1973-04-19 1977-07-19 Calspan Corporation Process for the interpretation of remotely sensed data
US4651001A (en) * 1983-12-19 1987-03-17 Kabushiki Kaisha Toshiba Visible/infrared imaging device with stacked cell structure
US4663656A (en) * 1984-03-16 1987-05-05 Rca Corporation High-resolution CCD imagers using area-array CCD's for sensing spectral components of an optical line image
US4688085A (en) * 1984-08-13 1987-08-18 Hitachi, Ltd. Enhanced sensitivity color video camera with reduced red component in second luminance signal
WO1989012941A1 (en) * 1988-06-16 1989-12-28 Valtion Teknillinen Tutkimuskeskus Procedure and means for producing a false colour picture
US5132802A (en) * 1989-02-23 1992-07-21 Tzn Forschungs-Und Entwicklungszentrum Unterluss Gmbh High contrast image apparatus employing optical filters to cause each image pick-up element to have its maximum sensitivity in a different spectral range
WO1993011630A1 (en) * 1991-11-27 1993-06-10 Valtion Teknillinen Tutkimuskeskus Method and apparatus for producing a false colour image
US5350490A (en) * 1992-02-21 1994-09-27 Samsung Electronics Ltd. Forming a color filter on a semiconductor substrate

Patent Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US4037048A (en) * 1973-04-19 1977-07-19 Calspan Corporation Process for the interpretation of remotely sensed data
US4651001A (en) * 1983-12-19 1987-03-17 Kabushiki Kaisha Toshiba Visible/infrared imaging device with stacked cell structure
US4663656A (en) * 1984-03-16 1987-05-05 Rca Corporation High-resolution CCD imagers using area-array CCD's for sensing spectral components of an optical line image
US4688085A (en) * 1984-08-13 1987-08-18 Hitachi, Ltd. Enhanced sensitivity color video camera with reduced red component in second luminance signal
WO1989012941A1 (en) * 1988-06-16 1989-12-28 Valtion Teknillinen Tutkimuskeskus Procedure and means for producing a false colour picture
US5132802A (en) * 1989-02-23 1992-07-21 Tzn Forschungs-Und Entwicklungszentrum Unterluss Gmbh High contrast image apparatus employing optical filters to cause each image pick-up element to have its maximum sensitivity in a different spectral range
WO1993011630A1 (en) * 1991-11-27 1993-06-10 Valtion Teknillinen Tutkimuskeskus Method and apparatus for producing a false colour image
US5350490A (en) * 1992-02-21 1994-09-27 Samsung Electronics Ltd. Forming a color filter on a semiconductor substrate

Non-Patent Citations (6)

* Cited by examiner, † Cited by third party
Title
B. B. Nitsch, K. Von Bargen, G. E. Meyer, "Visible and Near Infrared Plant, Soil and Crop Residue Reflectivity for Weed Sensor Design," ASAE, Paper No. 913006.
B. B. Nitsch, K. Von Bargen, G. E. Meyer, Visible and Near Infrared Plant, Soil and Crop Residue Reflectivity for Weed Sensor Design, ASAE, Paper No. 913006. *
E. Franz, M. R. Gebhardt, K. B. Unklesbay, "The Use of Local Spectral Properties of Leaves as an Aid for Identifying Weed Seedlings in Digital Images," Transactions of the ASAE, vol. 34(2): Mar.-Apr. 1991, pp. 682-687.
E. Franz, M. R. Gebhardt, K. B. Unklesbay, The Use of Local Spectral Properties of Leaves as an Aid for Identifying Weed Seedlings in Digital Images, Transactions of the ASAE, vol. 34(2): Mar. Apr. 1991, pp. 682 687. *
Sony brochure for lCCD R.G.B. Primary Color Filter Camera Module XC 711/711P. *
Sony brochure for lCCD R.G.B. Primary Color Filter Camera Module XC-711/711P.

Cited By (86)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5661817A (en) * 1995-07-21 1997-08-26 Lockheed Martin Corporation Single charge-coupled-device camera for detection and differentiation of desired objects from undesired objects
US5992758A (en) * 1996-09-23 1999-11-30 Agro-Mack Enterprises Ltd. Proximity detector for ground-based implements
US6715003B1 (en) 1998-05-18 2004-03-30 Agilent Technologies, Inc. Digital camera and method for communicating digital image and at least one address image stored in the camera to a remotely located service provider
US6167469A (en) * 1998-05-18 2000-12-26 Agilent Technologies, Inc. Digital camera having display device for displaying graphical representation of user input and method for transporting the selected digital images thereof
US8466978B2 (en) 1998-05-29 2013-06-18 Avago Technologies General Ip (Singapore) Pte. Ltd. Digital image processor for a digital camera
US6642956B1 (en) 1998-05-29 2003-11-04 Agilent Technologies, Inc. Digital image processor for a digital camera
US20030048361A1 (en) * 1998-05-29 2003-03-13 Safai Mohammad A. Digital camera
US9025045B2 (en) 1998-05-29 2015-05-05 Avago Technologies General Ip (Singapore) Pte. Ltd. Digital image processor for a digital camera
US6577336B2 (en) 1998-05-29 2003-06-10 Agilent Technologies, Inc. Authentication stamping in a digital camera
US20080055428A1 (en) * 1998-05-29 2008-03-06 Safai Mohammad A Digital Image Processor for a Digital Camera
US6593963B1 (en) 1998-05-29 2003-07-15 Agilent Technologies, Inc. Programmable control of operational signals in a digital camera
US7321388B2 (en) 1998-05-29 2008-01-22 Avago Technologies General Ip (Singapore) Pte. Ltd. Digital image processor for a digital camera
US20100295964A1 (en) * 1998-05-29 2010-11-25 Safai Mohammad A Digital image processor for a digital camera
US20060274167A1 (en) * 1998-05-29 2006-12-07 Safai Mohammad A Digital image processor for a digital camera
US20040004664A1 (en) * 1998-05-29 2004-01-08 Safai Mohammad A. Digital image processor for a digital camera
US7903149B2 (en) 1998-05-29 2011-03-08 Avago Technologies Fiber Ip (Singapore) Pte. Ltd Digital image processor for a digital camera
US8760533B2 (en) 1998-05-29 2014-06-24 Avago Technologies General Ip (Singapore) Pte. Ltd. Digital image processor for a digital camera
US6363366B1 (en) * 1998-08-31 2002-03-26 David L. Henty Produce identification and pricing system for checkouts
EP1004240A1 (en) * 1998-11-27 2000-05-31 Amazonen-Werke H. Dreyer GmbH & Co. KG Device for recognizing plants and/or forms applied to agriculture
US7236196B1 (en) * 1999-09-08 2007-06-26 Fujifilm Corporation Solid-state image pickup apparatus for reading out image signals with pixels reduced in a horizontal direction and a signal reading method for the same
US7806335B2 (en) 2000-11-24 2010-10-05 Metrologic Instruments, Inc. Digital image capturing and processing system for automatically recognizing objects in a POS environment
DE10118628C1 (en) * 2001-04-12 2002-12-05 Aeg Infrarot Module Gmbh Detecting spectrally selective infrared radiator involves acquiring broadband image and image in sub-band of broadband image in immediate succession using infrared detector
US6855933B2 (en) 2001-07-24 2005-02-15 The Board Of Regents For Oklahoma State University Optical spectral reflectance sensor and controller
US20040065834A1 (en) * 2001-07-24 2004-04-08 The Board Of Regents For Oklahoma State University Optical spectral reflectance sensor and controller
US6596996B1 (en) 2001-07-24 2003-07-22 The Board Of Regents For Oklahoma State University Optical spectral reflectance sensor and controller
US7030916B2 (en) * 2001-09-19 2006-04-18 Fuji Photo Film Co., Ltd. Color image pickup apparatus with light source distinguishing function
US20030058357A1 (en) * 2001-09-19 2003-03-27 Fuji Photo Film Co., Ltd. Color image pickup apparatus with light source distinguishing function
US7148920B2 (en) * 2002-03-05 2006-12-12 Fuji Photo Film Co., Ltd. Solid state image pickup device capable of distinguishing between light sources and image pickup apparatus using such solid state image pickup device
US20030169354A1 (en) * 2002-03-05 2003-09-11 Fuji Photo Film Co., Ltd. Solid state image pickup device capable of distinguishing between light sources and image pickup apparatus using such solid state image pickup device
DE10220825A1 (en) * 2002-05-08 2003-07-03 Audi Ag Image pickup device for motor vehicle driver assistance system, has image pickup element corresponding to pixel of image detection device
US7379590B2 (en) * 2003-01-17 2008-05-27 University Of New Brunswick Method for generating natural colour satellite images
US20050001912A1 (en) * 2003-07-02 2005-01-06 Nikon Corporation Color photographing device
US7656458B2 (en) * 2003-07-02 2010-02-02 Nikon Corporation Color photographing device
US7900839B2 (en) 2003-11-13 2011-03-08 Metrologic Instruments, Inc. Hand-supportable digital image capture and processing system having a printed circuit board with a light transmission aperture, through which the field of view (FOV) of the image detection array and visible targeting illumination beam are projected using a FOV-folding mirror
US8132731B2 (en) 2003-11-13 2012-03-13 Metrologic Instruments, Inc. Digital image capture and processing system having a printed circuit (PC) board with a light transmission aperture, wherein an image detection array is mounted on the rear side of said PC board, and a linear array of light emitting diodes (LEDS) is mounted on the front surface of said PC board, and aligned with an illumination-focusing lens structure integrated within said imaging window
US8100331B2 (en) 2003-11-13 2012-01-24 Metrologic Instruments, Inc. Digital image capture and processing system having a printed circuit (PC) board with light transmission aperture, wherein first and second field of view (FOV) folding mirrors project the FOV of a digital image detection array on the rear surface of said PC board, through said light transmission aperture
US8157174B2 (en) 2003-11-13 2012-04-17 Metrologic Instruments, Inc. Digital image capture and processing system employing an image formation and detection system having an area-type image detection array supporting single snap-shot and periodic snap-shot modes of image acquisition during object illumination and imaging operations
US8087588B2 (en) 2003-11-13 2012-01-03 Metrologic Instruments, Inc. Digital image capture and processing system having a single printed circuit (PC) board with a light transmission aperture, wherein a first linear array of visible light emitting diodes (LEDs) are mounted on the rear side of the PC board for producing a linear targeting illumination beam, and wherein a second linear array of visible LEDs are mounted on the front side of said PC board for producing a field of visible illumination within the field of view (FOV) of the system
US8052057B2 (en) * 2003-11-13 2011-11-08 Metrologic Instruments, Inc. Method of programming the system configuration parameters of a digital image capture and processing system during the implementation of its communication interface with a host system without reading programming-type bar code symbols
US8157175B2 (en) 2003-11-13 2012-04-17 Metrologic Instruments, Inc. Digital image capture and processing system supporting a presentation mode of system operation which employs a combination of video and snapshot modes of image detection array operation during a single cycle of system operation
US9104930B2 (en) 2003-11-13 2015-08-11 Metrologic Instruments, Inc. Code symbol reading system
US7841533B2 (en) 2003-11-13 2010-11-30 Metrologic Instruments, Inc. Method of capturing and processing digital images of an object within the field of view (FOV) of a hand-supportable digitial image capture and processing system
US7845561B2 (en) 2003-11-13 2010-12-07 Metrologic Instruments, Inc. Digital image capture and processing system supporting a periodic snapshot mode of operation wherein during each image acquisition cycle, the rows of image detection elements in the image detection array are exposed simultaneously to illumination
US7845559B2 (en) 2003-11-13 2010-12-07 Metrologic Instruments, Inc. Hand-supportable digital image capture and processing system employing visible targeting illumination beam projected from an array of visible light sources on the rear surface of a printed circuit (PC) board having a light transmission aperture, and reflected off multiple folding mirrors and projected through the light transmission aperture into a central portion of the field of view of said system
US8047438B2 (en) 2003-11-13 2011-11-01 Metrologic Instruments, Inc. Digital image capture and processing system employing an image formation and detection subsystem having an area-type image detection array supporting periodic occurrance of snap-shot type image acquisition cycles at a high-repetition rate during object illumination
US7997489B2 (en) 2003-11-13 2011-08-16 Metrologic Instruments, Inc. Countertop-based digital image capture and processing system having an illumination subsystem employing a single array of LEDs disposed behind an illumination focusing lens structure integrated within the imaging window, for generating a field of visible illumination highly confined below the field
US8317105B2 (en) 2003-11-13 2012-11-27 Metrologic Instruments, Inc. Optical scanning system having an extended programming mode and method of unlocking restricted extended classes of features and functionalities embodied therewithin
US7922089B2 (en) 2003-11-13 2011-04-12 Metrologic Instruments, Inc. Hand-supportable digital image capture and processing system employing automatic object presence detection to control automatic generation of a linear targeting illumination beam within the field of view (FOV), and manual trigger switching to initiate illumination
US8011585B2 (en) 2003-11-13 2011-09-06 Metrologic Instruments, Inc. Digital image capture and processing system employing a linear LED-based illumination array mounted behind an illumination-focusing lens component integrated within the imaging window of the system
US7967209B2 (en) 2003-11-13 2011-06-28 Metrologic Instruments, Inc. Method of blocking a portion of illumination rays generated by a countertop-supported digital imaging system, and preventing illumination rays from striking the eyes of the system operator or nearby consumers during operation of said countertop-supported digital image capture and processing system installed at a retail point of sale (POS) station
US7980471B2 (en) 2003-11-13 2011-07-19 Metrologic Instruments, Inc. Method of unlocking restricted extended classes of features and functionalities embodied within a digital image capture and processing system by reading feature/functionality-unlocking type code symbols
US7988053B2 (en) 2003-11-13 2011-08-02 Metrologic Instruments, Inc. Digital image capture and processing system employing an image formation and detection subsystem having image formation optics providing a field of view (FOV) on an area-type image detection array, and a multi-mode illumination subsystem having near and far field LED-based illumination arrays for illuminating near and far field portions of said FOV
WO2005060241A1 (en) * 2003-12-17 2005-06-30 Nokia Corporation Method and imaging device for producing infrared images and normal images
US20050134697A1 (en) * 2003-12-17 2005-06-23 Sami Mikkonen Imaging device and method of creating image file
CN100463497C (en) * 2003-12-17 2009-02-18 诺基亚有限公司 Method and imaging device for producing infrared images and normal images
US7746396B2 (en) 2003-12-17 2010-06-29 Nokia Corporation Imaging device and method of creating image file
JP2007515010A (en) * 2003-12-18 2007-06-07 サジェム デファンス セキュリテ Method and apparatus for iris authentication
US7693307B2 (en) * 2003-12-18 2010-04-06 Sagem Defense Securite Method and apparatus for iris recognition
US20070110284A1 (en) * 2003-12-18 2007-05-17 Rieul Francois Method and apparatus for iris recognition
US20060071156A1 (en) * 2004-10-06 2006-04-06 Funai Electric Co., Ltd. Infrared imaging apparatus
US7235775B2 (en) * 2004-10-06 2007-06-26 Funai Electric Co., Ltd. Infrared imaging apparatus for processing emissions in infrared and visible spectrum
US20090147112A1 (en) * 2007-12-05 2009-06-11 Electro Scientific Industries, Inc. Method and apparatus for achieving panchromatic response from a color-mosaic imager
US8259203B2 (en) 2007-12-05 2012-09-04 Electro Scientific Industries, Inc. Method and apparatus for achieving panchromatic response from a color-mosaic imager
DE102008003791B4 (en) * 2008-01-10 2017-03-16 Robert Bosch Gmbh Method for processing and evaluating a color image and associated driver assistance system
DE202008018010U1 (en) 2008-01-14 2011-05-05 Henty, David L., Irvine Fruits and vegetables Identification and pricing system for cash registers
US20090316025A1 (en) * 2008-06-18 2009-12-24 Hideaki Hirai Image pickup
US8379084B2 (en) 2008-06-18 2013-02-19 Ricoh Company, Limited Image pickup
EP2136550A3 (en) * 2008-06-18 2011-08-17 Ricoh Company, Ltd. Image pickup
TWI480189B (en) * 2008-06-18 2015-04-11 Ricoh Co Ltd Image pickup
DE102008031593A1 (en) * 2008-07-03 2010-01-07 Hella Kgaa Hueck & Co. Camera system for use in motor vehicle to assist driver during e.g. reversing vehicle, has filter system formed from red, green, blue and weight color filters, and evaluation arrangement with compensating unit to compensate infrared parts
US8658975B2 (en) * 2009-06-10 2014-02-25 Siliconfile Technologies Inc. Image sensor for measuring illumination, proximity and color temperature
US20100314543A1 (en) * 2009-06-10 2010-12-16 Siliconfile Technologies Inc. Image sensor for measuring illumination, proximity and color temperature
DE102011100350A1 (en) * 2011-05-03 2012-11-08 Conti Temic Microelectronic Gmbh Image sensor with adjustable resolution
US20140192177A1 (en) * 2011-09-02 2014-07-10 Koninklijke Philips N.V. Camera for generating a biometrical signal of a living being
US10521900B2 (en) * 2011-09-02 2019-12-31 Koninklijke Philips N.V. Camera for generating a biometrical signal of a living being
US20130217439A1 (en) * 2012-02-21 2013-08-22 Trimble Navigation Limited Cell phone NDVI sensor
US8902413B2 (en) * 2012-02-21 2014-12-02 Trimble Navigation Limited Cell phone NDVI sensor
US20130222603A1 (en) * 2012-02-28 2013-08-29 Aptina Imaging Corporation Imaging systems for infrared and visible imaging
US20140009647A1 (en) * 2012-07-06 2014-01-09 Fujifilm Corporation Color imaging element and imaging apparatus
US8922683B2 (en) * 2012-07-06 2014-12-30 Fujifilm Corporation Color imaging element and imaging apparatus
WO2016151240A1 (en) * 2015-03-23 2016-09-29 Université de Bourgogne Imaging of a macroscopic plant object
FR3034234A1 (en) * 2015-03-23 2016-09-30 Univ Bourgogne IMAGING A MACROSCOPIC VEGETABLE OBJECT
DE102016105579A1 (en) * 2016-03-24 2017-09-28 Connaught Electronics Ltd. Optical filter for a camera of a motor vehicle, camera for a driver assistance system, driver assistance system and motor vehicle train with a driver assistant system
US20180278857A1 (en) * 2017-03-23 2018-09-27 JVC Kenwood Corporation Imaging device and imaging method
US10659703B2 (en) * 2017-03-23 2020-05-19 JVC Kenwood Corporation Imaging device and imaging method for capturing a visible image and a near-infrared image
US10963751B2 (en) 2018-06-07 2021-03-30 Cnh Industrial Canada, Ltd. Measuring crop residue from imagery using a machine-learned classification model

Similar Documents

Publication Publication Date Title
US5555464A (en) Red/near-infrared filtering for CCD cameras
US5661817A (en) Single charge-coupled-device camera for detection and differentiation of desired objects from undesired objects
US5621460A (en) Optical differentiation between plants and background utilizing a single CCD camera
US9094567B2 (en) Multi-channel camera system
EP0811400B1 (en) Method and system for fire detection
Yang A high-resolution airborne four-camera imaging system for agricultural remote sensing
US5258618A (en) Infrared imager forming two narrow waveband images of the same object field
Blackmer et al. Analysis of aerial photography for nitrogen stress within corn fields
US11388359B2 (en) Systems and methods for implementing time delay integration imaging techniques in conjunction with distinct imaging regions on a monolithic charge-coupled device image sensor
US5132802A (en) High contrast image apparatus employing optical filters to cause each image pick-up element to have its maximum sensitivity in a different spectral range
CN1914492B (en) Method and system for wavelength-dependent imaging and detection using a hybrid filter
US7545422B2 (en) Imaging system
Everitt et al. A three-camera multispectral digital video imaging system
EP0630159B1 (en) Moire reduction device for a solid state colour imaging apparatus
EP1515161A1 (en) Optical range finder and corresponding method
WO1999050682A2 (en) Infrared pixel sensor and infrared signal correction
King et al. Development of a multispectral video system and its application in forestry
Pitt et al. Use of remote sensing for forest vegetation management: a problem analysis
US20110242328A1 (en) Ir-based multispectral disturbed ground detection
WO2022252367A1 (en) Multispectral image sensor and imaging module thereof
King Determination and reduction of cover type brightness variations with view angle in airborne multispectral video imagery
AU2021204034B2 (en) Information processing device, information processing method and program
Everitt et al. Distinguishing brush and weeds on rangelands using video remote sensing
DE10037701C2 (en) Color imaging system with anti-aliasing
AT502858B1 (en) METHOD FOR DETECTING AND DISCRIMINATING ANIMALS IN AGRICULTURAL USED MEADOW SURFACES

Legal Events

Date Code Title Description
AS Assignment

Owner name: LORAL CORPORATION, NEW YORK

Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:HATLESTAD, JOHN D.;REEL/FRAME:007600/0341

Effective date: 19950724

STCF Information on status: patent grant

Free format text: PATENTED CASE

FEPP Fee payment procedure

Free format text: PAYOR NUMBER ASSIGNED (ORIGINAL EVENT CODE: ASPN); ENTITY STATUS OF PATENT OWNER: LARGE ENTITY

AS Assignment

Owner name: LOCKHEED MARTIN TACTICAL SYSTEMS, INC., MARYLAND

Free format text: MERGER;ASSIGNOR:LORAL CORPORATION;REEL/FRAME:009586/0402

Effective date: 19960429

AS Assignment

Owner name: LOCKHEED MARTIN CORPORATION, MARYLAND

Free format text: MERGER;ASSIGNOR:LOCKHEED MARTIN TACTICAL SYSTEMS, INC.;REEL/FRAME:009901/0660

Effective date: 19970627

FPAY Fee payment

Year of fee payment: 4

FPAY Fee payment

Year of fee payment: 8

FPAY Fee payment

Year of fee payment: 12

REMI Maintenance fee reminder mailed