US20070206099A1 - Image capturing apparatus having distance measurement function - Google Patents
Image capturing apparatus having distance measurement function Download PDFInfo
- Publication number
- US20070206099A1 US20070206099A1 US11/589,761 US58976106A US2007206099A1 US 20070206099 A1 US20070206099 A1 US 20070206099A1 US 58976106 A US58976106 A US 58976106A US 2007206099 A1 US2007206099 A1 US 2007206099A1
- Authority
- US
- United States
- Prior art keywords
- light
- image
- image capturing
- distance
- capturing apparatus
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
- G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
- G06V40/12—Fingerprints or palmprints
- G06V40/13—Sensors therefor
- G06V40/1312—Sensors therefor direct reading, e.g. contactless acquisition
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V10/00—Arrangements for image or video recognition or understanding
- G06V10/10—Image acquisition
- G06V10/12—Details of acquisition arrangements; Constructional details thereof
- G06V10/14—Optical characteristics of the device performing the acquisition or on the illumination arrangements
- G06V10/145—Illumination specially adapted for pattern recognition, e.g. using gratings
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
- G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/56—Cameras or camera modules comprising electronic image sensors; Control thereof provided with illuminating means
Definitions
- the present invention relates to an image capturing apparatus having a distance measurement function for measuring a distance of an object and capturing an image of the object, and more particularly an image capturing apparatus for measuring a distance to the object so as to detect whether the object exists in an image capturing range.
- An image capturing apparatus for capturing an image in a predetermined range of an object by irradiating the object with uniform light is widely used.
- a sharp image is particularly required.
- FIGS. 19 through 22 show explanation diagrams of the conventional blood vessel image authentication technique.
- a user puts a palm of a hand 110 close to an image capturing apparatus 100 .
- the image capturing apparatus 100 emits an ear infrared ray, and irradiates it the palm of the hand 110 .
- the image capturing apparatus 100 receives the near infrared ray reflected from the palm of hand 110 by a sensor.
- hemoglobin in the red corpuscle flowing in a vein loses oxygen.
- Such the hemoglobin (deoxidized hemoglobin) absorbs the near infrared of the vicinity of 760 nm in wavelength. Accordingly, when the palm is irradiated with the near infrared, reflection is reduced in a portion in which a vein exists. Thus, by the degree of strength of the reflected near infrared, the location of veins can be recognized.
- the user registers a vein image data of the own palm into a server or a card, using the image capturing apparatus 100 shown in FIG. 19 .
- the user makes the vein image data of the own palm to be read, using the image capturing apparatus 100 shown in FIG. 19 .
- the personal authentication is performed by collating the registered vein image, which is extracted using a user ID, with a vein pattern in the collation vein image being read above.
- a vein pattern in the collation vein image being read above.
- the person is authenticated as genuine.
- the person is not authenticated as genuine (see Japanese Unexamined Patent Publication No. 2004-062826, FIGS. 2-9 ).
- the image capturing apparatus 100 emits light producing uniform light intensity in a certain image capturing range (distance and area), receives the reflected light of the above image capturing range by a sensor, and outputs a captured image signal as an electric signal.
- FIGS. 23 and 24 show explanation diagrams of the conventional image capturing apparatus.
- the image capturing apparatus 100 includes an image capturing unit 120 at the center, and in the periphery thereof, a plurality of light-emitting devices 130 - 1 to 130 - 8 .
- the dotted lines shown in FIG. 23 represent the range of the light having uniform intensity emitted from an individual light-emitting device among the plurality of light-emitting devices 130 - 1 to 130 - 8 .
- image capturing unit 120 includes a photoelectric conversion unit 122 such as a CMOS sensor, and an optical system 124 such as a lens. Since the photoelectric conversion device 122 , which is a plane photodetector device, has a predetermined light receiving area, a predetermined optical distance is required to guide the reflected light of the image capturing range onto the light-receiving plane of the photoelectric conversion device 122 .
- a lens 124 such as a fish eye lens is disposed between the photoelectric conversion unit 122 and the object, so that an image of the predetermined image capturing range is projected onto the light-receiving plane of photoelectric conversion device 122 .
- the point light source elements 130 - 1 to 130 - 8 have been disposed apart from each other, as shown in FIG. 23 . Also, in order to supply the light of predetermined uniform intensity to the image capturing range, the point light source elements 130 - 1 to 130 - 8 have been disposed nearer to the object than the photoelectric conversion device 122 , as shown in FIG. 24 (see WO 2004/088588, FIGS. 1 and 6 ).
- an optical distance sensor having a light emission portion and a light reception portion has been provided in the image capturing apparatus, so as to measure the distance to the object (see WO 2004/088979, FIGS. 1 and 5 ).
- the optical distance sensor has been provided between the point light source 130 - 4 and the image capturing unit 120 shown in FIG. 24 .
- the distance sensor includes the light emission portion and the light reception portion. Since the distance is measured from the position of the reflected light, it has been necessary to dispose the light reception portion apart from the light emission portion. This causes the sensor of interest to become a large size. Also, miniaturization of the image capturing apparatus has been difficult and there has been a restriction when incorporating the image capturing apparatus into equipment.
- an image capturing apparatus for capturing an image of an object by illuminating the object and receiving reflected light from the object, and includes: an image sensor for capturing the image by receiving the reflected light; distance-measuring light-emitting devices for irradiating the object with spot light; and a control circuit for driving the distance-measuring light-emitting devices, detecting the spot light positions of the distance-measuring light-emitting devices from the image captured by the image sensor, and obtaining a distance to the object from the detected spot light positions at the time of the distance measurement.
- the distance-measuring light-emitting devices are disposed to the image sensor in the positions of irradiating within an image capturing range of the image sensor with the spot light.
- the distance-measuring light-emitting devices are constituted of at least three distance-measuring light-emitting devices disposed in different positions centered at the image sensor.
- the above at least three distance-measuring light-emitting devices are disposed in opposite positions centered at the image sensor.
- control circuit detects the spot light position of each distance-measuring light-emitting device from the image captured by the image sensor, and obtains an inclination of the object from the detected positions.
- the distance-measuring light-emitting devices are mounted on a circuit board having the image sensor mounted thereon.
- an illumination mechanism for illuminating the object at the time of image capturing is disposed in the periphery of the image sensor, and the distance-measuring light-emitting devices are disposed on the outer sides of the illumination mechanism.
- the illumination mechanism includes: a plurality of light-emitting devices mounted in the peripheral positions of the image sensor; a ring-shaped light guide member for guiding the light of the plurality of light-emitting devices to an image capturing range, and illuminating the image capturing range; and further includes an optical unit accommodated inside the ring of the ring-shaped light guide member and for guiding the reflected light of the object in the illuminated image capturing range to the image sensor.
- the image capturing apparatus further includes a circuit board having the image sensor, the distance-measuring light-emitting devices, and the plurality of light-emitting devices being mounted thereon.
- the plurality of light-emitting devices are mounted on the circuit board at predetermined intervals along a circle in the periphery of the image sensor, and the light guide member has a ring-shaped structure corresponding to the circle.
- a diffusion plate for diffusing the light of the light-emitting devices is disposed between the ring-shaped light guide member and the plurality of light-emitting devices.
- the plurality of light-emitting devices are configured of light-emitting devices emitting infrared rays, and at least on the incident plane of the optical unit, an optical filter for filtering the visible light is disposed.
- the light guide member includes: a lower end portion for guiding the light of the light-emitting devices; an upper end portion for outputting the light in the image capturing range; and a light guide portion for guiding the light of the light-emitting devices from the lower end portion to the upper end portion.
- the image sensor images a portion of a living body.
- the image capturing apparatus includes an image sensor for capturing an image of an object by receiving reflected light, distance-measuring light-emitting devices for irradiating the object with spot light, and, at the time of distance measurement, a control circuit for driving the distance-measuring light-emitting devices and detecting the spot light positions of the distance-measuring light-emitting devices from an image captured by the image sensor, thereby obtaining the distance to the object.
- the image sensor provided for capturing an image of the object can be used as a photodetector device for distance measurement. With this, it becomes unnecessary to separately provide a photodetector device for distance measurement, which enables miniaturization of the image capturing apparatus, as well as cost reduction.
- FIG. 1 shows a cross-sectional view of an image capturing apparatus according to one embodiment of the present invention.
- FIG. 2 shows an exploded structural view of the image capturing apparatus shown in FIG. 1 .
- FIG. 3 shows a component layout diagram of the circuit board shown in FIG. 2 .
- FIG. 4 shows an explanation diagram of the relationship between a light-emitting device and a photodetector device shown in FIG. 2 .
- FIG. 5 shows an assembly diagram of the decomposed components shown in FIG. 2 .
- FIG. 6 shows a configuration diagram of the external finishing components shown in FIG. 1 .
- FIG. 7 shows a configuration diagram of the assembly of the assembled body shown in FIG. 2 .
- FIG. 8 shows an outer view of the image capturing apparatus shown in FIG. 1 .
- FIG. 9 shows an explanation diagram of the illumination system shown in FIG. 1 .
- FIG. 10 shows a configuration diagram of the light guide member and the light-emitting device shown in FIG. 9 .
- FIG. 11 shows a relation diagram of the emission intensity distribution of the light-emitting device, and the lower end portion of the light guide member shown in FIG. 10 .
- FIG. 12 shows a first operation explanation diagram of the light guide member shown in FIG. 10 .
- FIG. 13 shows a second operation explanation diagram of the light guide member shown in FIG. 10 .
- FIG. 14 shows a third operation explanation diagram of the light guide member shown in FIG. 10 .
- FIG. 15 shows a light intensity distribution diagram using the light guide member shown in FIG. 10 .
- FIG. 16 shows a block diagram of a control circuit for the image capturing apparatus shown in FIG. 1 .
- FIG. 17 shows an imaging process flowchart of the control circuit shown in FIG. 16 .
- FIG. 18 shows an explanation diagram of distance measurement operation using the configuration shown in FIG. 16 .
- FIG. 19 shows an explanation diagram of the conventional palm image capturing apparatus.
- FIG. 20 shows a principle explanation diagram of the conventional palm image capturing apparatus.
- FIG. 21 shows an explanation diagram of the conventional palm authentication technique.
- FIG. 22 shows another explanation diagram of the conventional palm authentication technique.
- FIG. 23 shows an explanation diagram of an illumination configuration in the conventional image capturing apparatus.
- FIG. 24 shows a configuration diagram of the conventional image capturing apparatus.
- FIG. 1 shows a cross-sectional view of an image capturing apparatus according to one embodiment of the present invention
- FIG. 2 shows an exploded structural view of the image capturing apparatus shown in FIG. 1
- FIG. 3 shows a top plan view of the circuit board shown in FIGS. 1 and 2
- FIG. 4 shows an operation explanation diagram of a light-emitting device and a photodetector device shown in FIG. 3
- FIG. 5 shows an assembly diagram when the structures shown in FIG. 2 are assembled
- FIG. 6 shows a configuration diagram of the external case shown in FIG. 1
- FIG. 7 shows a configuration diagram when the assembled body shown in FIG. 2 is housed in the external case
- FIG. 8 shows an outer view of the image capturing apparatus shown in FIG. 1 .
- an image sensor 30 such as a CMOS image sensor and a polarizing plate 32 are disposed at the center of a camera substrate 20 .
- a plurality of light-emitting devices 22 , 24 and photodetector devices 26 are mounted.
- the image sensor 30 is mounted at the center of the camera substrate 20 , and the polarizing plate 32 is pasted upon the image sensor 30 .
- the polarizing plate 32 is pasted upon the image sensor 30 .
- a plurality of light-emitting devices 22 , 24 and photodetector devices 26 are mounted.
- the photo-detector device (photodiode) 26 is disposed between each the above first light-emitting device 22 and each the second light-emitting device 24 .
- the photo-detector device 26 is provided for receiving the light from both the first light-emitting device 22 and the light from the second light-emitting device 24 (reflected light from a diffusion plate 44 described later), thereby performing APC (automatic power control) of the first light-emitting device 22 and the second light-emitting device 24 .
- the above first light-emitting device 22 and the second light-emitting device 24 are driven for emission at individual timing.
- one photodetector device 26 is disposed between the first light-emitting device 22 and the second light-emitting device 24 so as to receive the light from the first and second light-emitting devices 22 , 24 .
- the number of photodetector devices for APC control can be reduced.
- four distance-measuring light-emitting devices 52 are provided for measuring the distance to the object. As shown in FIG. 3 , the above four distance-measuring light-emitting devices 52 are disposed on the diagonal lines of the camera substrate 20 , at the farthest positions on the diagonal lines so that each distance therebetween becomes farthest. From the distances measured by the above four distance-measuring light-emitting devices 52 , the inclination of the object (here, palm) is detected.
- illumination systems 22 , 24 , 26 and imaging systems 30 , 32 for imaging the object, as well as a distance-measuring system 52 .
- each diffusion plate 44 diffuses, to a certain extent, the emission distribution of the directive light emitted from the first and second light-emitting devices 22 , 24 .
- Each polarizing plate 42 converts natural light emitted from the first and second light-emitting devices 22 , 24 to linearly polarized light.
- a ring-shaped light guide member 10 is provided in the upper direction of the four polarizing plates 42 .
- the light guide member 10 is formed of, for example, resin, and guides the light from the first and second light-emitting devices 22 , 24 of the camera substrate 20 in the upward direction, so as to irradiate the object with uniform light.
- the light guide member 10 has a ring-shaped structure. As will be described in FIG. 9 and after, the light guide member 10 guides the light emitted from the first and second light-emitting devices 22 , 24 to the upward direction, so that the object is irradiated with uniform light.
- an optical unit 34 is attached to the camera substrate 20 on the image sensor 30 disposed in the approximate center of the camera substrate 20 , and inside the ring-shaped light guide member 10 .
- the optical unit 34 is constituted of a lens optical system such as a converging lens.
- An aperture 50 is mounted on the distance-measuring light-emitting device 52 of the camera substrate 20 .
- the aperture 50 shuts off diffusion of light to other directions so as to guide the light emitted from the distance-measuring light-emitting devices 52 to the object direction.
- a control substrate 60 is provided Separately from the camera substrate 20 .
- the control substrate 60 is provided for connecting with the outside, and includes an external connector 62 and a camera connector 64 for connecting with the camera substrate 20 .
- the above control substrate 60 is disposed on the lower portion of the camera substrate 20 , and electrically connected with the camera substrate 20 using the camera connector 64 . Further, a holder cover 68 is provided for the external connector 62 .
- the image sensor 30 , the light-emitting devices 22 , 24 , the photo-detector devices 26 and the distance-measuring light-emitting devices 52 are mounted on the camera substrate 20 .
- the polarization/diffusion plate holders 46 , the diffusion plates 44 , the polarizing plates 42 , the apertures 50 , the optical unit 34 , and the light guide members 10 are mounted on the above camera substrate 20 , and thus a camera portion is assembled.
- the control substrate 60 is attached.
- FIG. 5 shows a state of the unit after attaching the camera portion and the control substrate 60 .
- FIG. 6 there are prepared a visible-light cutoff filter plate 76 , a hood 78 , a holder assembly 70 and an external case 74 .
- attachment unit shown in FIG. 5 to the holder assembly 70 shown in FIG. 6
- holder cover 68 shown in FIG. 2 to the holder assembly 70
- FIG. 7 By attaching the holder cover 68 shown in FIG. 2 to the holder assembly 70 , the configuration shown in FIG. 7 is assembled.
- FIG. 7 The configuration shown in FIG. 7 is then housed into the external case 74 shown in FIG. 6 , and by attaching the visible-light cutoff filter plate 76 having an attached hood 78 on the upper portion of external case 74 , an image capturing apparatus shown in FIG. 8 is structured.
- the above the visible-light cutoff filter plate 76 cuts off the visible light component so as not to enter the image sensor 30 from outside.
- the hood 78 shuts off the light so that the light outside the predetermined image capturing area does not enter the optical unit 34 , and prevents the light being leaked from the light guide member 10 from invading into the optical unit 34 .
- FIG. 1 shows a cross-sectional view of the finished body 1 shown in FIG. 8 .
- the image sensor 30 , the light-emitting devices 22 , 24 , the photo-detector devices 26 and the distance-measuring light-emitting device 52 are mounted on the camera substrate 20 .
- a basic structure including the illumination system and the image capturing system is mounted on the single substrate. Accordingly, only one mounting board is sufficient, thus contributing to cost reduction.
- the light from the light-emitting devices 22 , 24 is guided to the visible-light filter 76 .
- the above light guide member 10 separates the light from the light-emitting devices 22 , 24 and then forwards the light to the visible-light filter 76 . Therefore, the light-emitting devices 22 , 24 can be disposed close to the image sensor 30 , and also on the identical substrate 20 , which enables miniaturization, and illumination of the object by uniform light as well. More specifically, assuming that an oblique line portion of an upside-down triangle shape shown in FIG. 1 is the image capturing range of the camera, the image capturing range can be illuminated by uniform light.
- the light guide member 10 has a ring shape, it is possible to house the optical unit 34 inside the ring 10 , thus enabling further miniaturization.
- the hood 78 prevents the light outside the predetermined image capturing range (oblique line portion in FIG. 1 ) from entering the optical unit 34 , and also prevents the light leaked from the light guide member 10 from invading into the optical unit 34 . Accordingly, even when the light guide member 10 and the light-emitting devices 22 , 24 are disposed close to the image sensor 30 and the optical unit 34 , degradation in imaging accuracy can be avoided.
- the control substrate 60 is connected to the lower portion of the camera substrate 20 , and an external cable 2 is connected to the external connector 62 of the control substrate 60 .
- FIG. 9 shows an operation explanation diagram of the light guide member according to one embodiment of the present invention
- FIG. 10 shows a detailed configuration diagram of the illumination mechanism shown in FIG. 9
- FIG. 11 shows an explanation diagram of a trapezoidal notch of the light guide member shown in FIG. 10
- FIGS. 12 through 14 show explanation diagrams of light guiding and diffusion operations of the light guide member shown in FIG. 10
- FIG. 15 shows a luminance (brightness) distribution diagram by the illumination.
- the light guide member 10 guides the light from each light-emitting device 22 , 24 , which is a point light source, to the visible-light filter 76 so as to split the light into three.
- each single point light source 22 , 24 can behave as if three point light sources exist in the vicinity of the visible-light filter 76 .
- the light guide member 10 includes an upper slope face 14 , two side faces 10 - 1 , 10 - 2 , and a lower trapezoidal groove 12 .
- the lower trapezoidal portion 12 is positioned opposite to the light-emitting device 22 , 24 by the intermediary of the polarizing plate 42 and the diffusion plate 44 , and receives the light from the light-emitting device 22 , 24 .
- the upper slope face 14 is a slope face of which height is greater on the optical unit 34 side.
- an emission intensity distribution B from the light-emitting device 22 , 24 has a long (strong) circular arc shape in the upward direction. Namely, the intensity of a light component B 1 to the light output direction of the light-emitting device 22 , 24 (vertical direction of the device) is stronger than the intensity of light components B 2 , B 3 to the directions to both sides.
- the trapezoidal groove 12 in the light guide member 10 is formed correspondingly to the above intensity distribution B so that the light can basically be regarded as three point light sources on the output side.
- the trapezoidal groove 12 is constituted of a flat portion 12 b for introducing the light component B 1 without refracting, and a pair of slope face portions 12 a, 12 c for refracting and introducing the light components B 2 , B 3 on the both sides, having gradients corresponding to the directions of the light components B 2 , B 3 .
- the above shapes of the trapezoidal groove 12 function to virtually split the light from each point light source 22 , 24 into three.
- the respective lengths of the above flat portion 12 b and slope face portions 12 a, 12 c are set so that the light intensity in a predetermined area caused by the light output from the light guide member 10 becomes substantially uniform.
- the length of the flat portion 12 b, which receives the maximum intensity of the light component B 1 is set shorter than each length of the slope face portions 12 a, 12 c, which receive light intensity of the light components B 2 , B 3 weaker than the light intensity of the light component B 1 .
- the component B 2 on the left side of the emission intensity distribution B of each light-emitting device 22 , 24 is refracted at the left slope face portion 12 a of the light guide member 10 , and incident to the left side face 10 - 2 of the light guide member 10 .
- the incident light is then reflected on the left side face 10 - 2 , and forwarded to the right side face 10 - 1 of the light guide member 10 .
- the light forwarded to the right side face 10 - 1 is reflected on the right side face 10 - 1 , and forwarded again to the left side face 10 - 2 .
- the light is then reflected on the left side face 10 - 2 , and incident to the upper slope face 14 substantially perpendicularly, and output to the outermost portion of the image capturing range.
- the central component B 1 of the emission intensity distribution B of the light-emitting device 22 , 24 is incident to the light guide member 10 from the central flat portion 12 b of the light guide member 10 .
- the light is then incident obliquely to the upper slope face 14 , and output to the innermost portion of the image capturing range.
- the component B 3 on the right side of the emission intensity distribution B of the light-emitting device 22 , 24 is refracted at the right slope face portion 12 c of the light guide member 10 , and incident to the right side face 10 - 1 of the light guide member 10 .
- the incident light is then reflected on the right side face 10 - 1 , and forwarded to the left side face 10 - 2 of the light guide member 10 .
- the light forwarded to the left side face 10 - 2 is reflected on the left side face 10 - 2 , and incident to the upper slope face 14 substantially perpendicularly, and output between the innermost portion and the outermost portion of the image capturing range.
- FIGS. 12 through 14 an optical path diagram as shown in FIG. 10 is obtained. Namely, at the trapezoidal groove 12 , the light guide member 10 splits the point emission of the point light source 22 , 24 into three. Using the reflection on the side faces inside the light guide member 10 , each split light is output in such behavior as three point light sources existent on the output side of the light guide member 10 .
- the output direction is adjusted at the upper slope face 14 of the light guide member 10 .
- the lengths i.e. the incident widths of, or the incident amount to, the flat portion 12 b and the slope face portions 12 a, 12 c of the trapezoidal groove 12 of the light guide member 10 are adjusted, taking into consideration the emission intensity distribution B of light-emitting device 22 , 24 described earlier in FIG. 11 .
- the length of the flat portion 12 b of the trapezoidal groove 12 is set shorter than each length of the slope face portions 12 a, 12 c.
- the light portion having strong light intensity is incident not only to the flat portion 12 b, but also to the slope face portions 12 a, 12 c.
- the reflected light and the rectilinear light can be output with diffusion so as to obtain substantially uniform light intensity throughout the image capturing range.
- FIG. 15 shows a diagram illustrating an experiment result in regard to the image capturing range and the light intensity of the image capturing apparatus shown in FIG. 1 .
- the horizontal axis indicates the position, while the vertical axis indicates the light intensity. More specifically, the position is a dot position of the image sensor 30 , and here, the image sensor 30 having 640 dots in width is employed.
- plain white paper for experimental purpose on the flat portion of the upper part of the image capturing range (oblique line portion) shown in FIG. 1 , thereby producing uniform reflection, an output level value of each dot of image sensor 30 has been measured. Because of the white paper, the output level value corresponds to the light intensity.
- substantially uniform light intensity has been obtained in the width of approximately 310 dots in the center of the image sensor 30 .
- the maximum level in the 310 dot width is ‘190’
- the minimum level is ‘160’, which range within ⁇ 15% of the medium value ‘175’, with the error of ⁇ 10% or less.
- V 1 the range of uniform light intensity is shown by V 1 .
- V 1 the image capturing range
- an image obtained outside the range of V 1 may also be used for feature extraction of a lower degree of importance, by matching the level through level correction.
- FIG. 16 shows a block diagram of a captured image processing apparatus according to one embodiment of the present invention.
- FIG. 17 shows a flow chart of the captured image processing in the above image processing apparatus.
- FIG. 18 shows an explanation diagram of distance measurement operation.
- a drive/process system in the image capturing apparatus includes a first illumination LED driver 94 for driving the first light-emitting device 22 , a second illumination LED driver 96 for driving the second light-emitting device 24 , a distance-measuring LED driver 98 for driving the distance-measuring light-emitting devices 52 , an analog/digital converter 92 for converting the analog output of each pixel from the image sensor 30 to a digital value, and a microcontroller 90 .
- Microcontroller (MCU) 90 includes MPU (microprocessor), ROM (read-only memory) and RAM (random access memory), and executes processing including distance measurement 90 A, posture discrimination 90 B, shutter control 90 C and image processing 90 D.
- imaging processing in MCU 90 is described below.
- (S 10 ) MCU 90 drives the distance-measuring light-emitting devices (LED) 52 via the distance-measuring LED driver 98 .
- LED distance-measuring light-emitting devices
- four distance-measuring light-emitting devices 52 described in FIGS. 2 and 3 emit light.
- the image sensor 30 photographs an image in the image capturing range.
- the illumination light-emitting devices 22 , 24 are not driven, the image sensor 30 receives only the reflected light from the object in the image capturing range corresponding to the light emitted from the distance-measuring light-emitting devices 52 .
- FIG. 10 MCU 90 drives the distance-measuring light-emitting devices (LED) 52 via the distance-measuring LED driver 98 .
- each analog light reception amount in image 30 A of the image sensor 30 is converted into a digital value, and then stored into the memory of MCU 90 .
- MCU 90 searches the image data in the memory, and detects the positions of the above reflected light 52 A, 52 B, 52 C and 52 D.
- the four distance-measuring light-emitting devices 52 are disposed diagonally from the center of the image (image capturing range) as shown in FIGS. 3 and 18 , by searching on the straight lines, as shown by the dotted lines in FIG. 18 , the positions of the four points (i.e. the positions from the center of the image sensor) can be detected from the pixel luminance on the straight lines. For example, in the image capturing range of an upside-down triangle as shown in FIG.
- MCU 90 detects the distance (average) and the inclination of the object using the triangulation measuring method. Namely, by use of the positions from the center of the image sensor 30 , a distance at each of the four points is calculated, and the inclination (in four directions) can be detected from the distance difference of the four points.
- MCU 90 decides whether the distance to the imaging object is appropriate (whether the object is positioned in the image capturing range with a predetermined focal-distance). When the distance to the imaging object is not appropriate, MCU 90 displays a guidance message on a non-illustrated display portion. For example, a guidance message of “Put the object (palm) closer.” or “Put the object (palm) further.” is displayed.
- MCU 90 decides whether the inclination of the imaging object is appropriate. For example, when imaging a flat portion (palm, etc.) of the object, it is decided whether the inclination is within a tolerable range. When the inclination of the imaging object is not appropriate, MCU 90 displays a guidance message on the non-illustrated display portion. For example, in case that a palm is the object, a guidance message of “Open your hand.” or the like is displayed.
- MCU 90 instructs the illumination LED drivers 94 , 96 to emit light.
- the first and second light-emitting devices 22 , 24 emit light, so as to irradiate the object.
- MCU 90 drives a non-illustrated electric shutter (provided in the optical unit), and photographs the image in the image capturing range by image sensor 30 .
- MCU 90 then stores the image into the memory via A/D converter 92 .
- the feature is extracted from the above image. For example, in case of extraction of the aforementioned blood vessel image, the blood vessel image is extracted from the image.
- the image sensor 30 is also used for the distance-measuring photodetector portion to detect whether the imaging object lies at the focal distance, or the inclination thereof.
- the distance measurement mechanism it is sufficient to provide the distance-measuring light-emitting devices 52 without particularly providing photodetector devices for distance measurement. This contributes a reduction of cost, and miniaturization as well, due to a reduced number of mounting components.
- the positions of the four points can be detected by searching the image data stored in the memory as shown by the dotted lines in FIG. 18 , and thus, detection processing becomes easy. Further, because the distance-measuring light-emitting devices 52 are disposed in the farthest positions on the diagonal lines with sufficient distances, it is possible to detect the farthest positions in the image from the center even the apparatus is miniaturized, and detection of the inclination can be performed accurately.
- the description is made using a case of four distance-measuring light-emitting devices.
- only one distance-measuring light-emitting device may be provided.
- the description is made using the lower groove 12 of a trapezoidal shape.
- the groove has three planes because of the trapezoidal cross section, but a groove of a polyhedron shape such as having four planes may be used depending on required performance.
- a polyhedron having a smaller number of faces is better, and therefore, a trapezoid is better here.
- the imaging object is exemplified by the palm
- the image processing of the imaging object is exemplified by the vein pattern authentication.
- the present invention is also applicable to other biometric authentication by use of other features of human bodies, including hand skin pattern, blood vessel image of the back of hand, blood vessel image of a finger, and features of face and iris, etc.
- the present invention is not limited to the application to the biometric authentication, but applicable to other applications.
Abstract
Description
- This application is based upon and claims the benefit of priority from the prior Japanese Patent Application No. 2006-057494, filed on Mar. 3, 2006, the entire contents of which are incorporated herein by reference.
- 1. Field of the Invention
- The present invention relates to an image capturing apparatus having a distance measurement function for measuring a distance of an object and capturing an image of the object, and more particularly an image capturing apparatus for measuring a distance to the object so as to detect whether the object exists in an image capturing range.
- 2. Description of the Related Art
- An image capturing apparatus for capturing an image in a predetermined range of an object by irradiating the object with uniform light is widely used. In an image processing system using an image captured by such the image capturing apparatus, a sharp image is particularly required.
- For example, with the development of biometric technologies in recent years, there have been provided a variety of apparatuses for personal identification by which an individual can be distinguished by capturing an image of a living body by which an individual can be distinguished and recognizing a feature of the living body, for example, fingerprints of limbs, eye retinas, face and blood vessels.
- In particular, blood vessels and skin patterns of a palm and a finger are suitable for reliable personal authentication, because a relatively large amount of personal feature data may be obtained therefrom. Further, it is believed that the patterns of blood vessels (veins) do not change from the time of an embryo throughout the lifetime of any person, and that no identical pattern exists among any persons without exception, which are therefore suitable for personal authentication.
FIGS. 19 through 22 show explanation diagrams of the conventional blood vessel image authentication technique. As shown inFIG. 19 , at the time of registration or authentication, a user puts a palm of ahand 110 close to animage capturing apparatus 100. Theimage capturing apparatus 100 emits an ear infrared ray, and irradiates it the palm of thehand 110. Theimage capturing apparatus 100 receives the near infrared ray reflected from the palm ofhand 110 by a sensor. - As shown in
FIG. 20 , hemoglobin in the red corpuscle flowing in a vein loses oxygen. Such the hemoglobin (deoxidized hemoglobin) absorbs the near infrared of the vicinity of 760 nm in wavelength. Accordingly, when the palm is irradiated with the near infrared, reflection is reduced in a portion in which a vein exists. Thus, by the degree of strength of the reflected near infrared, the location of veins can be recognized. - As shown in
FIG. 19 , first, the user registers a vein image data of the own palm into a server or a card, using theimage capturing apparatus 100 shown inFIG. 19 . Next, to perform personal authentication, the user makes the vein image data of the own palm to be read, using theimage capturing apparatus 100 shown inFIG. 19 . - The personal authentication is performed by collating the registered vein image, which is extracted using a user ID, with a vein pattern in the collation vein image being read above. For example, in the case of the collation of the vein patterns between the registered image and the collation image as shown in
FIG. 21 , the person is authenticated as genuine. Meanwhile, in the case of the collation of the vein patterns between the registered image and the collation image as shown inFIG. 22 , the person is not authenticated as genuine (see Japanese Unexamined Patent Publication No. 2004-062826,FIGS. 2-9 ). - For such the biometric authentication or the like, it is necessary to capture an image of an object (a portion of a human body in case of the biometric authentication) in a non-contact manner. For this purpose, the
image capturing apparatus 100 emits light producing uniform light intensity in a certain image capturing range (distance and area), receives the reflected light of the above image capturing range by a sensor, and outputs a captured image signal as an electric signal. -
FIGS. 23 and 24 show explanation diagrams of the conventional image capturing apparatus. As shown inFIGS. 23 and 24 , theimage capturing apparatus 100 includes animage capturing unit 120 at the center, and in the periphery thereof, a plurality of light-emitting devices 130-1 to 130-8. The dotted lines shown inFIG. 23 represent the range of the light having uniform intensity emitted from an individual light-emitting device among the plurality of light-emitting devices 130-1 to 130-8. - As such, by disposing a plurality of (here, eight) point light sources in the periphery of
image capturing unit 120, the image capturing range of theimage capturing unit 120 can be irradiated with the light of uniform intensity. Meanwhile,image capturing unit 120 includes aphotoelectric conversion unit 122 such as a CMOS sensor, and anoptical system 124 such as a lens. Since thephotoelectric conversion device 122, which is a plane photodetector device, has a predetermined light receiving area, a predetermined optical distance is required to guide the reflected light of the image capturing range onto the light-receiving plane of thephotoelectric conversion device 122. For this purpose, alens 124 such as a fish eye lens is disposed between thephotoelectric conversion unit 122 and the object, so that an image of the predetermined image capturing range is projected onto the light-receiving plane ofphotoelectric conversion device 122. - Thus, conventionally, in order to irradiate the object with each point light source element 130-1 to 130-8 by sharing a predetermined image capturing range, the point light source elements 130-1 to 130-8 have been disposed apart from each other, as shown in
FIG. 23 . Also, in order to supply the light of predetermined uniform intensity to the image capturing range, the point light source elements 130-1 to 130-8 have been disposed nearer to the object than thephotoelectric conversion device 122, as shown inFIG. 24 (see WO 2004/088588,FIGS. 1 and 6 ). - Further, in such the image capturing apparatus, it is necessary to detect whether the object is positioned at a focal distance. Conventionally, an optical distance sensor having a light emission portion and a light reception portion has been provided in the image capturing apparatus, so as to measure the distance to the object (see WO 2004/088979,
FIGS. 1 and 5 ). For example, the optical distance sensor has been provided between the point light source 130-4 and theimage capturing unit 120 shown inFIG. 24 . - In the above conventional image capturing apparatus, the distance sensor includes the light emission portion and the light reception portion. Since the distance is measured from the position of the reflected light, it has been necessary to dispose the light reception portion apart from the light emission portion. This causes the sensor of interest to become a large size. Also, miniaturization of the image capturing apparatus has been difficult and there has been a restriction when incorporating the image capturing apparatus into equipment.
- Also, in order to detect the inclination of the object also, it is necessary to mount a plurality of distance sensors, which further causes difficulty in miniaturizing the image capturing apparatus with restriction to incorporate into equipment, and impediment to cost reduction.
- Accordingly, it is an object of the present invention to provide an image capturing apparatus having a distance measurement function, with a miniaturized configuration even when the distance measurement function is added.
- It is another object of the present invention to provide an image capturing apparatus having a distance measurement function, enabling cost reduction even when the distance measurement function is added.
- It is still another object of the present invention to provide an image capturing apparatus having a distance measurement function, enabling easy detection of the distance to the object with miniaturization.
- In order to achieve the aforementioned objects, according to the present invention, an image capturing apparatus for capturing an image of an object by illuminating the object and receiving reflected light from the object, and includes: an image sensor for capturing the image by receiving the reflected light; distance-measuring light-emitting devices for irradiating the object with spot light; and a control circuit for driving the distance-measuring light-emitting devices, detecting the spot light positions of the distance-measuring light-emitting devices from the image captured by the image sensor, and obtaining a distance to the object from the detected spot light positions at the time of the distance measurement.
- Further, according to the present invention, preferably, the distance-measuring light-emitting devices are disposed to the image sensor in the positions of irradiating within an image capturing range of the image sensor with the spot light.
- Still further, according to the present invention, preferably, the distance-measuring light-emitting devices are constituted of at least three distance-measuring light-emitting devices disposed in different positions centered at the image sensor.
- Further, according to the present invention, preferably, the above at least three distance-measuring light-emitting devices are disposed in opposite positions centered at the image sensor.
- Further, according to the present invention, preferably, the control circuit detects the spot light position of each distance-measuring light-emitting device from the image captured by the image sensor, and obtains an inclination of the object from the detected positions.
- Further, according to the present invention, preferably, the distance-measuring light-emitting devices are mounted on a circuit board having the image sensor mounted thereon.
- Further, according to the present invention, preferably, an illumination mechanism for illuminating the object at the time of image capturing is disposed in the periphery of the image sensor, and the distance-measuring light-emitting devices are disposed on the outer sides of the illumination mechanism.
- Further, according to the present invention, preferably, the illumination mechanism includes: a plurality of light-emitting devices mounted in the peripheral positions of the image sensor; a ring-shaped light guide member for guiding the light of the plurality of light-emitting devices to an image capturing range, and illuminating the image capturing range; and further includes an optical unit accommodated inside the ring of the ring-shaped light guide member and for guiding the reflected light of the object in the illuminated image capturing range to the image sensor.
- Further, according to the present invention, preferably, the image capturing apparatus further includes a circuit board having the image sensor, the distance-measuring light-emitting devices, and the plurality of light-emitting devices being mounted thereon.
- Further, according to the present invention, preferably, the plurality of light-emitting devices are mounted on the circuit board at predetermined intervals along a circle in the periphery of the image sensor, and the light guide member has a ring-shaped structure corresponding to the circle.
- Further, according to the present invention, preferably, a diffusion plate for diffusing the light of the light-emitting devices is disposed between the ring-shaped light guide member and the plurality of light-emitting devices.
- Further, according to the present invention, preferably, the plurality of light-emitting devices are configured of light-emitting devices emitting infrared rays, and at least on the incident plane of the optical unit, an optical filter for filtering the visible light is disposed.
- Further, according to the present invention, preferably, the light guide member includes: a lower end portion for guiding the light of the light-emitting devices; an upper end portion for outputting the light in the image capturing range; and a light guide portion for guiding the light of the light-emitting devices from the lower end portion to the upper end portion.
- Further, according to the present invention, preferably, the image sensor images a portion of a living body.
- According to the present invention, the image capturing apparatus includes an image sensor for capturing an image of an object by receiving reflected light, distance-measuring light-emitting devices for irradiating the object with spot light, and, at the time of distance measurement, a control circuit for driving the distance-measuring light-emitting devices and detecting the spot light positions of the distance-measuring light-emitting devices from an image captured by the image sensor, thereby obtaining the distance to the object. Accordingly, the image sensor provided for capturing an image of the object can be used as a photodetector device for distance measurement. With this, it becomes unnecessary to separately provide a photodetector device for distance measurement, which enables miniaturization of the image capturing apparatus, as well as cost reduction.
- Further scopes and features of the present invention will become more apparent by the following description of the embodiments with the accompanied drawings.
-
FIG. 1 shows a cross-sectional view of an image capturing apparatus according to one embodiment of the present invention. -
FIG. 2 shows an exploded structural view of the image capturing apparatus shown inFIG. 1 . -
FIG. 3 shows a component layout diagram of the circuit board shown inFIG. 2 . -
FIG. 4 shows an explanation diagram of the relationship between a light-emitting device and a photodetector device shown inFIG. 2 . -
FIG. 5 shows an assembly diagram of the decomposed components shown inFIG. 2 . -
FIG. 6 shows a configuration diagram of the external finishing components shown inFIG. 1 . -
FIG. 7 shows a configuration diagram of the assembly of the assembled body shown inFIG. 2 . -
FIG. 8 shows an outer view of the image capturing apparatus shown inFIG. 1 . -
FIG. 9 shows an explanation diagram of the illumination system shown inFIG. 1 . -
FIG. 10 shows a configuration diagram of the light guide member and the light-emitting device shown inFIG. 9 . -
FIG. 11 shows a relation diagram of the emission intensity distribution of the light-emitting device, and the lower end portion of the light guide member shown inFIG. 10 . -
FIG. 12 shows a first operation explanation diagram of the light guide member shown inFIG. 10 . -
FIG. 13 shows a second operation explanation diagram of the light guide member shown inFIG. 10 . -
FIG. 14 shows a third operation explanation diagram of the light guide member shown inFIG. 10 . -
FIG. 15 shows a light intensity distribution diagram using the light guide member shown inFIG. 10 . -
FIG. 16 shows a block diagram of a control circuit for the image capturing apparatus shown inFIG. 1 . -
FIG. 17 shows an imaging process flowchart of the control circuit shown inFIG. 16 . -
FIG. 18 shows an explanation diagram of distance measurement operation using the configuration shown inFIG. 16 . -
FIG. 19 shows an explanation diagram of the conventional palm image capturing apparatus. -
FIG. 20 shows a principle explanation diagram of the conventional palm image capturing apparatus. -
FIG. 21 shows an explanation diagram of the conventional palm authentication technique. -
FIG. 22 shows another explanation diagram of the conventional palm authentication technique. -
FIG. 23 shows an explanation diagram of an illumination configuration in the conventional image capturing apparatus. -
FIG. 24 shows a configuration diagram of the conventional image capturing apparatus. - The preferred embodiment of the present invention is described hereinafter referring to the charts and drawings, in the order of an image capturing apparatus configuration, an illumination mechanism, an image processing configuration, and other embodiments. However, it is to be noted that the scope of the present invention is not limited to the embodiments described below.
-
FIG. 1 shows a cross-sectional view of an image capturing apparatus according to one embodiment of the present invention;FIG. 2 shows an exploded structural view of the image capturing apparatus shown inFIG. 1 ;FIG. 3 shows a top plan view of the circuit board shown inFIGS. 1 and 2 ;FIG. 4 shows an operation explanation diagram of a light-emitting device and a photodetector device shown inFIG. 3 ;FIG. 5 shows an assembly diagram when the structures shown inFIG. 2 are assembled;FIG. 6 shows a configuration diagram of the external case shown inFIG. 1 ;FIG. 7 shows a configuration diagram when the assembled body shown inFIG. 2 is housed in the external case; andFIG. 8 shows an outer view of the image capturing apparatus shown inFIG. 1 . - Prior to the description of the configuration shown in
FIG. 1 , referring toFIGS. 2 through 7 , the configuration of each portion illustrated inFIG. 1 is described. As shown inFIG. 2 , animage sensor 30 such as a CMOS image sensor and apolarizing plate 32 are disposed at the center of acamera substrate 20. In the periphery of theimage sensor 30 of thecamera substrate 20, a plurality of light-emittingdevices photodetector devices 26 are mounted. - Describing in more detail with reference to
FIG. 3 , theimage sensor 30 is mounted at the center of thecamera substrate 20, and thepolarizing plate 32 is pasted upon theimage sensor 30. Along the circle in the periphery of theimage sensor 30 of thecamera substrate 20, a plurality of light-emittingdevices photodetector devices 26 are mounted. - Between each the above first light-emitting
device 22 and each the second light-emittingdevice 24, the photo-detector device (photodiode) 26 is disposed. As shown inFIG. 4 , theabove photodetector device 26 is provided for receiving the light from both the first light-emittingdevice 22 and the light from the second light-emitting device 24 (reflected light from adiffusion plate 44 described later), thereby performing APC (automatic power control) of the first light-emittingdevice 22 and the second light-emittingdevice 24. - The above first light-emitting
device 22 and the second light-emittingdevice 24 are driven for emission at individual timing. In the above example, in order to independently perform automatic power control of each the first and second light-emittingdevice photodetector device 26 is disposed between the first light-emittingdevice 22 and the second light-emittingdevice 24 so as to receive the light from the first and second light-emittingdevices - Further, at the four corners of the
camera substrate 20, four distance-measuring light-emittingdevices 52 are provided for measuring the distance to the object. As shown inFIG. 3 , the above four distance-measuring light-emittingdevices 52 are disposed on the diagonal lines of thecamera substrate 20, at the farthest positions on the diagonal lines so that each distance therebetween becomes farthest. From the distances measured by the above four distance-measuring light-emittingdevices 52, the inclination of the object (here, palm) is detected. - In brief, on a
single camera substrate 20, there are providedillumination systems imaging systems system 52. - Now, referring back to
FIG. 2 , in the upper direction of the light-emittingdevices camera substrate 20, there are provided fourdiffusion plates 44 and fourpolarizing plates 42. Theabove diffusion plates 44 and thepolarizing plates 42 are pasted onto the polarization/diffusion plate holders 46 being attached on the four sides of thecamera substrate 20. Eachdiffusion plate 44 diffuses, to a certain extent, the emission distribution of the directive light emitted from the first and second light-emittingdevices polarizing plate 42 converts natural light emitted from the first and second light-emittingdevices - In the upper direction of the four
polarizing plates 42, a ring-shapedlight guide member 10 is provided. Thelight guide member 10 is formed of, for example, resin, and guides the light from the first and second light-emittingdevices camera substrate 20 in the upward direction, so as to irradiate the object with uniform light. To fit the dispositions of the light-emittingdevices camera substrate 20, thelight guide member 10 has a ring-shaped structure. As will be described inFIG. 9 and after, thelight guide member 10 guides the light emitted from the first and second light-emittingdevices - Further, an
optical unit 34 is attached to thecamera substrate 20 on theimage sensor 30 disposed in the approximate center of thecamera substrate 20, and inside the ring-shapedlight guide member 10. Theoptical unit 34 is constituted of a lens optical system such as a converging lens. - An
aperture 50 is mounted on the distance-measuring light-emittingdevice 52 of thecamera substrate 20. Theaperture 50 shuts off diffusion of light to other directions so as to guide the light emitted from the distance-measuring light-emittingdevices 52 to the object direction. - Separately from the
camera substrate 20, acontrol substrate 60 is provided. Thecontrol substrate 60 is provided for connecting with the outside, and includes anexternal connector 62 and acamera connector 64 for connecting with thecamera substrate 20. Theabove control substrate 60 is disposed on the lower portion of thecamera substrate 20, and electrically connected with thecamera substrate 20 using thecamera connector 64. Further, aholder cover 68 is provided for theexternal connector 62. - In such a way, the
image sensor 30, the light-emittingdevices detector devices 26 and the distance-measuring light-emittingdevices 52 are mounted on thecamera substrate 20. Also, the polarization/diffusion plate holders 46, thediffusion plates 44, thepolarizing plates 42, theapertures 50, theoptical unit 34, and thelight guide members 10 are mounted on theabove camera substrate 20, and thus a camera portion is assembled. To the above camera portion, thecontrol substrate 60 is attached.FIG. 5 shows a state of the unit after attaching the camera portion and thecontrol substrate 60. - Further, as shown in
FIG. 6 , there are prepared a visible-lightcutoff filter plate 76, ahood 78, aholder assembly 70 and anexternal case 74. By attaching attachment unit shown inFIG. 5 to theholder assembly 70 shown inFIG. 6 , and also, by attaching theholder cover 68 shown inFIG. 2 to theholder assembly 70, the configuration shown inFIG. 7 is assembled. - The configuration shown in
FIG. 7 is then housed into theexternal case 74 shown inFIG. 6 , and by attaching the visible-lightcutoff filter plate 76 having an attachedhood 78 on the upper portion ofexternal case 74, an image capturing apparatus shown inFIG. 8 is structured. The above the visible-lightcutoff filter plate 76 cuts off the visible light component so as not to enter theimage sensor 30 from outside. Further, as also described inFIG. 1 , thehood 78 shuts off the light so that the light outside the predetermined image capturing area does not enter theoptical unit 34, and prevents the light being leaked from thelight guide member 10 from invading into theoptical unit 34. -
FIG. 1 shows a cross-sectional view of the finished body 1 shown inFIG. 8 . As described earlier, theimage sensor 30, the light-emittingdevices detector devices 26 and the distance-measuring light-emittingdevice 52 are mounted on thecamera substrate 20. Namely, a basic structure including the illumination system and the image capturing system is mounted on the single substrate. Accordingly, only one mounting board is sufficient, thus contributing to cost reduction. - Also, with the provision of the ring-shaped
light guide member 10 on the upper portion of light-emittingdevices devices light filter 76. The abovelight guide member 10 separates the light from the light-emittingdevices light filter 76. Therefore, the light-emittingdevices image sensor 30, and also on theidentical substrate 20, which enables miniaturization, and illumination of the object by uniform light as well. More specifically, assuming that an oblique line portion of an upside-down triangle shape shown inFIG. 1 is the image capturing range of the camera, the image capturing range can be illuminated by uniform light. - Further, because the
light guide member 10 has a ring shape, it is possible to house theoptical unit 34 inside thering 10, thus enabling further miniaturization. In addition, thehood 78 prevents the light outside the predetermined image capturing range (oblique line portion inFIG. 1 ) from entering theoptical unit 34, and also prevents the light leaked from thelight guide member 10 from invading into theoptical unit 34. Accordingly, even when thelight guide member 10 and the light-emittingdevices image sensor 30 and theoptical unit 34, degradation in imaging accuracy can be avoided. - Moreover, since the distance-measuring light-emitting
devices 52 are provided on thecamera substrate 20, it becomes possible to further miniaturize the camera unit measuring the distance. Additionally, inFIG. 1 , thecontrol substrate 60 is connected to the lower portion of thecamera substrate 20, and anexternal cable 2 is connected to theexternal connector 62 of thecontrol substrate 60. - Next, an illumination mechanism including a light guide member will be described.
FIG. 9 shows an operation explanation diagram of the light guide member according to one embodiment of the present invention;FIG. 10 shows a detailed configuration diagram of the illumination mechanism shown inFIG. 9 ;FIG. 11 shows an explanation diagram of a trapezoidal notch of the light guide member shown inFIG. 10 ;FIGS. 12 through 14 show explanation diagrams of light guiding and diffusion operations of the light guide member shown inFIG. 10 ; andFIG. 15 shows a luminance (brightness) distribution diagram by the illumination. - In
FIG. 9 , like parts as shown inFIGS. 1 and 2 are designated by like reference numerals. As shown inFIG. 9 , thelight guide member 10 guides the light from each light-emittingdevice light filter 76 so as to split the light into three. - More specifically, from the
light guide member 10, basically, light A3 to the direction of theoptical unit 34, light A2 to the longitudinal direction of thelight guide member 10, and light Al to the opposite direction to theoptical unit 34 are output. With the provision of the abovelight guide member 10, each singlepoint light source light filter 76. - As shown in
FIG. 10 , thelight guide member 10 includes anupper slope face 14, two side faces 10-1, 10-2, and a lowertrapezoidal groove 12. The lowertrapezoidal portion 12 is positioned opposite to the light-emittingdevice polarizing plate 42 and thediffusion plate 44, and receives the light from the light-emittingdevice upper slope face 14 is a slope face of which height is greater on theoptical unit 34 side. - As shown in
FIG. 11 , an emission intensity distribution B from the light-emittingdevice device 22, 24 (vertical direction of the device) is stronger than the intensity of light components B2, B3 to the directions to both sides. As shown inFIG. 9 , thetrapezoidal groove 12 in thelight guide member 10 is formed correspondingly to the above intensity distribution B so that the light can basically be regarded as three point light sources on the output side. - More specifically, in order to function as three point light sources by the reflection inside the
light guide member 10, thetrapezoidal groove 12 is constituted of aflat portion 12 b for introducing the light component B1 without refracting, and a pair ofslope face portions trapezoidal groove 12 function to virtually split the light from each pointlight source - Also, as described later, the respective lengths of the above
flat portion 12 b andslope face portions light guide member 10 becomes substantially uniform. Here, the length of theflat portion 12 b, which receives the maximum intensity of the light component B1, is set shorter than each length of theslope face portions - The above operation is described referring to
FIGS. 12 through 14 . As shown inFIG. 12 , the component B2 on the left side of the emission intensity distribution B of each light-emittingdevice slope face portion 12 a of thelight guide member 10, and incident to the left side face 10-2 of thelight guide member 10. The incident light is then reflected on the left side face 10-2, and forwarded to the right side face 10-1 of thelight guide member 10. Subsequently, the light forwarded to the right side face 10-1 is reflected on the right side face 10-1, and forwarded again to the left side face 10-2. The light is then reflected on the left side face 10-2, and incident to the upper slope face 14 substantially perpendicularly, and output to the outermost portion of the image capturing range. - Also, as shown in
FIG. 13 , the central component B1 of the emission intensity distribution B of the light-emittingdevice light guide member 10 from the centralflat portion 12 b of thelight guide member 10. The light is then incident obliquely to theupper slope face 14, and output to the innermost portion of the image capturing range. - Further, as shown in
FIG. 14 , the component B3 on the right side of the emission intensity distribution B of the light-emittingdevice slope face portion 12c of thelight guide member 10, and incident to the right side face 10-1 of thelight guide member 10. The incident light is then reflected on the right side face 10-1, and forwarded to the left side face 10-2 of thelight guide member 10. Subsequently, the light forwarded to the left side face 10-2 is reflected on the left side face 10-2, and incident to the upper slope face 14 substantially perpendicularly, and output between the innermost portion and the outermost portion of the image capturing range. - By synthesizing
FIGS. 12 through 14 , an optical path diagram as shown inFIG. 10 is obtained. Namely, at thetrapezoidal groove 12, thelight guide member 10 splits the point emission of the pointlight source light guide member 10, each split light is output in such behavior as three point light sources existent on the output side of thelight guide member 10. - In this case, considering the image capturing range (shown by oblique lines) shown in
FIG. 1 , the output direction is adjusted at the upper slope face 14 of thelight guide member 10. Also, in order to obtain substantially uniform light intensity in the image capturing range, the lengths i.e. the incident widths of, or the incident amount to, theflat portion 12 b and theslope face portions trapezoidal groove 12 of thelight guide member 10 are adjusted, taking into consideration the emission intensity distribution B of light-emittingdevice FIG. 11 . - Here, to obtain the substantially uniform light intensity, because the emission intensity distribution B of the light-emitting
device FIG. 11 has stronger light intensity at the center, while weaker light intensity in the periphery, the length of theflat portion 12 b of thetrapezoidal groove 12 is set shorter than each length of theslope face portions flat portion 12 b, but also to theslope face portions - Also, using the
groove 12 having a trapezoidal shape and the upper slope face 14 of thelight guide member 10, and the reflection by thelight guide member 10, the reflected light and the rectilinear light can be output with diffusion so as to obtain substantially uniform light intensity throughout the image capturing range. -
FIG. 15 shows a diagram illustrating an experiment result in regard to the image capturing range and the light intensity of the image capturing apparatus shown inFIG. 1 . InFIG. 15 , the horizontal axis indicates the position, while the vertical axis indicates the light intensity. More specifically, the position is a dot position of theimage sensor 30, and here, theimage sensor 30 having 640 dots in width is employed. By placing plain white paper for experimental purpose on the flat portion of the upper part of the image capturing range (oblique line portion) shown inFIG. 1 , thereby producing uniform reflection, an output level value of each dot ofimage sensor 30 has been measured. Because of the white paper, the output level value corresponds to the light intensity. - According to the above example of the experiment result, substantially uniform light intensity has been obtained in the width of approximately 310 dots in the center of the
image sensor 30. For example, the maximum level in the 310 dot width is ‘190’, the minimum level is ‘160’, which range within ±15% of the medium value ‘175’, with the error of ±10% or less. - Referring to
FIG. 1 , for an image capturing range V of theimage sensor 30, the range of uniform light intensity is shown by V1. Although the image capturing range is V, by extracting particularly important features of an imaging object from an image in the range of the above V1, highly accurate feature extraction becomes obtainable. - In addition, an image obtained outside the range of V1 may also be used for feature extraction of a lower degree of importance, by matching the level through level correction.
-
FIG. 16 shows a block diagram of a captured image processing apparatus according to one embodiment of the present invention.FIG. 17 shows a flow chart of the captured image processing in the above image processing apparatus. Also,FIG. 18 shows an explanation diagram of distance measurement operation. - As shown in
FIG. 16 , a drive/process system in the image capturing apparatus includes a firstillumination LED driver 94 for driving the first light-emittingdevice 22, a secondillumination LED driver 96 for driving the second light-emittingdevice 24, a distance-measuringLED driver 98 for driving the distance-measuring light-emittingdevices 52, an analog/digital converter 92 for converting the analog output of each pixel from theimage sensor 30 to a digital value, and amicrocontroller 90. - As described in
FIG. 4 , the first and secondillumination LED drivers detector device 26. Microcontroller (MCU) 90 includes MPU (microprocessor), ROM (read-only memory) and RAM (random access memory), and executes processing includingdistance measurement 90A,posture discrimination 90B,shutter control 90C andimage processing 90D. - Referring to
FIG. 17 , imaging processing inMCU 90 is described below. - (S10)
MCU 90 drives the distance-measuring light-emitting devices (LED) 52 via the distance-measuringLED driver 98. By this, four distance-measuring light-emittingdevices 52 described inFIGS. 2 and 3 emit light. As shown inFIG. 1 , theimage sensor 30 photographs an image in the image capturing range. Here, since the illumination light-emittingdevices image sensor 30 receives only the reflected light from the object in the image capturing range corresponding to the light emitted from the distance-measuring light-emittingdevices 52. InFIG. 18 , there are shown the positions of the reflected light 52A, 52B, 52C and 52D in animage 30A of theimage sensor 30, being received from the object in the image capturing range corresponding to the light emitted from each distance-measuring light-emittingdevice 52. The above positions deviate depending on the inclination of the object (for example, palm). - (S12) Next, by means of analog/digital (A/D)
converter 92, each analog light reception amount inimage 30A of theimage sensor 30 is converted into a digital value, and then stored into the memory ofMCU 90.MCU 90 searches the image data in the memory, and detects the positions of the above reflected light 52A, 52B, 52C and 52D. - At this time, since the four distance-measuring light-emitting
devices 52 are disposed diagonally from the center of the image (image capturing range) as shown inFIGS. 3 and 18 , by searching on the straight lines, as shown by the dotted lines inFIG. 18 , the positions of the four points (i.e. the positions from the center of the image sensor) can be detected from the pixel luminance on the straight lines. For example, in the image capturing range of an upside-down triangle as shown inFIG. 1 , when the distance to the object is long, the spot light positions on the image become near the center as shown by 52A1 to 52D1 with the dotted line, while when the distance to the object is short, the spot light positions on the image become far from the center as shown by 52A to 52D with the solid line. - Further, because the light-emitting
devices 52 are disposed in the farthest positions on the diagonal lines with sufficient distances, it is possible to detect the positions farthest from the center in the image. From the above four positions,MCU 90 detects the distance (average) and the inclination of the object using the triangulation measuring method. Namely, by use of the positions from the center of theimage sensor 30, a distance at each of the four points is calculated, and the inclination (in four directions) can be detected from the distance difference of the four points. - (S14)
MCU 90 decides whether the distance to the imaging object is appropriate (whether the object is positioned in the image capturing range with a predetermined focal-distance). When the distance to the imaging object is not appropriate,MCU 90 displays a guidance message on a non-illustrated display portion. For example, a guidance message of “Put the object (palm) closer.” or “Put the object (palm) further.” is displayed. - (S16) When the distance is appropriate,
MCU 90 decides whether the inclination of the imaging object is appropriate. For example, when imaging a flat portion (palm, etc.) of the object, it is decided whether the inclination is within a tolerable range. When the inclination of the imaging object is not appropriate,MCU 90 displays a guidance message on the non-illustrated display portion. For example, in case that a palm is the object, a guidance message of “Open your hand.” or the like is displayed. - (S18) When the inclination is appropriate,
MCU 90 instructs theillumination LED drivers devices MCU 90 drives a non-illustrated electric shutter (provided in the optical unit), and photographs the image in the image capturing range byimage sensor 30.MCU 90 then stores the image into the memory via A/D converter 92. Then, the feature is extracted from the above image. For example, in case of extraction of the aforementioned blood vessel image, the blood vessel image is extracted from the image. - As such, the
image sensor 30 is also used for the distance-measuring photodetector portion to detect whether the imaging object lies at the focal distance, or the inclination thereof. Thus, in the distance measurement mechanism, it is sufficient to provide the distance-measuring light-emittingdevices 52 without particularly providing photodetector devices for distance measurement. This contributes a reduction of cost, and miniaturization as well, due to a reduced number of mounting components. - Also, because four distance-measuring light-emitting
devices 52 are disposed diagonally from the center of the image (imaging range), the positions of the four points can be detected by searching the image data stored in the memory as shown by the dotted lines inFIG. 18 , and thus, detection processing becomes easy. Further, because the distance-measuring light-emittingdevices 52 are disposed in the farthest positions on the diagonal lines with sufficient distances, it is possible to detect the farthest positions in the image from the center even the apparatus is miniaturized, and detection of the inclination can be performed accurately. - In the aforementioned embodiment, the description is made using a case of four distance-measuring light-emitting devices. However, to detect the inclination, it is sufficient if three devices are provided at the minimum. Similarly, when it is not necessary to detect inclination, only one distance-measuring light-emitting device may be provided.
- Also, in the aforementioned embodiment, the description is made using the
lower groove 12 of a trapezoidal shape. However, other polyhedron shapes are applicable. For example, in the above description, the groove has three planes because of the trapezoidal cross section, but a groove of a polyhedron shape such as having four planes may be used depending on required performance. When attaching importance to the cost, a polyhedron having a smaller number of faces is better, and therefore, a trapezoid is better here. - In the aforementioned embodiments, the imaging object is exemplified by the palm, and the image processing of the imaging object is exemplified by the vein pattern authentication. However, the present invention is also applicable to other biometric authentication by use of other features of human bodies, including hand skin pattern, blood vessel image of the back of hand, blood vessel image of a finger, and features of face and iris, etc. Also, the present invention is not limited to the application to the biometric authentication, but applicable to other applications.
- While the embodiments of the present invention have been illustrated in the foregoing description, any suitable modifications can be made without departing from the spirit of the invention. All such modifications are not to be excluded from the scope of the invention. The features and advantages of the invention which fall within the scope of the invention are covered by the appended claims.
Claims (14)
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
JP2006057494A JP4799216B2 (en) | 2006-03-03 | 2006-03-03 | Imaging device having distance measuring function |
JP2006-057494 | 2006-03-03 |
Publications (2)
Publication Number | Publication Date |
---|---|
US20070206099A1 true US20070206099A1 (en) | 2007-09-06 |
US7777808B2 US7777808B2 (en) | 2010-08-17 |
Family
ID=38110260
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US11/589,761 Active 2029-06-17 US7777808B2 (en) | 2006-03-03 | 2006-10-31 | Image capturing apparatus having distance measurement function |
Country Status (6)
Country | Link |
---|---|
US (1) | US7777808B2 (en) |
EP (1) | EP1830306B1 (en) |
JP (1) | JP4799216B2 (en) |
KR (1) | KR100919041B1 (en) |
CN (1) | CN100478981C (en) |
DE (1) | DE602006012799D1 (en) |
Cited By (26)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20110301500A1 (en) * | 2008-10-29 | 2011-12-08 | Tim Maguire | Automated vessel puncture device using three-dimensional(3d) near infrared (nir) imaging and a robotically driven needle |
US20160117561A1 (en) * | 2014-10-24 | 2016-04-28 | Magik Eye Inc. | Distance sensor |
US9610038B2 (en) * | 2005-07-13 | 2017-04-04 | Ermi, Inc. | Apparatus and method for evaluating joint performance |
US9807348B2 (en) | 2011-03-15 | 2017-10-31 | Fujitsu Frontech Limited | Imaging apparatus, imaging method, and imaging program |
WO2018106670A1 (en) * | 2016-12-07 | 2018-06-14 | Magik Eye Inc. | Distance sensor projecting parallel patterns |
CN108309237A (en) * | 2018-01-29 | 2018-07-24 | 杭州美界科技有限公司 | A kind of intelligence skin detection mirror |
US10228243B2 (en) | 2015-05-10 | 2019-03-12 | Magik Eye Inc. | Distance sensor with parallel projection beams |
US10373998B1 (en) * | 2013-03-14 | 2019-08-06 | Wavefront Research, Inc. | Compact annular field imager optical interconnect |
US10488192B2 (en) | 2015-05-10 | 2019-11-26 | Magik Eye Inc. | Distance sensor projecting parallel patterns |
US10521895B2 (en) | 2015-12-09 | 2019-12-31 | Utechzone Co., Ltd. | Dynamic automatic focus tracking system |
US10582106B2 (en) | 2016-07-27 | 2020-03-03 | Guangdong Sirui Optical Co., Ltd. | Intelligent ball head and method for performing self-photographing by using the same |
US10679076B2 (en) | 2017-10-22 | 2020-06-09 | Magik Eye Inc. | Adjusting the projection system of a distance sensor to optimize a beam layout |
US10885761B2 (en) | 2017-10-08 | 2021-01-05 | Magik Eye Inc. | Calibrating a sensor system including multiple movable sensors |
US10931883B2 (en) | 2018-03-20 | 2021-02-23 | Magik Eye Inc. | Adjusting camera exposure for three-dimensional depth sensing and two-dimensional imaging |
US11019249B2 (en) | 2019-05-12 | 2021-05-25 | Magik Eye Inc. | Mapping three-dimensional depth map data onto two-dimensional images |
US11062468B2 (en) | 2018-03-20 | 2021-07-13 | Magik Eye Inc. | Distance measurement using projection patterns of varying densities |
US11172838B2 (en) | 2014-02-24 | 2021-11-16 | Samsung Electronics Co., Ltd. | Sensing body information apparatus for volume and blood flow via light reflectance |
US11199397B2 (en) | 2017-10-08 | 2021-12-14 | Magik Eye Inc. | Distance measurement using a longitudinal grid pattern |
US11258937B2 (en) * | 2016-06-28 | 2022-02-22 | Amazon Technologies, Inc. | Local and remote video-camera control |
US11320537B2 (en) | 2019-12-01 | 2022-05-03 | Magik Eye Inc. | Enhancing triangulation-based three-dimensional distance measurements with time of flight information |
US11475584B2 (en) * | 2018-08-07 | 2022-10-18 | Magik Eye Inc. | Baffles for three-dimensional sensors having spherical fields of view |
US11474245B2 (en) | 2018-06-06 | 2022-10-18 | Magik Eye Inc. | Distance measurement using high density projection patterns |
US11474209B2 (en) | 2019-03-25 | 2022-10-18 | Magik Eye Inc. | Distance measurement using high density projection patterns |
US11483503B2 (en) | 2019-01-20 | 2022-10-25 | Magik Eye Inc. | Three-dimensional sensor including bandpass filter having multiple passbands |
US11580662B2 (en) | 2019-12-29 | 2023-02-14 | Magik Eye Inc. | Associating three-dimensional coordinates with two-dimensional feature points |
US11688088B2 (en) | 2020-01-05 | 2023-06-27 | Magik Eye Inc. | Transferring the coordinate system of a three-dimensional camera to the incident point of a two-dimensional camera |
Families Citing this family (23)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP5138268B2 (en) * | 2006-06-14 | 2013-02-06 | 株式会社タニタ | Dimensional measuring device |
JP5237394B2 (en) | 2009-01-30 | 2013-07-17 | 富士通フロンテック株式会社 | Authentication device, imaging device, authentication method, and authentication program |
US8760631B2 (en) * | 2010-01-27 | 2014-06-24 | Intersil Americas Inc. | Distance sensing by IQ domain differentiation of time of flight (TOF) measurements |
KR20130111633A (en) * | 2011-02-28 | 2013-10-10 | 후지츠 프론테크 가부시키가이샤 | Illumination optical system for imaging device |
US8866064B2 (en) * | 2011-07-26 | 2014-10-21 | Avago Technologies General Ip (Singapore) Pte. Ltd. | Multi-directional proximity sensor |
US10436902B2 (en) * | 2012-03-01 | 2019-10-08 | Nissan Motor Co., Ltd. | Range finding device and range finding method |
KR102023611B1 (en) * | 2012-05-04 | 2019-09-23 | 삼성전자 주식회사 | Terminal and method for iris scanning and proximity sensing |
KR102117261B1 (en) * | 2013-03-05 | 2020-06-01 | 삼성전자주식회사 | Range detection and bio-certification method, machine-readable storage medium and terminal |
EP2982301A4 (en) * | 2013-04-01 | 2016-11-23 | Fujitsu Frontech Ltd | Palm vein image capture device |
EP2814235A1 (en) * | 2013-06-14 | 2014-12-17 | Q Lifestyle Holding AB | Camera device with diffuser and related method |
JP5947777B2 (en) * | 2013-10-31 | 2016-07-06 | 京セラドキュメントソリューションズ株式会社 | Image reading apparatus, image forming apparatus, program, and image reading method |
US9773151B2 (en) | 2014-02-06 | 2017-09-26 | University Of Massachusetts | System and methods for contactless biometrics-based identification |
JP6346294B2 (en) * | 2014-09-18 | 2018-06-20 | 富士通フロンテック株式会社 | Ranging light generator |
WO2016076912A1 (en) * | 2014-11-13 | 2016-05-19 | Intel Corporation | Spoofing detection in image biometrics |
WO2017094078A1 (en) * | 2015-11-30 | 2017-06-08 | 富士通フロンテック株式会社 | Image pickup device and method for manufacturing image pickup device |
JP6743429B2 (en) | 2016-03-11 | 2020-08-19 | 富士通株式会社 | Biometric apparatus, biometric method, and biometric program |
CN106646819A (en) * | 2016-12-02 | 2017-05-10 | 深圳天珑无线科技有限公司 | Single-hole laser focusing realization device and method |
TWI622782B (en) * | 2016-12-16 | 2018-05-01 | Path detection system for generating laser pattern by diffractive optical element and method thereof | |
JP2019164734A (en) * | 2018-03-20 | 2019-09-26 | 富士通フロンテック株式会社 | Biometric authentication device |
CN109033981A (en) * | 2018-06-29 | 2018-12-18 | 张维先 | The method for reducing palm vein identification system power consumption based on ultrasonic distance measurement |
CN108509945A (en) * | 2018-06-29 | 2018-09-07 | 张维先 | The method for promoting palm vein identification system performance is identified by face character |
JP2020094923A (en) * | 2018-12-13 | 2020-06-18 | 株式会社島津製作所 | Fluorescence imaging device |
CN111784893A (en) * | 2019-04-03 | 2020-10-16 | 阿里巴巴集团控股有限公司 | Information identification method, system, device and storage medium |
Citations (20)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US4914460A (en) * | 1987-05-29 | 1990-04-03 | Harbor Branch Oceanographic Institution Inc. | Apparatus and methods of determining distance and orientation |
US5274429A (en) * | 1989-04-14 | 1993-12-28 | Asahi Kogaku Kogyo Kabushiki Kaisha | Distance measuring device |
US5378883A (en) * | 1991-07-19 | 1995-01-03 | Omniplanar Inc. | Omnidirectional wide range hand held bar code reader |
US5483601A (en) * | 1992-02-10 | 1996-01-09 | Keith Faulkner | Apparatus and method for biometric identification using silhouette and displacement images of a portion of a person's hand |
US5811828A (en) * | 1991-09-17 | 1998-09-22 | Norand Corporation | Portable reader system having an adjustable optical focusing means for reading optical information over a substantial range of distances |
US20020030748A1 (en) * | 2000-06-30 | 2002-03-14 | Ricoh Company, Limited | Image input apparatus and image input method |
US6404904B1 (en) * | 1998-04-24 | 2002-06-11 | Tst-Touchless Sensor Technology Ag | System for the touchless recognition of hand and finger lines |
US20020131622A1 (en) * | 2001-03-15 | 2002-09-19 | Lg Electronics Inc. | Apparatus and method for adjusting focus position in iris recognition system |
US6554452B1 (en) * | 1997-08-19 | 2003-04-29 | Ppt Vision, Inc. | Machine-vision ring-reflector illumination system and method |
US20040022421A1 (en) * | 2002-07-31 | 2004-02-05 | Fujitsu Limited | Processor with personal verification function and operating device |
US6688523B1 (en) * | 1988-08-31 | 2004-02-10 | Intermec Ip Corp. | System for reading optical indicia |
US6741279B1 (en) * | 1998-07-21 | 2004-05-25 | Hewlett-Packard Development Company, L.P. | System and method for capturing document orientation information with a digital camera |
US6774945B1 (en) * | 1999-10-18 | 2004-08-10 | Hewlett-Packard Development Company, L.P. | Focusing apparatus for image recording system |
US6782122B1 (en) * | 2000-04-27 | 2004-08-24 | Simmonds Precision Products, Inc. | Apparatus for measuring height of a liquid in a container using area image pattern recognition techniques |
US6850631B1 (en) * | 1998-02-20 | 2005-02-01 | Oki Electric Industry Co., Ltd. | Photographing device, iris input device and iris image input method |
US20060110145A1 (en) * | 2003-03-28 | 2006-05-25 | Fujitsu Limited | Image taking device, method for controlling light sources and computer program |
US7075661B2 (en) * | 2001-02-23 | 2006-07-11 | Industrial Control Systems Limited | Apparatus and method for obtaining three-dimensional positional data from a two-dimensional captured image |
US20060210256A1 (en) * | 2003-03-28 | 2006-09-21 | Satoshi Fukui | Photographing apparatus photographing method and computer program |
US7245745B2 (en) * | 2003-03-04 | 2007-07-17 | Hitachi, Ltd. | Personal authentication device |
US7266223B2 (en) * | 2000-09-06 | 2007-09-04 | Hitachi, Ltd. | Personal identification device and method |
Family Cites Families (10)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JPS60200111A (en) * | 1984-03-26 | 1985-10-09 | Hitachi Ltd | Apparatus for recognizing three-dimensional object |
JPS6215063A (en) * | 1985-07-10 | 1987-01-23 | Shin Meiwa Ind Co Ltd | Distance and attitude controller of ruled line followup device |
JPH0552531A (en) * | 1991-08-21 | 1993-03-02 | Olympus Optical Co Ltd | Endoscope apparatus for three-dimensional measurement |
JPH0560529A (en) * | 1991-09-05 | 1993-03-09 | Matsushita Electric Ind Co Ltd | Height measuring device |
JP2981942B2 (en) * | 1991-12-02 | 1999-11-22 | 株式会社新川 | Bonding wire inspection method |
US5726443A (en) * | 1996-01-18 | 1998-03-10 | Chapman Glenn H | Vision system and proximity detector |
CN1238840A (en) * | 1996-11-22 | 1999-12-15 | 莱卡显微镜系统股份公司 | Method for telemeasuring and telemeter |
JPH10246617A (en) * | 1997-03-03 | 1998-09-14 | Copal Co Ltd | Method and apparatus for judgment of flatness |
US20020097896A1 (en) * | 1998-03-17 | 2002-07-25 | Lars Kuckendahl | Device and method for scanning and mapping a surface |
JP3571211B2 (en) | 1998-04-23 | 2004-09-29 | 株式会社三協精機製作所 | Optical reader |
-
2006
- 2006-03-03 JP JP2006057494A patent/JP4799216B2/en active Active
- 2006-10-27 DE DE602006012799T patent/DE602006012799D1/en active Active
- 2006-10-27 EP EP06255557A patent/EP1830306B1/en active Active
- 2006-10-31 US US11/589,761 patent/US7777808B2/en active Active
- 2006-11-10 CN CNB2006101435218A patent/CN100478981C/en active Active
- 2006-11-16 KR KR1020060113080A patent/KR100919041B1/en active IP Right Grant
Patent Citations (22)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US4914460A (en) * | 1987-05-29 | 1990-04-03 | Harbor Branch Oceanographic Institution Inc. | Apparatus and methods of determining distance and orientation |
US6688523B1 (en) * | 1988-08-31 | 2004-02-10 | Intermec Ip Corp. | System for reading optical indicia |
US5274429A (en) * | 1989-04-14 | 1993-12-28 | Asahi Kogaku Kogyo Kabushiki Kaisha | Distance measuring device |
US5378883A (en) * | 1991-07-19 | 1995-01-03 | Omniplanar Inc. | Omnidirectional wide range hand held bar code reader |
US5811828A (en) * | 1991-09-17 | 1998-09-22 | Norand Corporation | Portable reader system having an adjustable optical focusing means for reading optical information over a substantial range of distances |
US5483601A (en) * | 1992-02-10 | 1996-01-09 | Keith Faulkner | Apparatus and method for biometric identification using silhouette and displacement images of a portion of a person's hand |
US6554452B1 (en) * | 1997-08-19 | 2003-04-29 | Ppt Vision, Inc. | Machine-vision ring-reflector illumination system and method |
US6850631B1 (en) * | 1998-02-20 | 2005-02-01 | Oki Electric Industry Co., Ltd. | Photographing device, iris input device and iris image input method |
US6404904B1 (en) * | 1998-04-24 | 2002-06-11 | Tst-Touchless Sensor Technology Ag | System for the touchless recognition of hand and finger lines |
US6741279B1 (en) * | 1998-07-21 | 2004-05-25 | Hewlett-Packard Development Company, L.P. | System and method for capturing document orientation information with a digital camera |
US6774945B1 (en) * | 1999-10-18 | 2004-08-10 | Hewlett-Packard Development Company, L.P. | Focusing apparatus for image recording system |
US6782122B1 (en) * | 2000-04-27 | 2004-08-24 | Simmonds Precision Products, Inc. | Apparatus for measuring height of a liquid in a container using area image pattern recognition techniques |
US20020030748A1 (en) * | 2000-06-30 | 2002-03-14 | Ricoh Company, Limited | Image input apparatus and image input method |
US7145596B2 (en) * | 2000-06-30 | 2006-12-05 | Ricoh Company, Ltd. | Method of and apparatus for composing a series of partial images into one image based upon a calculated amount of overlap |
US7266223B2 (en) * | 2000-09-06 | 2007-09-04 | Hitachi, Ltd. | Personal identification device and method |
US7075661B2 (en) * | 2001-02-23 | 2006-07-11 | Industrial Control Systems Limited | Apparatus and method for obtaining three-dimensional positional data from a two-dimensional captured image |
US20020131622A1 (en) * | 2001-03-15 | 2002-09-19 | Lg Electronics Inc. | Apparatus and method for adjusting focus position in iris recognition system |
US20040022421A1 (en) * | 2002-07-31 | 2004-02-05 | Fujitsu Limited | Processor with personal verification function and operating device |
US7245745B2 (en) * | 2003-03-04 | 2007-07-17 | Hitachi, Ltd. | Personal authentication device |
US20060110145A1 (en) * | 2003-03-28 | 2006-05-25 | Fujitsu Limited | Image taking device, method for controlling light sources and computer program |
US20060210256A1 (en) * | 2003-03-28 | 2006-09-21 | Satoshi Fukui | Photographing apparatus photographing method and computer program |
US7522824B2 (en) * | 2003-03-28 | 2009-04-21 | Fujitsu Limited | Photographing apparatus photographing method and computer program |
Cited By (38)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US9610038B2 (en) * | 2005-07-13 | 2017-04-04 | Ermi, Inc. | Apparatus and method for evaluating joint performance |
US10575773B2 (en) | 2005-07-13 | 2020-03-03 | RoboDiagnostics LLC | Apparatus and method for evaluating ligaments |
US9743875B2 (en) * | 2008-10-29 | 2017-08-29 | Vasculogic, Llc | Automated vessel puncture device using three-dimensional(3D) near infrared (NIR) imaging and a robotically driven needle |
US20150374273A1 (en) * | 2008-10-29 | 2015-12-31 | Vasculogic, Llc | Automated vessel puncture device using three-dimensional(3d) near infrared (nir) imaging and a robotically driven needle |
US20110301500A1 (en) * | 2008-10-29 | 2011-12-08 | Tim Maguire | Automated vessel puncture device using three-dimensional(3d) near infrared (nir) imaging and a robotically driven needle |
US9807348B2 (en) | 2011-03-15 | 2017-10-31 | Fujitsu Frontech Limited | Imaging apparatus, imaging method, and imaging program |
US11043526B1 (en) * | 2013-03-14 | 2021-06-22 | Wavefront Research, Inc. | Compact annular field imager optical interconnect |
US11652129B1 (en) * | 2013-03-14 | 2023-05-16 | Wavefront Research, Inc. | Compact annular field imager optical interconnect |
US10373998B1 (en) * | 2013-03-14 | 2019-08-06 | Wavefront Research, Inc. | Compact annular field imager optical interconnect |
US10665630B1 (en) | 2013-03-14 | 2020-05-26 | Wavefront Research, Inc. | Compact annular field imager optical interconnect |
US11172838B2 (en) | 2014-02-24 | 2021-11-16 | Samsung Electronics Co., Ltd. | Sensing body information apparatus for volume and blood flow via light reflectance |
US20160117561A1 (en) * | 2014-10-24 | 2016-04-28 | Magik Eye Inc. | Distance sensor |
US10268906B2 (en) * | 2014-10-24 | 2019-04-23 | Magik Eye Inc. | Distance sensor with directional projection beams |
TWI700508B (en) * | 2014-10-24 | 2020-08-01 | 美商麥吉克艾公司 | Apparatus, method, and computer-readable storage device for distance sensing |
WO2016065130A1 (en) * | 2014-10-24 | 2016-04-28 | Magik Eye Inc. | Distance sensor |
US10488192B2 (en) | 2015-05-10 | 2019-11-26 | Magik Eye Inc. | Distance sensor projecting parallel patterns |
US10228243B2 (en) | 2015-05-10 | 2019-03-12 | Magik Eye Inc. | Distance sensor with parallel projection beams |
US10521895B2 (en) | 2015-12-09 | 2019-12-31 | Utechzone Co., Ltd. | Dynamic automatic focus tracking system |
US11258937B2 (en) * | 2016-06-28 | 2022-02-22 | Amazon Technologies, Inc. | Local and remote video-camera control |
US10582106B2 (en) | 2016-07-27 | 2020-03-03 | Guangdong Sirui Optical Co., Ltd. | Intelligent ball head and method for performing self-photographing by using the same |
US10337860B2 (en) | 2016-12-07 | 2019-07-02 | Magik Eye Inc. | Distance sensor including adjustable focus imaging sensor |
WO2018106670A1 (en) * | 2016-12-07 | 2018-06-14 | Magik Eye Inc. | Distance sensor projecting parallel patterns |
US11002537B2 (en) | 2016-12-07 | 2021-05-11 | Magik Eye Inc. | Distance sensor including adjustable focus imaging sensor |
US11199397B2 (en) | 2017-10-08 | 2021-12-14 | Magik Eye Inc. | Distance measurement using a longitudinal grid pattern |
US10885761B2 (en) | 2017-10-08 | 2021-01-05 | Magik Eye Inc. | Calibrating a sensor system including multiple movable sensors |
US10679076B2 (en) | 2017-10-22 | 2020-06-09 | Magik Eye Inc. | Adjusting the projection system of a distance sensor to optimize a beam layout |
CN108309237A (en) * | 2018-01-29 | 2018-07-24 | 杭州美界科技有限公司 | A kind of intelligence skin detection mirror |
US11381753B2 (en) | 2018-03-20 | 2022-07-05 | Magik Eye Inc. | Adjusting camera exposure for three-dimensional depth sensing and two-dimensional imaging |
US10931883B2 (en) | 2018-03-20 | 2021-02-23 | Magik Eye Inc. | Adjusting camera exposure for three-dimensional depth sensing and two-dimensional imaging |
US11062468B2 (en) | 2018-03-20 | 2021-07-13 | Magik Eye Inc. | Distance measurement using projection patterns of varying densities |
US11474245B2 (en) | 2018-06-06 | 2022-10-18 | Magik Eye Inc. | Distance measurement using high density projection patterns |
US11475584B2 (en) * | 2018-08-07 | 2022-10-18 | Magik Eye Inc. | Baffles for three-dimensional sensors having spherical fields of view |
US11483503B2 (en) | 2019-01-20 | 2022-10-25 | Magik Eye Inc. | Three-dimensional sensor including bandpass filter having multiple passbands |
US11474209B2 (en) | 2019-03-25 | 2022-10-18 | Magik Eye Inc. | Distance measurement using high density projection patterns |
US11019249B2 (en) | 2019-05-12 | 2021-05-25 | Magik Eye Inc. | Mapping three-dimensional depth map data onto two-dimensional images |
US11320537B2 (en) | 2019-12-01 | 2022-05-03 | Magik Eye Inc. | Enhancing triangulation-based three-dimensional distance measurements with time of flight information |
US11580662B2 (en) | 2019-12-29 | 2023-02-14 | Magik Eye Inc. | Associating three-dimensional coordinates with two-dimensional feature points |
US11688088B2 (en) | 2020-01-05 | 2023-06-27 | Magik Eye Inc. | Transferring the coordinate system of a three-dimensional camera to the incident point of a two-dimensional camera |
Also Published As
Publication number | Publication date |
---|---|
KR20070090724A (en) | 2007-09-06 |
US7777808B2 (en) | 2010-08-17 |
JP2007233231A (en) | 2007-09-13 |
CN100478981C (en) | 2009-04-15 |
DE602006012799D1 (en) | 2010-04-22 |
EP1830306A3 (en) | 2007-09-12 |
EP1830306B1 (en) | 2010-03-10 |
CN101030252A (en) | 2007-09-05 |
EP1830306A2 (en) | 2007-09-05 |
KR100919041B1 (en) | 2009-09-24 |
JP4799216B2 (en) | 2011-10-26 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US7777808B2 (en) | Image capturing apparatus having distance measurement function | |
US7690827B2 (en) | Light guide member, illumination apparatus, and image capturing apparatus using the same | |
US7978259B2 (en) | Image capturing apparatus for guiding light emitted from a plurality of light emitting devices | |
US7679671B2 (en) | Image capturing for capturing an image of an object by illuminating the object and receiving light from the object | |
US7646423B2 (en) | Image capture apparatus with illuminator and distance measuring light emitting device | |
EP1830565B1 (en) | Image capturing apparatus | |
JP4708232B2 (en) | Imaging device |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
AS | Assignment |
Owner name: FUJITSU LIMITED, JAPAN Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNORS:MATSUO, KOICHI;NAKAMURA, AKIHIRO;IWAGUCHI, ISAO;AND OTHERS;REEL/FRAME:018485/0031 Effective date: 20060626 Owner name: FUJITSU FRONTECH LIMITED, JAPAN Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNORS:MATSUO, KOICHI;NAKAMURA, AKIHIRO;IWAGUCHI, ISAO;AND OTHERS;REEL/FRAME:018485/0031 Effective date: 20060626 |
|
AS | Assignment |
Owner name: FUJITSU LIMITED, JAPAN Free format text: RE-RECORD TO CORRECT THE FIFTH ASSIGNOR'S NAME ON A DOCUMENT PREVIOUSLY RECORDED AT REEL 018485, FRAME 0031. (ASSIGNMENT OF ASSIGNOR'S INTEREST);ASSIGNORS:MATSUO, KOICHI;NAKAMRUA, AKIHIRO;IWAGUCHI, ISAO;AND OTHERS;REEL/FRAME:019125/0514 Effective date: 20060626 Owner name: FUJITSU FRONTECH LIMITED, JAPAN Free format text: RE-RECORD TO CORRECT THE FIFTH ASSIGNOR'S NAME ON A DOCUMENT PREVIOUSLY RECORDED AT REEL 018485, FRAME 0031. (ASSIGNMENT OF ASSIGNOR'S INTEREST);ASSIGNORS:MATSUO, KOICHI;NAKAMRUA, AKIHIRO;IWAGUCHI, ISAO;AND OTHERS;REEL/FRAME:019125/0514 Effective date: 20060626 |
|
STCF | Information on status: patent grant |
Free format text: PATENTED CASE |
|
FEPP | Fee payment procedure |
Free format text: PAYOR NUMBER ASSIGNED (ORIGINAL EVENT CODE: ASPN); ENTITY STATUS OF PATENT OWNER: LARGE ENTITY |
|
FPAY | Fee payment |
Year of fee payment: 4 |
|
MAFP | Maintenance fee payment |
Free format text: PAYMENT OF MAINTENANCE FEE, 8TH YEAR, LARGE ENTITY (ORIGINAL EVENT CODE: M1552) Year of fee payment: 8 |
|
MAFP | Maintenance fee payment |
Free format text: PAYMENT OF MAINTENANCE FEE, 12TH YEAR, LARGE ENTITY (ORIGINAL EVENT CODE: M1553); ENTITY STATUS OF PATENT OWNER: LARGE ENTITY Year of fee payment: 12 |