EP1041396A2 - Ultrasonic diagnostic device - Google Patents

Ultrasonic diagnostic device Download PDF

Info

Publication number
EP1041396A2
EP1041396A2 EP00400874A EP00400874A EP1041396A2 EP 1041396 A2 EP1041396 A2 EP 1041396A2 EP 00400874 A EP00400874 A EP 00400874A EP 00400874 A EP00400874 A EP 00400874A EP 1041396 A2 EP1041396 A2 EP 1041396A2
Authority
EP
European Patent Office
Prior art keywords
data
unit
digital
reading
writing
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
EP00400874A
Other languages
German (de)
French (fr)
Other versions
EP1041396B1 (en
EP1041396A3 (en
Inventor
Mitsutoshi c/o Terumo K.K. Yaegashi
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Terumo Corp
Original Assignee
Terumo Corp
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Terumo Corp filed Critical Terumo Corp
Publication of EP1041396A2 publication Critical patent/EP1041396A2/en
Publication of EP1041396A3 publication Critical patent/EP1041396A3/en
Application granted granted Critical
Publication of EP1041396B1 publication Critical patent/EP1041396B1/en
Anticipated expiration legal-status Critical
Expired - Lifetime legal-status Critical Current

Links

Images

Classifications

    • GPHYSICS
    • G01MEASURING; TESTING
    • G01SRADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
    • G01S7/00Details of systems according to groups G01S13/00, G01S15/00, G01S17/00
    • G01S7/52Details of systems according to groups G01S13/00, G01S15/00, G01S17/00 of systems according to group G01S15/00
    • G01S7/52017Details of systems according to groups G01S13/00, G01S15/00, G01S17/00 of systems according to group G01S15/00 particularly adapted to short-range imaging
    • G01S7/52023Details of receivers
    • G01S7/52034Data rate converters
    • GPHYSICS
    • G01MEASURING; TESTING
    • G01SRADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
    • G01S7/00Details of systems according to groups G01S13/00, G01S15/00, G01S17/00
    • G01S7/52Details of systems according to groups G01S13/00, G01S15/00, G01S17/00 of systems according to group G01S15/00
    • G01S7/52017Details of systems according to groups G01S13/00, G01S15/00, G01S17/00 of systems according to group G01S15/00 particularly adapted to short-range imaging
    • G01S7/52053Display arrangements

Definitions

  • the present invention relates to an ultrasonic diagnostic device that enables to obtain diagnostically optimum images using stored data.
  • the ultrasonic diagnostic device has been used for diagnosis of diseased parts in body cavities.
  • the device transmits ultrasonic waves from its ultrasonic transducer attached to the distal end of a catheter inserted into a body cavity such as a vein or vessel, receives the echoes reflected from reflective members of the subject, and displays them as images on a display such as a CRT (cathode ray tube) after processing such as amplification and detection.
  • a display such as a CRT (cathode ray tube)
  • the operator of the device first inserts the ultrasonic catheter into the body cavity, and records the ultrasonic images on a video cassette as this ultrasonic catheter is being out or starting prior to that. After the operation, the recorded ultrasonic images will be reproduced to provide a detailed diagnosis for the subject.
  • the operator typically has contradicting desires, a desire to minimize the time of inserting the catheter, which is a foreign object, in the body cavity of the subject, and a desire to take as much time as possible for adjusting images to obtain optimum images during the operation.
  • the ultrasonic images are recorded on a video cassette recorder as video signals, it is impossible to add adjustments such as dynamic range adjustment, gamma correction, STC (sensitivity time control) and the like to the images after the operation, or to obtain images with altered circuit characteristics such as filter characteristics.
  • adjustments such as dynamic range adjustment, gamma correction, STC (sensitivity time control) and the like to the images after the operation, or to obtain images with altered circuit characteristics such as filter characteristics.
  • An object of this invention is to provide an ultrasonic diagnostic device that makes it possible to perform signal processing after the operation by means of storing the obtained signals as special digital data, thus to be able to obtain optimum images for diagnosis.
  • the present invention provides an ultrasonic diagnostic device comprising an ADC (analog-digital converter) for converting signals received, which are ultrasonic waves transmitted to a subject by exciting an ultrasonic transducer built into a catheter and then reflected back from the subject; a time axis extension unit that is capable of writing the data obtained from said ADC as well as reading said data at a frequency lower than the frequency used at the time of writing; a data compression unit for compressing the data read by said time extension unit; a memory unit for writing the data compressed by said data compression unit; a data expanding unit for reading and expanding the compressed data stored in said memory unit; and a DAC (digital-analog converter) for converting the data expanded by said data expanding unit; wherein the analog output from said DAC is filtered, logarithmically converted, detected, converted into a digital format again, and inputted into a digital scan converter so that optimum images for diagnosis can be obtained.
  • ADC analog-digital converter
  • a device can store image signals reflected from the subject as digital data so that optimum images for diagnosis can be obtained by processing the stored signals even after the operation.
  • This device can prevent noise interference and make the device configuration simpler so that the stored digital data can be used as they are without having to convert them from a digital format to an analog format and converting back from an analog format to a digital format.
  • This device allows the use of a mass storage removable medium and the storage of a large volume of image data in said mass storage removable medium.
  • this device can be widened by issuing output signals based on existing image standards.
  • An ultrasonic diagnostic device 10 is used for the diagnosis of intravascular and other organ ailments and no different from ultrasonic diagnostic devices of the prior art in that a transmission unit 20 drives an ultrasonic transducer 30, signals reflected by a subject are received and amplified by a preamplifier 40, the signals are then filtered, logarithmically converted, and detected before inputted into a DSC (digital scan converter) 210, and images thus generated are displayed on a CRT 220.
  • a transmission unit 20 drives an ultrasonic transducer 30
  • signals reflected by a subject are received and amplified by a preamplifier 40, the signals are then filtered, logarithmically converted, and detected before inputted into a DSC (digital scan converter) 210, and images thus generated are displayed on a CRT 220.
  • DSC digital scan converter
  • the first difference is that it has a unit that enters the output of the preamplifier 40 via buffer 50 into a high speed ADC 60 for processing.
  • the second difference is that it has two sets of filtering units 120, 130, logarithmic conversion units 140, 150, detection units 160, 170, and ADC 180, 190 so that it is capable of selecting either real time image display or stored image display reading the data stored in a mass memory unit 90 by means of switching the input into the DSC 210 with an MPX (multiplexer) 200.
  • MPX multiplexer
  • the device 10 of this first embodiment is capable of processing at the high speed ADC 60 and thereafter while displaying images in real time.
  • Image display at CRT 220 in real time is accomplished by means of filtering, logarithmic conversion, detection and conversion from an analog format to a digital format using the first filter unit 120, the first logarithmic conversion unit 140, the first detection unit 160, and the first ADC 180, via the MPX 200 and the DSC 210.
  • the image display of the stored data is accomplished at CRT220 by means of filtering, logarithmic conversion, detection and conversion from an analog format to a digital format using the second filter unit 130, the second logarithmic conversion unit 150, the second detection unit 170, and the second ADC 190, via the MPX 200 and the DSC 210.
  • a time axis extension unit 70 that is capable of writing as well as reading said data at a frequency lower than that the frequency used at the time of writing
  • a data compression unit 80 that compresses the data read by the time axis extension unit 70
  • a mass memory unit 90 that writes the data compressed by the data compression unit 80
  • a data expanding unit 100 that reads and expands the compressed data stored at the mass memory unit 90
  • a DAC 110 that converts the data expanded by the expanding unit 100.
  • the high speed ADC 60 is equipped with multiple analog-digital conversion ICs 62 and the time axis extension unit 70 is equipped with multiple FIFO memories 72, each of which corresponds to each of the analog-digital conversion ICs 62.
  • the ultrasonic frequency is 30 MHz
  • an appropriate display depth radius is 5mm considering the signal attenuation.
  • the speed of sound in a human body is 1530 m/s
  • the sampling frequency is eight times this, i.e., 240 MHz.
  • the dynamic range of the ultrasonic diagnostic device 10 is required to be about 60 dB, it is necessary to have a dynamic range of 60 dB or more in order to do an analog-digital conversion of the original signals, which are RF (radio frequency) signals.
  • the maximum sampling frequency for a 10 bit high speed IC 62 to be used for analog-digital conversion use is 100 MHz so that four of these IC 62 for the analog-digital conversion are used to achieve 240 MHz setting the frequency for each IC 62 for the analog-digital conversion as 60 MHz.
  • the sampling clock of each IC is a four phase clock.
  • the memory for writing the data resulting from the analog-digital conversion is a FIFO memory 72 intended for image use.
  • the FIFO memory 72 for the image use available on the market typically has a minimum clock cycle of 30 ns and a bit configuration of 256 k word x 8 bit (e.g., MN4777AS by Matsushita Electric Industrial Co. Ltd.).
  • the FIFO memory 72 Since the data consists of 10 bits per word, the FIFO memory 72 is used to divide them into two groups, one of 8 lower bits and one of 2 upper bits. Concerning the 60 MHz writing clock, the available speed is not fast enough, but it can be compensated by allocating two of them to each of said 8 lower bit and 2 upper bit ranges using divided 30 MHz two-phase clocks. In other words, four FIFO memories 72 are connected to each of the four analog-digital conversion IC 62.
  • the commonly used frame rate i.e., 33 ms (frame interval) is appropriate for the data collection interval for each screen. Therefore, it is possible to use a time axis extension of executing the high speed analog-digital conversion in 240 MHz and data reading in 33 MHz (30 ns cycle).
  • HD hard disk
  • a typical 3.5 inch HD available on the market has a rotating speed of 7200 rpm, line recording density of 120 k BPI, and a maximum data transfer speed of 120 M bit/s.
  • the maximum data transfer speed of an HD depends on the magnetic material of the recording head, and even the magnetic material currently used on the conventional HD can accommodate up to 200 M bit/s by means of increasing the rotating speed.
  • Typical image compression technologies include:
  • 100 M bit/s can be compressed 1/25 to 4 M bit/s.
  • 8.24 (M bit) x 30 (frames) 247 (M bit/s) so that it is a difference of about 2.5 times and it can be used in principle.
  • FIFO memory 72 stores data that is comparable to one screen, it is possible to compress information within a screen equivalent to the technology (b) mentioned above, and the technology (a) mentioned above can be accomplished by arranging multiple FIFO memories 72. Compression can be achieved by calculation using high speed CPU (central processing unit) and DSP (digital signal processor) or dedicated equipment.
  • CPU central processing unit
  • DSP digital signal processor
  • One of the HD products with large memory capacities that can be easily obtained on the market today has a capacity of 4.2 GB, while many systems used for image handling can be expanded up to 16 GB. Therefore, assuming the capacity of the HD is 16 GB, it is possible to write 15 minutes of data into a HD.
  • CD-R compact disk recorder
  • MO magnetic optical
  • DVD-RAM digital versatile disc-random access memory
  • the image is to be configured (reproduced) using the data stored in mass memory removable media, it is first written into HD (to be written after having been expanded if it has be recompressed as in the case of (ii) above), expanded and digital-analog converted.
  • the analog output obtained by shifting the frequency is inputted into DSC 210 to display images.
  • envelope detection envelope detection is assumed
  • the analog output obtained by shifting the frequency is inputted into DSC 210 to display images.
  • several filters with different characteristics can be used and selected as needed.
  • the embodiment described above is based on an assumption that the frequency is 30 MHz, but the configuration is the same as the one for the sampling frequency of 120 MHz that can be used for 15 MHz with a display depth of 10 mm.
  • the upper limit of the frequency being handled determines the clock frequency for high speed analog-digital conversion
  • the clock frequency determines the capacity of the time axis extension unit 70 (FIPO memory 72). If the frequency being handled is lower than the upper limit, the clock frequency can be reduced so that the record length can be handled within the capacity of the time axis extension unit 70.
  • a second embodiment shown in Fig. 2 conducts filtration, logarithmic conversion, and detection on expanded digital data, without going through the digital-analog conversion process, and inputs the digital data into the DSC 210 to display images.
  • the parts of the second embodiment which perform the same function as in the first embodiment are identified with the same codes, so that their descriptions do not have to be repeated here.
  • a device 230 of the second embodiment is different from the device 10 of the embodiment 1 in that it does not include the DAC 110 for applying the digital-analog conversion to the data expanded by the data expanding unit 100 and the second ADC 190 for applying the analog-digital conversion to the filtered, logarithmically converted, and detected.
  • the filter of this signal can be a conventional digital filter (can be realized using CPU, DSP, etc.) causing benefits such as the improvement of transient characteristics and the prevention of oscillation.
  • the logarithmic conversion can be realized with the use of CPU, DSP, etc., resulting in an improved linearity of the conversion.
  • the detection can also be realized with the use of CPU, DSP, etc., resulting in improved transient characteristics.
  • the analog signal obtained by applying the digital-analog conversion to the data read by the time axis extension unit 70 conforms to the NTSC (National Television System Standard Committee) standard or the PAL (Phase Alteration by Line System) standard.
  • the output has the square wave RF signal extended along the time axis with its level adjusted to match the brightness level of the image (within 1 Vpp in case of the NTSC standard) as shown in Fig. 3.
  • the sound ray is matched with the scanning line of the image.
  • the number of sound rays is 525, it is possible to make them correspond with the scanning lines one to one.
  • the commercial image compression boards e.g., MPEG board
  • MPEG board are applicable for the compression in terms of hardware and software.

Abstract

An ultrasonic diagnostic device comprising an ADC (60) that converts signals to digital format, a time axis extension unit (70) that is capable of writing and reading the digital data, a data compression unit (80) that compresses the read data, a memory unit (90) that stores the compressed data, a data expanding unit that expands the compressed data stored in the memory unit, and a DAC (110) that converts the expanded data from a digital format to an analog format, wherein optimum images can be displayed for diagnosis by means of filtering, logarithmically converting, and detecting before inputting the data into the digital scan converter (210).

Description

    BACKGROUND OF THE INVENTION Field of the invention
  • The present invention relates to an ultrasonic diagnostic device that enables to obtain diagnostically optimum images using stored data.
  • Description of the related art
  • The ultrasonic diagnostic device has been used for diagnosis of diseased parts in body cavities.
  • The device transmits ultrasonic waves from its ultrasonic transducer attached to the distal end of a catheter inserted into a body cavity such as a vein or vessel, receives the echoes reflected from reflective members of the subject, and displays them as images on a display such as a CRT (cathode ray tube) after processing such as amplification and detection.
  • The operator of the device first inserts the ultrasonic catheter into the body cavity, and records the ultrasonic images on a video cassette as this ultrasonic catheter is being out or starting prior to that. After the operation, the recorded ultrasonic images will be reproduced to provide a detailed diagnosis for the subject.
  • However, the operator typically has contradicting desires, a desire to minimize the time of inserting the catheter, which is a foreign object, in the body cavity of the subject, and a desire to take as much time as possible for adjusting images to obtain optimum images during the operation.
  • As both of these desires cannot be satisfied simultaneously, the operator ends up compromising on the image adjusting time in reality.
  • Further, since the ultrasonic images are recorded on a video cassette recorder as video signals, it is impossible to add adjustments such as dynamic range adjustment, gamma correction, STC (sensitivity time control) and the like to the images after the operation, or to obtain images with altered circuit characteristics such as filter characteristics.
  • Therefore, it is difficult to conduct diagnosis based on optimum images using a device of the prior art and the development of a ultrasonic diagnostic device that provides images more suitable for diagnosis is desired.
  • SUMMARY OF THE INVENTION
  • An object of this invention is to provide an ultrasonic diagnostic device that makes it possible to perform signal processing after the operation by means of storing the obtained signals as special digital data, thus to be able to obtain optimum images for diagnosis.
  • To achieve the above object, the present invention provides an ultrasonic diagnostic device comprising an ADC (analog-digital converter) for converting signals received, which are ultrasonic waves transmitted to a subject by exciting an ultrasonic transducer built into a catheter and then reflected back from the subject; a time axis extension unit that is capable of writing the data obtained from said ADC as well as reading said data at a frequency lower than the frequency used at the time of writing; a data compression unit for compressing the data read by said time extension unit; a memory unit for writing the data compressed by said data compression unit; a data expanding unit for reading and expanding the compressed data stored in said memory unit; and a DAC (digital-analog converter) for converting the data expanded by said data expanding unit; wherein the analog output from said DAC is filtered, logarithmically converted, detected, converted into a digital format again, and inputted into a digital scan converter so that optimum images for diagnosis can be obtained.
  • Consequently, a device according to this invention can store image signals reflected from the subject as digital data so that optimum images for diagnosis can be obtained by processing the stored signals even after the operation.
  • This device can prevent noise interference and make the device configuration simpler so that the stored digital data can be used as they are without having to convert them from a digital format to an analog format and converting back from an analog format to a digital format.
  • This device allows the use of a mass storage removable medium and the storage of a large volume of image data in said mass storage removable medium.
  • Furthermore, the applicability of this device can be widened by issuing output signals based on existing image standards.
  • BRIEF DESCRIPTION OF THE DRAWINGS
  • Fig. 1 is a schematic block diagram of an ultrasonic diagnostic device according to a first embodiment of the invention;
  • Fig. 2 is a schematic block diagram of an ultrasonic diagnostic device according to a second embodiment of the invention;
  • Fig. 3 is an explanatory drawing for signals outputted by an ultrasonic diagnostic device according to a third embodiment of the invention.
  • DETAILED DESCRIPTION OF THE INVENTION
  • Embodiments of ultrasonic diagnostic devices according to the present invention will be described below with reference to the attached drawings.
  • An ultrasonic diagnostic device 10 according to first embodiment of the present invention shown in Fig. 1, is used for the diagnosis of intravascular and other organ ailments and no different from ultrasonic diagnostic devices of the prior art in that a transmission unit 20 drives an ultrasonic transducer 30, signals reflected by a subject are received and amplified by a preamplifier 40, the signals are then filtered, logarithmically converted, and detected before inputted into a DSC (digital scan converter) 210, and images thus generated are displayed on a CRT 220.
  • Its differences from the ultrasonic diagnostic devices of the prior art are mainly the following two points.
  • The first difference is that it has a unit that enters the output of the preamplifier 40 via buffer 50 into a high speed ADC 60 for processing.
  • The second difference is that it has two sets of filtering units 120, 130, logarithmic conversion units 140, 150, detection units 160, 170, and ADC 180, 190 so that it is capable of selecting either real time image display or stored image display reading the data stored in a mass memory unit 90 by means of switching the input into the DSC 210 with an MPX (multiplexer) 200.
  • The device 10 of this first embodiment is capable of processing at the high speed ADC 60 and thereafter while displaying images in real time. Image display at CRT 220 in real time is accomplished by means of filtering, logarithmic conversion, detection and conversion from an analog format to a digital format using the first filter unit 120, the first logarithmic conversion unit 140, the first detection unit 160, and the first ADC 180, via the MPX 200 and the DSC 210.
  • On the other hand, the image display of the stored data is accomplished at CRT220 by means of filtering, logarithmic conversion, detection and conversion from an analog format to a digital format using the second filter unit 130, the second logarithmic conversion unit 150, the second detection unit 170, and the second ADC 190, via the MPX 200 and the DSC 210.
  • Following the high speed ADC 60 are a time axis extension unit 70 that is capable of writing as well as reading said data at a frequency lower than that the frequency used at the time of writing, a data compression unit 80 that compresses the data read by the time axis extension unit 70, a mass memory unit 90 that writes the data compressed by the data compression unit 80, a data expanding unit 100 that reads and expands the compressed data stored at the mass memory unit 90, and a DAC 110 that converts the data expanded by the expanding unit 100.
  • The high speed ADC 60 is equipped with multiple analog-digital conversion ICs 62 and the time axis extension unit 70 is equipped with multiple FIFO memories 72, each of which corresponds to each of the analog-digital conversion ICs 62.
  • Now, one example of the embodiment will describe how these parts operate using a case where the ultrasonic frequency is 30 MHz.
  • If the ultrasonic frequency is 30 MHz, an appropriate display depth radius is 5mm considering the signal attenuation. If the speed of sound in a human body is 1530 m/s, the recording length for one line of transmitting and receiving of the ultrasonic wave (hereinafter called sound ray) is: 5 (mm) x 2 / 1530 (m/s) = 6.54 (µs)
  • Since the signal frequency is 30 MHz, the sampling frequency is eight times this, i.e., 240 MHz. The data volume for one sound ray is: 6.54 (µs) x 240 (MHz) = 1570 (word)
  • Since the dynamic range of the ultrasonic diagnostic device 10 is required to be about 60 dB, it is necessary to have a dynamic range of 60 dB or more in order to do an analog-digital conversion of the original signals, which are RF (radio frequency) signals. Some of the ICs intended for analog-digital conversion currently available on the market are 10 bit products, whose dynamic range is; 20 log 210 = 60.2 dB    so that they satisfy the requirement.
  • The maximum sampling frequency for a 10 bit high speed IC 62 to be used for analog-digital conversion use (e.g., A-D9070 by Analog Devices, Inc.) is 100 MHz so that four of these IC 62 for the analog-digital conversion are used to achieve 240 MHz setting the frequency for each IC 62 for the analog-digital conversion as 60 MHz. The sampling clock of each IC is a four phase clock. The memory for writing the data resulting from the analog-digital conversion is a FIFO memory 72 intended for image use.
  • The FIFO memory 72 for the image use available on the market typically has a minimum clock cycle of 30 ns and a bit configuration of 256 k word x 8 bit (e.g., MN4777AS by Matsushita Electric Industrial Co. Ltd.).
  • Since the data consists of 10 bits per word, the FIFO memory 72 is used to divide them into two groups, one of 8 lower bits and one of 2 upper bits. Concerning the 60 MHz writing clock, the available speed is not fast enough, but it can be compensated by allocating two of them to each of said 8 lower bit and 2 upper bit ranges using divided 30 MHz two-phase clocks. In other words, four FIFO memories 72 are connected to each of the four analog-digital conversion IC 62.
  • Under such a configuration, the amount of data that can be written into the time axis extension unit 70 (consisting of 16 FIFO memories 72) is 256 (k word) x 2 x 4 = 2048 (k word).
  • Since the number of sound rays per screen is 500 or so, we assume that it is 525 lines for the sake of argument. That makes the amount of data per one sound ray 1570 (word), so that the amount of data per screen is: 1570 (word) x 525 = 824 (k word) [10 (bit) x 824 (k word) = 8.2424 (M bit)] so that two pages of images can be written on the aforementioned 2048 k word capacity.
  • Since writing and reading can be done independently on the FIFO memory 72 assumed on this embodiment, it is possible to read one screen of data of the previous screen whilst writing the data for the next screen (if a FIFO memory 72 used does not allow writing and reading independently, two systems can be used to overcome the shortcoming).
  • Since reading of this FIFO 72 memory can be done with a 30 ns clock, it takes 30 (ns) x 824 (k word) = 24.72 (ms)    to read one screen of data (with the configuration described above where the FIFO memory 72 has four independent clock systems, it is possible to read it in about 1/4 of the time, i.e., in 6 ms, if the reader side clock cycle is fast enough).
  • The commonly used frame rate, i.e., 33 ms (frame interval) is appropriate for the data collection interval for each screen. Therefore, it is possible to use a time axis extension of executing the high speed analog-digital conversion in 240 MHz and data reading in 33 MHz (30 ns cycle).
  • This data is compressed in real time and written into HD (hard disk), a mass memory device. A typical 3.5 inch HD available on the market has a rotating speed of 7200 rpm, line recording density of 120 k BPI, and a maximum data transfer speed of 120 M bit/s.
  • Therefore, the data that can be transferred during one frame interval is: 120 (M bit/s) x 33 (ms) = 120 (M bit)/30 = 4 (M bit).
  • As the required transfer data is 8.24 M bit as mentioned above, it is obvious that it has to be compressed into 1/2 or more.
  • The maximum data transfer speed of an HD depends on the magnetic material of the recording head, and even the magnetic material currently used on the conventional HD can accommodate up to 200 M bit/s by means of increasing the rotating speed.
  • Therefore, there is a high probability that there will be no more "requirement for compression to enable the transfer" in case of HDs to be developed in the near future (although there will always be a need for compression for the sake of minimizing the memory capacity requirement).
  • As for the principle of compression, technologies similar to those which have been used commonly for image compression can be applied here.
  • Typical image compression technologies include:
  • (a) information compression method using differences from a certain reference screen; and
  • (b) information compression method using DCT (discrete cosine transformation) utilizing correlation in space within a screen.
  • For example, in case of the MPEG (moving picture expert group) method, 100 M bit/s can be compressed 1/25 to 4 M bit/s. In case of the RF signal, 8.24 (M bit) x 30 (frames) = 247 (M bit/s) so that it is a difference of about 2.5 times and it can be used in principle.
  • Since FIFO memory 72 stores data that is comparable to one screen, it is possible to compress information within a screen equivalent to the technology (b) mentioned above, and the technology (a) mentioned above can be accomplished by arranging multiple FIFO memories 72. Compression can be achieved by calculation using high speed CPU (central processing unit) and DSP (digital signal processor) or dedicated equipment.
  • For example, if the data is compressed 1/3, the bit rate becomes: 247 (M bit/s)/3 = 82 (M bit/s)    so that the transfer speed of HD is sufficient.
  • A typical operation using an ultrasonic diagnostic device is about 15 minutes at most, and the data volume exchanged during that time can be calculated as: 82 (M bit/s) x 60 (s) x 15 (min) = 72.1 (G bit) = 9.01 (GB)
  • One of the HD products with large memory capacities that can be easily obtained on the market today has a capacity of 4.2 GB, while many systems used for image handling can be expanded up to 16 GB. Therefore, assuming the capacity of the HD is 16 GB, it is possible to write 15 minutes of data into a HD.
  • Moreover, when the HD's data transfer speed increases in the future and the volume increases, it is possible to make use of a method of keep writing as the information comes in without compressing it in real time and compressing only after the operation taking enough time to do so. Such a method is advantageous in terms of simplification of the device configuration and possibility of reversible compression as in the case of LHA by providing a broader choice of compression methods as it is not a real time processing.
  • As it provides information of about 9 GB for one operation, there is a need for writing the data into mass memory removable media such as a CD-R (compact disk recorder), MO (magneto optical), DVD-RAM (digital versatile disc-random access memory), etc.
  • The capacities of these mass memory removable media are typically:
    CD-R 640 MB
    MO 2.6 GB (max)
    DVD-RAM 5.2 GB (max)
  • This means that a single mass memory media disk does not provide a sufficient capacity. Therefore, it is necessary to take measures such as:
  • (i) simply use multiple disks, for example, two DVD-RAMs; or
  • (ii) it is necessary to compress data in real time when writing 9.01 GB of data in HD, but there is no need for compressing the data already written on HD in real time so that it can be done by recompressing the data taking enough time for the data to be stored in a media disk such as MO. The compression in case of (ii) can be done by CPU, DSP, etc.
  • On the other hand, if the image is to be configured (reproduced) using the data stored in mass memory removable media, it is first written into HD (to be written after having been expanded if it has be recompressed as in the case of (ii) above), expanded and digital-analog converted. The clock used during the digital-analog conversion does not have to be the clock used during the high speed analog-digital conversion. For example, in the example shown above, there are 525 sound rays for the frame cycle 33 ms, so that the time for each sound ray is: 1/30/525 = 63.5 (µs)    making it about 10 times longer than the recording length 6.54 µs during the data writing, so that the clock can be 10 times slower.
  • It will be described about here a case of making it eight times slower, i.e., reducing the speed from 240 MHz to 30 MHz. This makes the frequency of the original signal slow down 1/8 times from 30 MHz to 3.75 MHz. This is a frequency that can be more readily handled in an analog mode compared to the original frequency of 30 MHz.
  • After filtering, logarithmic conversion, and detection (hereinafter envelope detection is assumed), the analog output obtained by shifting the frequency is inputted into DSC 210 to display images. In order to obtain images with altered filtering characteristics, several filters with different characteristics can be used and selected as needed.
  • The embodiment described above is based on an assumption that the frequency is 30 MHz, but the configuration is the same as the one for the sampling frequency of 120 MHz that can be used for 15 MHz with a display depth of 10 mm. In other words, the upper limit of the frequency being handled determines the clock frequency for high speed analog-digital conversion, and the clock frequency determines the capacity of the time axis extension unit 70 (FIPO memory 72). If the frequency being handled is lower than the upper limit, the clock frequency can be reduced so that the record length can be handled within the capacity of the time axis extension unit 70.
  • Although we did not describe the control of the motor that rotates the catheter as well as the motor rotating angle and the data transmission/reception timing, it is obvious that the embodiment can be realized using the same design as the prior art.
  • A second embodiment shown in Fig. 2 conducts filtration, logarithmic conversion, and detection on expanded digital data, without going through the digital-analog conversion process, and inputs the digital data into the DSC 210 to display images. The parts of the second embodiment which perform the same function as in the first embodiment are identified with the same codes, so that their descriptions do not have to be repeated here.
  • In Fig. 2, a device 230 of the second embodiment is different from the device 10 of the embodiment 1 in that it does not include the DAC 110 for applying the digital-analog conversion to the data expanded by the data expanding unit 100 and the second ADC 190 for applying the analog-digital conversion to the filtered, logarithmically converted, and detected.
  • Since the frequency of the original signal is lowered from 300 MHz to 3.75 MHz in the second embodiment, the filter of this signal can be a conventional digital filter (can be realized using CPU, DSP, etc.) causing benefits such as the improvement of transient characteristics and the prevention of oscillation. Also, the logarithmic conversion can be realized with the use of CPU, DSP, etc., resulting in an improved linearity of the conversion. Moreover, the detection can also be realized with the use of CPU, DSP, etc., resulting in improved transient characteristics.
  • In the embodiment shown in Fig. 3, the analog signal obtained by applying the digital-analog conversion to the data read by the time axis extension unit 70 conforms to the NTSC (National Television System Standard Committee) standard or the PAL (Phase Alteration by Line System) standard. In other words, the output has the square wave RF signal extended along the time axis with its level adjusted to match the brightness level of the image (within 1 Vpp in case of the NTSC standard) as shown in Fig. 3. Also, the sound ray is matched with the scanning line of the image.
  • If the number of sound rays is 525, it is possible to make them correspond with the scanning lines one to one. In this case, there is an advantage that the commercial image compression boards (e.g., MPEG board) are applicable for the compression in terms of hardware and software.
  • However, in case the compression is applied within the image data of a single screen (spatial compression), the correlation will be smaller such that the 264th scanning line exists between the first and the second line if a simple correspondence in the order of the number is attempted in case of the NTSC standard as it uses the interlace scanning method. In order to achieve a more efficient compression, it is necessary to make a correspondence such as shown below, in which case, a buffer memory will be needed:
    Sound ray number Scanning line number
    1 1
    2 264
    3 2
    4 265
    : :
    : :
    523 262
    524 525
    525 263
  • The embodiments described above are given only as examples and they should not be construed to limit the scope of the invention in any way . The invention can be modified in various ways within the scope of the claims.

Claims (5)

  1. Ultrasonic diagnostic device comprising:
    an ADC that transmits ultrasonic waves to a subject by exciting an ultrasonic transducer built into a catheter and converts signals obtained as the waves are reflected by said subject to digital format;
    a time axis extension unit that is capable of writing the data received from said ADC and reading said data at a frequency lower than a frequency used during the time of reading;
    a data compression unit that compresses the data read by said time axis extension unit;
    a memory unit that stores the data compressed by said data compression unit; and
    a data expanding unit that expands the compressed data stored in said memory unit;
       wherein optimum images can be displayed most suitable for diagnosis by means of filtering and logarithmically converting the data expanded by said data expanding unit before inputting the data into a digital scan converter.
  2. The device according to the claim 1, wherein the device can be connected to a mass memory removable medium that is capable of writing and reading data between the device and said memory unit .
  3. Ultrasonic diagnostic device comprising:
    an ADC that transmits ultrasonic waves to a subject by exciting an ultrasonic transducer built into a catheter and converts signals obtained as the waves are reflected by said subject to digital format;
    a time axis extension unit that is capable of writing the data received from said ADC and reading said data at a frequency lower than a frequency used during the time of reading;
    a data compression unit that compresses the data read by said time axis extension unit;
    a memory unit that stores the data compressed by said data compression unit;
    a data expanding unit that expands the compressed data stored in said memory unit; and
    a DAC that converts the data expanded by said data expanding unit;
       wherein optimum images can be displayed for diagnosis by means of filtering, logarithmically converting, detecting and converting the output data of said DAC from an analog format to a digital format before inputting the data into a digital scan converter.
  4. The device according to the claim 3, wherein the device can be connected to a mass memory removable medium that is capable of writing and reading data between the device and said memory unit.
  5. The device according to the claim 3, wherein the analog signal outputted by said DAC corresponds with at least either the NTSC standard or the PAL standard.
EP00400874A 1999-03-30 2000-03-30 Ultrasonic diagnostic device Expired - Lifetime EP1041396B1 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
JP08900099A JP4210386B2 (en) 1999-03-30 1999-03-30 Intracavitary ultrasound system
JP8900099 1999-03-30

Publications (3)

Publication Number Publication Date
EP1041396A2 true EP1041396A2 (en) 2000-10-04
EP1041396A3 EP1041396A3 (en) 2003-06-04
EP1041396B1 EP1041396B1 (en) 2011-04-27

Family

ID=13958546

Family Applications (1)

Application Number Title Priority Date Filing Date
EP00400874A Expired - Lifetime EP1041396B1 (en) 1999-03-30 2000-03-30 Ultrasonic diagnostic device

Country Status (5)

Country Link
US (1) US6315722B1 (en)
EP (1) EP1041396B1 (en)
JP (1) JP4210386B2 (en)
AT (1) ATE507489T1 (en)
DE (1) DE60045883D1 (en)

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2004023152A1 (en) * 2002-09-05 2004-03-18 Honeywell International Inc. Synthetic rf detection system and method
WO2010137453A1 (en) * 2009-05-27 2010-12-02 Canon Kabushiki Kaisha Ultrasoungimaging measurement apparatus using adaptive data reduction
US10203243B1 (en) * 2012-10-25 2019-02-12 The Boeing Company Compression and feature extraction from full waveform ultrasound data

Families Citing this family (21)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6592523B2 (en) * 2001-11-21 2003-07-15 Ge Medical Systems Global Technology Company, Llc Computationally efficient noise reduction filter for enhancement of ultrasound images
JP2003265468A (en) * 2002-03-19 2003-09-24 Ge Medical Systems Global Technology Co Llc Diagnosis information generating device and ultrasonograph
JP4648652B2 (en) * 2004-06-24 2011-03-09 テルモ株式会社 Ultrasonic diagnostic apparatus and method for operating ultrasonic diagnostic apparatus
JP4795830B2 (en) * 2006-03-30 2011-10-19 テルモ株式会社 Diagnostic imaging apparatus and processing method thereof
US8386027B2 (en) 2007-04-27 2013-02-26 Echo Therapeutics, Inc. Skin permeation device for analyte sensing or transdermal drug delivery
US8781576B2 (en) 2009-03-17 2014-07-15 Cardiothrive, Inc. Device and method for reducing patient transthoracic impedance for the purpose of delivering a therapeutic current
CN102427851B (en) 2009-03-17 2015-04-15 卡迪欧思莱夫公司 External defibrillator
US8157738B2 (en) * 2009-06-02 2012-04-17 Samplify Systems, Inc. Ultrasound signal compression
US8317706B2 (en) * 2009-06-29 2012-11-27 White Eagle Sonic Technologies, Inc. Post-beamforming compression in ultrasound systems
JP5899172B2 (en) * 2013-01-10 2016-04-06 富士フイルム株式会社 Endoscope device
KR101489909B1 (en) * 2013-05-13 2015-02-06 알피니언메디칼시스템 주식회사 Transducer having front end processor, image diagnostic apparatus and method for processing signal thereof
US10149973B2 (en) 2013-06-14 2018-12-11 Cardiothrive, Inc. Multipart non-uniform patient contact interface and method of use
US9907970B2 (en) 2013-06-14 2018-03-06 Cardiothrive, Inc. Therapeutic system and method using biphasic or multiphasic pulse waveform
US9616243B2 (en) 2013-06-14 2017-04-11 Cardiothrive, Inc. Dynamically adjustable multiphasic defibrillator pulse system and method
US10279189B2 (en) 2013-06-14 2019-05-07 Cardiothrive, Inc. Wearable multiphasic cardioverter defibrillator system and method
US9656094B2 (en) 2013-06-14 2017-05-23 Cardiothrive, Inc. Biphasic or multiphasic pulse generator and method
US9833630B2 (en) 2013-06-14 2017-12-05 Cardiothrive, Inc. Biphasic or multiphasic pulse waveform and method
WO2018058358A1 (en) * 2016-09-28 2018-04-05 Covidien Lp System and method for parallelization of cpu and gpu processing for ultrasound imaging devices
US10828500B2 (en) 2017-12-22 2020-11-10 Cardiothrive, Inc. External defibrillator
TWI717112B (en) 2019-11-19 2021-01-21 科頡工業股份有限公司 Piston pump and clamping device with the piston pump
CN111031288B (en) * 2019-12-24 2021-10-08 中国兵器装备集团自动化研究所有限公司 Real-time video acquisition system and method based on wireless transmission

Family Cites Families (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US4412249A (en) * 1982-01-11 1983-10-25 Technicare Corporation Ultrasonic image storage device and method
US4974211A (en) * 1989-03-17 1990-11-27 Hewlett-Packard Company Digital ultrasound system with dynamic focus
JPH02291847A (en) * 1989-05-02 1990-12-03 Toshiba Corp Ultrasonic blood flow measuring apparatus
GB2233094B (en) * 1989-05-26 1994-02-09 Circulation Res Ltd Methods and apparatus for the examination and treatment of internal organs
US5291401A (en) * 1991-11-15 1994-03-01 Telescan, Limited Teleradiology system
JP2814900B2 (en) * 1993-12-07 1998-10-27 松下電器産業株式会社 Ultrasound diagnostic equipment
JP3410843B2 (en) * 1994-12-27 2003-05-26 株式会社東芝 Ultrasound diagnostic equipment
KR0180058B1 (en) 1995-09-13 1999-04-01 이민화 Ultrasonic diagnostic system storing compressed data to cine memory
JPH09238944A (en) * 1996-03-13 1997-09-16 Fujitsu Ltd Ultrasonic diagnostic apparatus

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
None

Cited By (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2004023152A1 (en) * 2002-09-05 2004-03-18 Honeywell International Inc. Synthetic rf detection system and method
US6844715B2 (en) 2002-09-05 2005-01-18 Honeywell International Inc. Synthetic RF detection system and method
WO2010137453A1 (en) * 2009-05-27 2010-12-02 Canon Kabushiki Kaisha Ultrasoungimaging measurement apparatus using adaptive data reduction
CN102449499A (en) * 2009-05-27 2012-05-09 佳能株式会社 Ultrasoungimaging measurement apparatus using adaptive data reduction
CN102449499B (en) * 2009-05-27 2015-04-08 佳能株式会社 Ultrasoungimaging measurement apparatus using adaptive data reduction
US10203243B1 (en) * 2012-10-25 2019-02-12 The Boeing Company Compression and feature extraction from full waveform ultrasound data

Also Published As

Publication number Publication date
US6315722B1 (en) 2001-11-13
EP1041396B1 (en) 2011-04-27
JP2000279413A (en) 2000-10-10
ATE507489T1 (en) 2011-05-15
JP4210386B2 (en) 2009-01-14
EP1041396A3 (en) 2003-06-04
DE60045883D1 (en) 2011-06-09

Similar Documents

Publication Publication Date Title
US6315722B1 (en) Ultrasonic diagnostic device
US6231510B1 (en) Ultrasonic diagnostic imaging system
US4755889A (en) Audio and video digital recording and playback system
US6231508B1 (en) Ultrasonic diagnostic imaging system with digital video image marking
US7472597B2 (en) Ultrasonic imaging device and the information processing method thereof
US6213944B1 (en) Ultrasonic diagnostic imaging system with a digital video recorder with visual controls
AU6400786A (en) Audio and video digital recording and playback system
US5090413A (en) Ultrasonic diagnostic apparatus
JPH11164831A (en) Ultrasonic diagnosis equipment
JPS60168440A (en) Ultrasonic diagnostic apparatus
EP0083985B1 (en) Improved ultrasonic image storage system
JP3158211B2 (en) Ultrasound diagnostic equipment
JPH0975340A (en) Ultrasonic diagnostic device
JP3268775B2 (en) Medical digital image storage and playback device
JPS6246176B2 (en)
JPH0630930A (en) Ultrasonic diagnosing apparatus
JP2005279287A (en) Ultrasonic diagnostic apparatus
JP2006346467A (en) Ultrasonic diagnostic system including high-capacity ultrasonic data storage device
JPS60116344A (en) Image formation in ultrasonic diagnostic apparatus
JPH0420338A (en) Ultrasonic diagnostic device
JP3388630B2 (en) Ultrasound diagnostic equipment
JPS60256442A (en) Change-over noise reducing circuit
JPS6080439A (en) Ultrasonic image recorder
JPS5869546A (en) Storing of ultrasonic echo
JPH0795981A (en) Ultrasonic diagnostic apparatus

Legal Events

Date Code Title Description
PUAI Public reference made under article 153(3) epc to a published international application that has entered the european phase

Free format text: ORIGINAL CODE: 0009012

AK Designated contracting states

Kind code of ref document: A2

Designated state(s): AT BE CH CY DE DK ES FI FR GB GR IE IT LI LU MC NL PT SE

AX Request for extension of the european patent

Free format text: AL;LT;LV;MK;RO;SI

PUAL Search report despatched

Free format text: ORIGINAL CODE: 0009013

AK Designated contracting states

Designated state(s): AT BE CH CY DE DK ES FI FR GB GR IE IT LI LU MC NL PT SE

AX Request for extension of the european patent

Extension state: AL LT LV MK RO SI

17P Request for examination filed

Effective date: 20031015

17Q First examination report despatched

Effective date: 20031105

AKX Designation fees paid

Designated state(s): AT BE CH CY DE DK ES FI FR GB GR IE IT LI LU MC NL PT SE

GRAP Despatch of communication of intention to grant a patent

Free format text: ORIGINAL CODE: EPIDOSNIGR1

GRAS Grant fee paid

Free format text: ORIGINAL CODE: EPIDOSNIGR3

GRAA (expected) grant

Free format text: ORIGINAL CODE: 0009210

AK Designated contracting states

Kind code of ref document: B1

Designated state(s): AT BE CH CY DE DK ES FI FR GB GR IE IT LI LU MC NL PT SE

REG Reference to a national code

Ref country code: GB

Ref legal event code: FG4D

REG Reference to a national code

Ref country code: CH

Ref legal event code: EP

REG Reference to a national code

Ref country code: IE

Ref legal event code: FG4D

REF Corresponds to:

Ref document number: 60045883

Country of ref document: DE

Date of ref document: 20110609

Kind code of ref document: P

REG Reference to a national code

Ref country code: DE

Ref legal event code: R096

Ref document number: 60045883

Country of ref document: DE

Effective date: 20110609

REG Reference to a national code

Ref country code: NL

Ref legal event code: VDEP

Effective date: 20110427

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: PT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20110829

Ref country code: SE

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20110427

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: GR

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20110728

Ref country code: BE

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20110427

Ref country code: ES

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20110807

Ref country code: AT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20110427

Ref country code: FI

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20110427

Ref country code: CY

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20110427

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: NL

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20110427

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: DK

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20110427

PLBE No opposition filed within time limit

Free format text: ORIGINAL CODE: 0009261

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: NO OPPOSITION FILED WITHIN TIME LIMIT

26N No opposition filed

Effective date: 20120130

REG Reference to a national code

Ref country code: DE

Ref legal event code: R097

Ref document number: 60045883

Country of ref document: DE

Effective date: 20120130

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: IT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20110427

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: MC

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20120331

REG Reference to a national code

Ref country code: CH

Ref legal event code: PL

REG Reference to a national code

Ref country code: IE

Ref legal event code: MM4A

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: LI

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20120331

Ref country code: CH

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20120331

Ref country code: IE

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20120330

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: LU

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20120330

REG Reference to a national code

Ref country code: FR

Ref legal event code: PLFP

Year of fee payment: 17

REG Reference to a national code

Ref country code: FR

Ref legal event code: PLFP

Year of fee payment: 18

REG Reference to a national code

Ref country code: FR

Ref legal event code: PLFP

Year of fee payment: 19

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: DE

Payment date: 20190319

Year of fee payment: 20

Ref country code: GB

Payment date: 20190327

Year of fee payment: 20

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: FR

Payment date: 20190213

Year of fee payment: 20

REG Reference to a national code

Ref country code: DE

Ref legal event code: R071

Ref document number: 60045883

Country of ref document: DE

REG Reference to a national code

Ref country code: GB

Ref legal event code: PE20

Expiry date: 20200329

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: GB

Free format text: LAPSE BECAUSE OF EXPIRATION OF PROTECTION

Effective date: 20200329