US20050013374A1 - Video decoder with down conversion function and method for decoding video signal - Google Patents

Video decoder with down conversion function and method for decoding video signal Download PDF

Info

Publication number
US20050013374A1
US20050013374A1 US10/916,404 US91640404A US2005013374A1 US 20050013374 A1 US20050013374 A1 US 20050013374A1 US 91640404 A US91640404 A US 91640404A US 2005013374 A1 US2005013374 A1 US 2005013374A1
Authority
US
United States
Prior art keywords
data
sampling
signal
field
motion
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Abandoned
Application number
US10/916,404
Inventor
Eung Kim
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
LG Electronics Inc
Original Assignee
LG Electronics Inc
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by LG Electronics Inc filed Critical LG Electronics Inc
Priority to US10/916,404 priority Critical patent/US20050013374A1/en
Publication of US20050013374A1 publication Critical patent/US20050013374A1/en
Abandoned legal-status Critical Current

Links

Images

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/50Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding
    • H04N19/503Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding involving temporal prediction
    • H04N19/51Motion estimation or motion compensation
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/50Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding
    • H04N19/59Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding involving spatial sub-sampling or interpolation, e.g. alteration of picture size or resolution
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/102Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or selection affected or controlled by the adaptive coding
    • H04N19/103Selection of coding mode or of prediction mode
    • H04N19/105Selection of the reference unit for prediction within a chosen coding or prediction mode, e.g. adaptive choice of position and number of pixels used for prediction
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/102Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or selection affected or controlled by the adaptive coding
    • H04N19/103Selection of coding mode or of prediction mode
    • H04N19/112Selection of coding mode or of prediction mode according to a given display mode, e.g. for interlaced or progressive display mode
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/134Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or criterion affecting or controlling the adaptive coding
    • H04N19/136Incoming video signal characteristics or properties
    • H04N19/137Motion inside a coding unit, e.g. average field, frame or block difference
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/42Methods or arrangements for coding, decoding, compressing or decompressing digital video signals characterised by implementation details or hardware specially adapted for video compression or decompression, e.g. dedicated software implementation
    • H04N19/423Methods or arrangements for coding, decoding, compressing or decompressing digital video signals characterised by implementation details or hardware specially adapted for video compression or decompression, e.g. dedicated software implementation characterised by memory arrangements
    • H04N19/426Methods or arrangements for coding, decoding, compressing or decompressing digital video signals characterised by implementation details or hardware specially adapted for video compression or decompression, e.g. dedicated software implementation characterised by memory arrangements using memory downsizing methods
    • H04N19/428Recompression, e.g. by spatial or temporal decimation
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/44Decoders specially adapted therefor, e.g. video decoders which are asymmetric with respect to the encoder
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/46Embedding additional information in the video signal during the compression process
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/50Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding
    • H04N19/503Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding involving temporal prediction
    • H04N19/51Motion estimation or motion compensation
    • H04N19/523Motion estimation or motion compensation with sub-pixel accuracy
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/60Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using transform coding
    • H04N19/61Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using transform coding in combination with predictive coding

Definitions

  • the present invention relates to a video decoder with a down conversion function, and a method for decoding a video signal.
  • an MPEG-2 video decoding chip is provided with a TP (Transport Packet)-decoder, a video decoder, a video display processor, an external memory, and a host interface, and the like.
  • the external memory may be a DRAM (Dynamic Random Access Memory) for receiving, and storing a bitstream, and frame buffers for motion compensation, and the like.
  • MPEG-2 standard requires a bit buffer size of 10 Mbits for supporting an MP@HL mode, at a maximum allowable bit rate of 80 Mbits/s.
  • An existing 16 Mbits DRAM basis MPEG-2 decoder requires an external memory of approx. 96 ⁇ 128 Mbits size. Therefore, a price competitiveness is required in view of manufacturers and consumers.
  • the video decoding chip is required to be provided with an effective device for reducing a memory capacity that can minimize a loss of a high quality picture signal loss.
  • ADPCM Adaptive Differential Pulse Coded Modulation
  • VQ Vector Quantization
  • the ADPCM is suggested by Pau and Sano in EP 0778709A1 titled “MPEG-2 decoding with a reduced RAM requisite by ADPCM recompression before storing MPEG decompressed data”.
  • the VQ is suggested by Bruni et al. in IEEE Trans., On Customer Electronics, pp. 537-544, 1988, titled “A novel adaptive vector quantization method for memory reduction in MPEG-2 HDTV decoders”.
  • the ADPCM method is difficult to display a video by using a video display right away, to require a device for decoding the compressed code, additionally. Since the ADPCM method shows very great picture quality loss in a case of 75% reduction, the ADPCM method is not suitable for the video decoding chip.
  • a plurality of HDTV class videos or SD class videos received at one chip video decoder can be displayed on one screen simultaneously by using a down conversion algorithm.
  • This method can maintain a good picture quality to some extent despite of substantial reduction of the memory capacity, and applicable to inexpensive decoders for low resolution displays. Therefore, a down conversion algorithm that allows to employ a small capacity memory while a good picture quality can be maintained, and a hardware design for the down conversion algorithm, are required.
  • a general MPEG encoder encodes either a progressive sequence or an interlaced sequence.
  • An interlaced sequence picture is encoded in field or frame units.
  • the field picture has odd scanning lines and even scanning lines, and all encoder and decoder are operative in field. Therefore, data blocks each DCT Transformed in a 8 ⁇ 8 unit only has odd fields or even fields, which are called as field DCT coded blocks.
  • macro blocks of the frame picture can be coded in two methods.
  • each of the four 8 ⁇ 8 discrete cosine transformed blocks is a DCT coded block in frame units each having odd scanning lines and even scanning lines.
  • two macro blocks from the four macro blocks are blocks DCT coded in field units only having odd scanning lines of the macro blocks, and the rest of two macro blocks are blocks DCT coded in field units only having even scanning lines.
  • All the macro block in the field picture are DCT coded in field units, and motion compensation of which are predicted from a reference field in making motion compensation.
  • macro blocks in the frame picture are DCT coded in frame units or in field units.
  • Each of the macro blocks in the frame picture is motion compensation predicted in frame units or field units.
  • all pictures are DCT coded, and motion compensation predicted in frame units.
  • NTSC National Television System Committee
  • U.S. Pat. No. 5,262,854 includes a down sampler for removing 48 high frequency DCT coefficients in an 8 ⁇ 8 block. According to this patent, a result of IDCT for the rest low frequency 4 ⁇ 4 blocks is stored in a memory. Therefore, for making an accurate motion compensation, when it is intended to reduce an error of motion compensation prediction by using perfect resolution motion vectors, a frame of reduced resolution is used as reference. At the end, in order to provide a picture of a perfect resolution from a picture of a reduced resolution, an up-sampling is employed.
  • These methods employ two dimensional filters each having 5 taps or 8 taps depending on a typically predicted motion vector of a macro block, when positions of 8 tap filter values are changed depending on the motion vector, to require to increase 4 pels into 8 pels by one 8 tap filter.
  • the foregoing methods are suitable to a progressive sequence having DCT coded blocks in frame units, matters on a video of blocks DCT coded in frame units and DCT coded in field units mixed therein are not taken into account.
  • the foregoing methods have a frame type memory structure, a down converting of blocks DCT coded in field units is carried out after the blocks DCT coded in field units is converted into blocks DCT coded in frame units, that results in unfavorable influence of prediction error accumulation in making motion compensation in an area having a great motion.
  • the only employment of low frequency parts (in general, called as 4 ⁇ 4 cuts) among 8 ⁇ 8 DCT coefficients in the motion compensation causes to lost signals of high frequency band, that causes to occur block artifacts.
  • an interlaced sequence processed at an MPEG-2 video decoder has a problem of data loss occurred in the down conversion.
  • the present invention is directed to a video decoder with a down conversion function, and a method for decoding a video signal that substantially obviates one or more of the problems due to limitations and disadvantages of the related art.
  • An object of the present invention is to provide a video decoder with a down conversion function, and a method for decoding a video signal which permits an SD class display of a small memory capacity to display an HD class signal.
  • Another object of the present invention is to provide a video decoder with a down conversion function, and a method for decoding a video signal which permits to reduce different video signals in 1 ⁇ 2, or 3 ⁇ 4 reduction ratio, and store in an external memory at a time, or display on one screen at a time, regardless of a progressive scanning type picture or interlaced scanning type picture.
  • frame DCT coded blocks and field DCT coded block received at the video decoder are always down converted into a picture of a field basis vertical pel structure.
  • a macro block adder module adds a motion compensated macro block from a motion compensation buffer and an IDCT macro block from a DCT buffer according to a picture structure and a DCT type.
  • a device is included for arranging positions of pels of a block predicted as a field structure to suit to an IDCT type.
  • a down sampler module has modes for horizontal 1 ⁇ 2 reduction in 8 ⁇ 8 block units, and for vertical and horizontal 3 ⁇ 4 reductions.
  • a down sampler module divides a frame DCT coded block into field signals and extracts frequency components in a 8 ⁇ 8 block in a 3 ⁇ 4 reduction mode.
  • different down sampling filters are used in a vertical down sampling depending on a color component, because a number of fields for chrominance components are smaller than a number of fields for luminance components.
  • a field fit to a motion vector is selected, and reads a reduced field reference signal on a memory. Then, horizontal and vertical direction up sampling are carried out for each fields.
  • a reference address is provided to a memory by using a motion vector to read a reference block. Then, horizontal and vertical up sampling is carried out for each filed, a 1 ⁇ 2 pel prediction is made for the up sampled blocks, to provide motion compensated blocks. Finally, the motion compensated blocks are forwarded to a macro block adder in field units.
  • a reference address is provided to a memory by using a motion vector, to read field unit reference blocks. Then, horizontal and vertical up sampling is carried out for each field, and a frame unit reference block is formed of up sampled blocks of each field. Then, a motion compensated block is formed by making 1 ⁇ 2 pel prediction. Finally, motion compensated frame unit blocks are forwarded to a macro block adder according to IDCT macro block type.
  • an up sampler module has a 1 ⁇ 2 reduction mode in which a horizontal up sampling in 8 ⁇ 4 block units is made, and a 3 ⁇ 4 reduction mode in which vertical and horizontal up sampling in 4 ⁇ 4 block units are made.
  • a motion compensator uses 2 ⁇ C 4 ⁇ 8 T , and 2 ⁇ C 2 ⁇ 4 T filters in up sampling in filtering.
  • FIG. 1 illustrates a block diagram showing a system of a scaleable MPEG-2 video decoder having a down conversion function in accordance with a preferred embodiment of the present invention
  • FIG. 2 illustrates a block diagram showing a system of a video decoder having a down conversion algorithm for memory reduction in accordance with a preferred embodiment of the present invention
  • FIG. 3 illustrates a diagram showing a pel architecture after data in DCT domain is down sampled
  • FIG. 4 illustrates a diagram showing a form of data from the IDCT and stored in the DCT buffer
  • FIG. 5 illustrates a diagram showing a case when an MC buffer converts and stores a field unit picture into a frame unit picture
  • FIG. 6 illustrates a diagram showing a case when an MC buffer stores a field unit picture as it is
  • FIG. 7 illustrates a diagram for explaining operation of a macro block adder
  • FIG. 8 illustrates a block diagram showing a detailed system of the down sampler in FIG. 2 ;
  • FIG. 9 illustrates a block diagram for explaining operation of the down sampler in FIG.
  • FIG. 10 illustrates detailed systems of the up sampler and the motion compensator in FIG. 2 ;
  • FIG. 11 illustrates a detailed system of the up sampler 9 in FIG. 2 ;
  • FIG. 12 illustrates a block diagram showing a process for up sampling field data stored in a field basis external memory by means of frame prediction.
  • FIG. 13 illustrates a diagram for explaining a method for making motion compensation having 1 ⁇ 2 pel interpolation of the present invention.
  • the video decoder with a down conversion function of present invention relates to a technology required for displaying interlaced scanning, coded, different video signals of HD class on the same screen on the same time, or displaying an HD class signal on a low resolution class display.
  • the video decoder of the present invention can reduce a capacity of an external memory by 50% or 75% compared to an existing HD class video decoder as required, and is applicable to an MPEG-2 (Moving Picture Expert Group-2) decoding chip, a standard in a digital video signal transmission field.
  • FIG. 1 illustrates a block diagram showing a system of a scaleable MPEG-2 video decoder having a down conversion function in accordance with a preferred embodiment of the present invention.
  • the down conversion function of the system in FIG. 1 is for 50% or 75% memory reduction.
  • the scaleable MPEG-2 video decoder having a down conversion function in accordance with a preferred embodiment of the present invention includes a buffer 2 for receiving a compressed bitstream 1 , a VLD (Variable Length Decoder) 3 for analyzing the compressed bitstream from the buffer 2 , an IQ (Inverse Quantizer) 4 for inverse quantizing the compressed bitstream analyzed at the VLD 3 , an IDCT for inverse discrete cosine transform of the bitstream from the IQ 4 , an MC (Motion Compensator) 6 for making motion compensation of a data up sampled by motion signals, such as motion vectors, extracted from the VLD 3 , an adder 7 for adding a data from the IDCT 5 and a data from the MC 6 , an adaptive down sampler 8 for subjecting a data from the adder to adaptive down sampling, and an adaptive up sampler 9 for up sampling the data down sampled at the adaptive down sampler 8 , and providing to the MC 6 .
  • a buffer 2 for receiving a compressed
  • the signal from the down sampler 8 is stored in an external video frame memory 12 through an internal memory bus 10 and the memory interface 11 .
  • the data stored in the memory 12 is processed to be displayable at a video display processor 14 in response to an instruction signal provided from the external input device 13 , and displayed on a display 15 .
  • the MPEG-2 video decoder carries out IDCT in 8 ⁇ 8 block units according to an MPEG-2 video syntax.
  • the data subjected to IQ and IDCT at the IQ 4 and IDCT 5 is stored in the external memory right away, and, in a case of a predictive picture (P-picture) or a bi-directional picture (B-picture), the data motion compensated at the MC 6 and the data subjected to IDCT at the IDCT 5 are added together at the adder 7 and stored in the external memory 12 .
  • the video stored in the external memory 12 is displayed after the video is passed through the video display processor 14 .
  • the present invention is characterized in that the adaptive down sampler 8 and the adaptive up sampler 9 are provided additionally, for storing different video signals, reducing a capacity of the external memory 12 , and reducing a bandwidth of the data to be stored in the external memory 12 .
  • Both of the adaptive down sampler 8 and the adaptive up sampler 9 reduce a size of a video data to be stored in the external memory 12 by 1 ⁇ 2 or 1 ⁇ 4. Also, the two samplers 8 and 9 reduce a drift error occurred during decoding of the MPEG video data to a maximum and helps to maintain a good display picture quality.
  • FIG. 2 illustrates a block diagram showing a system of a video decoder having a down conversion algorithm for memory reduction in accordance with a preferred embodiment of the present invention.
  • the video decoder having a down conversion algorithm for memory reduction in accordance with a preferred embodiment of the present invention includes a VLD 3 for receiving and analyzing a compressed bitstream, an IQ for subjecting the compressed bitstream analyzed at the VLD 3 to IQ, an IDCT 5 for subjecting a bitstream from the IQ 4 to inverse discrete cosine transform in 8 ⁇ 8 block units, an MC 6 for making motion compensation of an up sampled data by using motion signals extracted by analysis of the VLD 3 , i.e., motion vectors, motion type, and a motion vertical field selection signal, a DCT buffer 16 for forwarding a data from the IDCT 5 with the data sorted into a top field data and a bottom field data by using signals extracted at the VLD 3 , i.e., a DCT type, a picture architecture, and a progressive sequence signal, an MC buffer 17 for forwarding a data from the motion compensator 6 with the data sorted into a top field data and a bottom
  • the MPEG-2 video decoder reads pels in frame units or field units from the external memory 12 according to architecture frame picture or field picture, and makes motion compensation.
  • results of down sampling differ for the frame picture and the field picture.
  • FIG. 3 illustrates a diagram showing a pel architecture after data in DCT domain is down sampled.
  • results thereof show pel architecture different from the other, and, particularly, information on a field kind is lost when a motion compensation is made, or the video data in the interlaced scanning type is displayed in field units.
  • the present invention suggests to store the DCT blocks in the external memory 12 in a vertical pel architecture based on a field fixed already regardless of one DCT block in a received video sequence is a block DCT coded in field units or a block DCT coded in frame units. Thereafter, a compensation for a motion prediction is made. Therefore, even if a frame picture is down sampled in a vertical direction, information on a field kind is not lost, and, furthermore, a good picture quality can be maintained.
  • the DCT coefficients analyzed at the VLD 3 is provided to the IDCT (or a module) 5 after the DCT coefficients are passed through an inverse quantizing process through the IQ 4 , when the VLD 3 also provides a signal indicating that the received video signal has a DCT type frame or field, and a signal indicating the received video signal is a frame picture of a picture architecture or a field picture.
  • the VLD 3 also provides the motion vectors MV, a motion type signal motion_type, and a motion vertical field selection signals motion_vertical_field_select.
  • the two adders 18 and 19 in the macro block adder MB_ADD 7 in FIG. 1 add outputs both of the DCT buffer 16 and the MC_buffer 17 to suit to forms of data from the IDCT 5 , respectively. Then, data from the adders 18 and 19 are down sampled at the adaptive down sampler 8 .
  • FIG. 4 illustrates a diagram showing a form of data from the IDCT and stored in the DCT buffer.
  • a DCT calculation type code dc_cal_type representing a frame architecture in 8 ⁇ 8 block units is set to be “1”
  • shuffling of data in field units is carried out.
  • FIG. 5 illustrates a diagram showing a case when an MC buffer converts and stores a field unit picture into a frame unit picture
  • FIG. 6 illustrates a diagram showing a case when an MC buffer stores a field unit picture as it is.
  • the MC buffer receives, and stores a picture either in a frame structure or in a field structure depending on a picture structure.
  • the video decoder of the present invention stores a picture data based on the field structure. Therefore, when the video decoder forms a macro block for a motion compensation, the video decoder accesses to the external memory 12 and reads pel values therein in field units. Therefore, in general, in motion compensation for a field picture, the MC_buffer 17 is formed in field units as shown in FIG. 6 .
  • frame unit motion compensation MC-FRAME there are frame unit motion compensation MC-FRAME, and field unit motion compensation MC_FIELD, MC_DMV. At the end, as shown in FIG.
  • pels from the field structure macro block is required to be converted into a frame structure macro block.
  • a form of the pels stored in the MC_buffer 17 is made suitable to the picture structure provided to the video decoder.
  • FIG. 7 illustrates a diagram for explaining operation of a macro block adder.
  • the macro block adder 7 adds data from the MC_buffer 17 and the DCT_buffer 16 such that pels at the same positions are added according to the DCT type and the picture structure.
  • FIG. 8 illustrates a block diagram showing a detailed system of the down sampler 8 in FIG. 2 .
  • the down sampler 8 includes a down sampling controlling part 20 for controlling down sampling according to received down sampling parameters, a vertical down sampling part for down sampling a received data in a vertical direction under the control of the down sampling controlling part 20 , a temporary buffer 22 for temporary storage of the vertical down sampled data, a horizontal down sampling part 23 for down sampling data from the temporary buffer 22 in a horizontal direction under the control of the down sampling controlling part 20 , and a forwarding multiplexer 24 for forwarding either of the received data and a data from the horizontal down sampling part 23 selectively under the control of the down sampling controlling part 21 .
  • a down sampling controlling part 20 for controlling down sampling according to received down sampling parameters
  • a vertical down sampling part for down sampling a received data in a vertical direction under the control of the down sampling controlling part 20
  • a temporary buffer 22 for temporary storage of the vertical down sampled data
  • a horizontal down sampling part 23 for down sampling data from the temporary buffer 22 in a horizontal direction under the control of the down sampling controlling part 20
  • a forwarding multiplexer 24
  • the down sampler 8 reduces sizes of original data according to 1, 1 ⁇ 2, and 3 ⁇ 4 reduction ratios for respective field signals from the macro block adders MB_ADD 18 and 19 . To do this, the down sampler 8 includes separate processors for the vertical direction and the horizontal direction. In the 1 ⁇ 2 original data reduction, the down sampler 8 makes a horizontal down sampling only.
  • an one dimensional down sampling can be expressed as the following equation (5) by using equations (2) and (3).
  • C 4 [ T 4 ⁇ ] 2 .
  • the equation (5) can be expressed in the following equation (6).
  • a down sampling matrix having an input of 4 pels and an output of 2 pels can be represented as the following equation (7).
  • Y 2 ⁇ 1 C 2 ⁇ 4 ⁇ X 4 ⁇ 1 (7), where, C 2 ⁇ 4 represents [ T 2 ⁇ ] T ⁇ T 4 2 , and T 2 represents a matrix based on 2 ⁇ 2 DCT as shown in the equation (2).
  • FIG. 9 illustrates a block diagram for explaining operation of the down sampler in FIG. 2 , showing a field basis down sampling by using the equations (6) and (7).
  • the luminance signal ‘Y’ is divided into an 8 ⁇ 8 sized top field and an 8 ⁇ 8 sized bottom field.
  • the chrominance signal has a number of vertical direction field lines half of the luminance signal, down conversion is carried out, by using the equation (7) for the chrominance signal, and by using the equation (6) for the luminance signal.
  • the down converted field unit pels are stored in the external memory 12 .
  • FIG. 10 illustrates detailed systems of the up sampler and the motion compensator in FIG. 2 , showing a motion compensation for an up sampling.
  • the motion compensator having up samplers includes a motion vector translator 28 for translating a motion type signal, a motion vector, and a motion vertical field selection signal from the VLD 3 , to obtain a reference memory read address, and a reference pel for prediction, a horizontal up sampling filter 29 for making a horizontal up sampling by using the motion vector, the reference memory address, and the reference pels for prediction, a vertical up sampling filter 27 for making a vertical up sampling a data from the horizontal up sampling filter 29 by using the motion vector, and the motion type, a combiner 26 for combining up sampled field blocks from the vertical up sampling filter 27 into frame blocks when a frame prediction is used, and an 1 ⁇ 2 pel interpolator 25 for interpolating a data from the combiner 26 by 1 ⁇ 2 pels, and forwarding to the MC_buffer 17 .
  • a motion vector translator 28 for translating a motion type signal, a motion vector, and a motion vertical field selection signal from the VLD 3 , to obtain a reference memory read address, and a
  • a result passed through the IDCT 5 in FIG. 2 is down sampled right away, and stored in the external memory 12 .
  • a prediction picture ‘P’ or a bi-directional picture ‘B’ is added to motion prediction compensated blocks, and stored in the external memory 12 .
  • a video encoder in a transmission side reproduces the present frame block from a prior frame by using a motion vector MV of a perfect resolution. Therefore, for enhancing a picture quality, the present invention uses the motion vector of a perfect resolution as it is, rather than scaling down the vertical and horizontal motion vectors. At first, for using the motion vector MV of a perfect resolution, it is required to up sample a reference picture of a reduced resolution stored in the external memory 12 to a picture of an original resolution.
  • the external memory 12 in FIG. 2 has field based vertical structure pictures stored therein.
  • the MPEG video there are a frame prediction and field prediction according to motion types.
  • the field prediction an up sampling is made for fields selected in response to a motion vertical field selection signal motion_vertical_field_select.
  • motion_vertical_field_select a motion vertical field selection signal
  • the frame prediction after the top field and the bottom field are up sampled respectively, one frame block is provided from two up sampled fields. Then, a frame predicted block is provided and 1 ⁇ 2 pel prediction is carried out.
  • FIG. 11 illustrates a detailed system of the up sampler 9 in FIG. 2 .
  • the up sampler 9 includes an up sampling controlling part 30 for controlling up sampling according to received up sampling parameters, a horizontal up sampling part 31 for subjecting a received data to horizontal up sampling under the control of the up sampling controlling part 30 , a temporary buffer 32 for temporary storage of the horizontal up sampled data, a vertical up sampling part 33 for subjecting a data from the temporary buffer 32 to vertical up sampling under the control of the up sampling controlling part 30 , and a forwarding multiplexer 34 for forwarding either the received data or a data from the vertical up sampling part 33 under the control of the up sampling controlling part 31 , selectively. As shown in FIG.
  • the up sampler adjusts extents of vertical and horizontal up sampling according to unity, 1 ⁇ 2, or 3 ⁇ 4 reduction mode. For an example, in the 1 ⁇ 2 reduction mode, only horizontal up sampling is made, and in the 3 ⁇ 4 reduction mode, both vertical and horizontal up sampling are made.
  • equations (8) and (9) can be expressed as the following equation (10).
  • Equation (10) represents a process for up sampling a picture with a 1 ⁇ 2 resolution stored in the memory 2 .
  • a process for up sampling from the down sampled pel explained in the equation (7) to four pels can be expressed in the following equation (11).
  • FIG. 12 illustrates a block diagram showing a process for up sampling field data stored in a field basis external memory by means of frame prediction.
  • a luminance signal and a chrominance signal are up sampled, separately.
  • up sampling of the luminance signal will be explained.
  • a data from the field structure memory 12 is up sampling filtered by using the up sampling matrix, to obtain an up sampled top field and bottom field, which are added together.
  • the added data is 1 ⁇ 2 pel predicted, and forwarded to the macro block adder 7 in FIG. 2 .
  • up sampling of a chrominance signal will be explained.
  • a data from the field structure memory 12 is up sampling filtered by using the up sampling matrix in the equation (11), to obtain an up sampled top field and bottom field respectively, which are added together.
  • the added data is 1 ⁇ 2 pel predicted and forwarded to the macro block adder 7 in FIG. 2 .
  • the data from the field structure memory 12 is reproduced into a macro block in conformity to original resolution in vertical and horizontal directions, and a motion compensation block is obtained from this reproduced block.
  • the vertical up sampling of the chrominance signal is carried out by using the matrix in the equation (11).
  • a 1 ⁇ 2 pel interpolation presents in vertical and horizontal directions, or a motion vector MV of a perfect resolution is not an exact multiple of 8, adjacent 4 ⁇ 4 unit blocks in vertical and horizontal directions are taken for motion compensation.
  • FIG. 13 illustrates a diagram for explaining a method for making motion compensation having 1 ⁇ 2 pel interpolation of the present invention.
  • blocks B 1 , B 2 , B 3 , and B 4 adjoining to a macro block B 0 of a reduced resolution are taken.
  • blocks D 1 , D 2 , D 3 , and D 4 of perfect resolutions in vertical and horizontal directions are restored from the blocks B 1 , B 2 , B 3 , and B 4 by using the up sampling matrices derived in the equations (10) and (11).
  • a 1 ⁇ 2 pel interpolation is carried out for area D 0 of a motion vector MV of perfect resolution, to obtain a desired motion compensated block.
  • Blocks motion compensated according to the foregoing process is down sampled at the down sampler, and stored in the external memory 12 , again. Then, the stored data is displayed on a display through the video display processor.
  • the video decoder with a down conversion function, and the method for decoding a video signal have the following advantages.
  • the scaleable video decoder of an HD class MPEG sequence of the present invention can reduce memory capacity by 50% or 75% effectively while a picture quality is maintained.
  • a plurality of HD class video signals and a plurality of SD class video signals can be displayed on one screen by employing a memory of a capacity for processing one HD class video signal only.
  • an HD class video signal can be displayed on a display of a low resolution without any additional expense for hardware.

Abstract

The present invention relates to a video decoder with a down conversion function, and a method for decoding a video signal. According to the video decoder and the method for decoding a video signal of the present invention, a VLD analyzes a received compressed video stream, and extracts motion signals. The bitstream analyzed at the VLD is converted into a macro block through an IQ and IDCT in succession, and a MC makes motion compensation of an up sampled data by using the extracted motion signals. A data from the IDCT and a data from the MC are added, down sampled by an adaptive down sampler, and stored in an external memory. For motion compensation, the adaptive up sampler up samples the data down sampled at the adaptive down sampler, and provides to the MC.

Description

    BACKGROUND OF THE INVENTION
  • 1. Field of the Invention
  • The present invention relates to a video decoder with a down conversion function, and a method for decoding a video signal.
  • 2. Background of the Related Art
  • In general, an MPEG-2 video decoding chip is provided with a TP (Transport Packet)-decoder, a video decoder, a video display processor, an external memory, and a host interface, and the like. The external memory may be a DRAM (Dynamic Random Access Memory) for receiving, and storing a bitstream, and frame buffers for motion compensation, and the like. MPEG-2 standard requires a bit buffer size of 10 Mbits for supporting an MP@HL mode, at a maximum allowable bit rate of 80 Mbits/s. An existing 16 Mbits DRAM basis MPEG-2 decoder requires an external memory of approx. 96˜128 Mbits size. Therefore, a price competitiveness is required in view of manufacturers and consumers. For having the price competitiveness, it is required that a good picture quality is maintained while expensive memory sizes are reduced. However, it is foreseen that an increase of additional external memories is inevitable in the future in light of a trend that various OSD (On Screen Display) and a variety of services are provided.
  • Recently, in a case of a video compression and decoding system such as MPEG-2, a variety of video signals are multi-decoded and displayed, for providing a variety of services, when it is required that the variety of video signal are decoded by using a limited capacity of the memory. At the end, taking the memory size limitation, price, and a bandwidth of a data bus into account, the video decoding chip is required to be provided with an effective device for reducing a memory capacity that can minimize a loss of a high quality picture signal loss.
  • In memory reduction algorithms loaded on existing video decoding chips, there are the ADPCM (Adaptive Differential Pulse Coded Modulation) type with a 50% reduction ratio, and the type with 75% reduction ratio that eliminates spatial duplicity by using VQ (Vector Quantization).
  • The ADPCM is suggested by Pau and Sano in EP 0778709A1 titled “MPEG-2 decoding with a reduced RAM requisite by ADPCM recompression before storing MPEG decompressed data”. The VQ is suggested by Bruni et al. in IEEE Trans., On Customer Electronics, pp. 537-544, 1988, titled “A novel adaptive vector quantization method for memory reduction in MPEG-2 HDTV decoders”.
  • Compression methods by filtering in a DCT (Discrete Cosine Transformation) frequency domain, or down sampling are suggested by S.-B. Ng (“Lower resolution HDTV receivers”, U.S. Pat. No. 5,362,854, Nov. 16, 1993), S.-J. Choi et al. (“Frame memory reduction for MPEG-2/DTV video coding”, Int. workshop on HDTV '98), and R. Mokry and D. Anastassiou (“Minimul error drift in Frequency scalability for motion-compensated DCT coding”, IEEE Trans. On Circuits and Systems for Video Tech., Vol. 4, August 1994).
  • Because a compressed code is stored in the memory, the ADPCM method is difficult to display a video by using a video display right away, to require a device for decoding the compressed code, additionally. Since the ADPCM method shows very great picture quality loss in a case of 75% reduction, the ADPCM method is not suitable for the video decoding chip.
  • Different from this, a plurality of HDTV class videos or SD class videos received at one chip video decoder can be displayed on one screen simultaneously by using a down conversion algorithm. This method can maintain a good picture quality to some extent despite of substantial reduction of the memory capacity, and applicable to inexpensive decoders for low resolution displays. Therefore, a down conversion algorithm that allows to employ a small capacity memory while a good picture quality can be maintained, and a hardware design for the down conversion algorithm, are required.
  • A general MPEG encoder encodes either a progressive sequence or an interlaced sequence. An interlaced sequence picture is encoded in field or frame units. The field picture has odd scanning lines and even scanning lines, and all encoder and decoder are operative in field. Therefore, data blocks each DCT Transformed in a 8×8 unit only has odd fields or even fields, which are called as field DCT coded blocks.
  • Different from this, a frame picture has odd scanning lines and even scanning lines, resulting in macro blocks of the frame picture to have odd fields and even fields. However, macro blocks of the frame picture can be coded in two methods. According to the first method, each of the four 8×8 discrete cosine transformed blocks is a DCT coded block in frame units each having odd scanning lines and even scanning lines. On the other hand, according to the second method, two macro blocks from the four macro blocks are blocks DCT coded in field units only having odd scanning lines of the macro blocks, and the rest of two macro blocks are blocks DCT coded in field units only having even scanning lines.
  • All the macro block in the field picture are DCT coded in field units, and motion compensation of which are predicted from a reference field in making motion compensation. On the other hand, macro blocks in the frame picture are DCT coded in frame units or in field units. Each of the macro blocks in the frame picture is motion compensation predicted in frame units or field units. On the other hand, in a case of the progressive sequence, all pictures are DCT coded, and motion compensation predicted in frame units.
  • Currently, in this state spread of HD displays are not enough, there are many cases when an HD class picture quality video sequence is displayed in a lower resolution though TV receivers of present NTSC (National Television System Committee) standards. Therefore, it is required that users can watch an HDTV broadcasting signal through the NTSC TV receivers without buying expensive HDTV (High Definition Television), immediately. As explained, a device for converting the HDTV broadcasting signal suitable to the NTSC TV receiver is called as a down converting decoder. At the end, by employing the down converting decoder, a TV receiver having a price significantly lower than a TV receiver having a perfect HD class resolution can be obtained.
  • One of these types is disclosed in U.S. Pat. No. 5,262,854. This patent includes a down sampler for removing 48 high frequency DCT coefficients in an 8×8 block. According to this patent, a result of IDCT for the rest low frequency 4×4 blocks is stored in a memory. Therefore, for making an accurate motion compensation, when it is intended to reduce an error of motion compensation prediction by using perfect resolution motion vectors, a frame of reduced resolution is used as reference. At the end, in order to provide a picture of a perfect resolution from a picture of a reduced resolution, an up-sampling is employed.
  • A few effective methods are suggested for reducing the error of motion compensation prediction by up sampling a picture down sampled by using 4×4 IDCT, by R. Monky and D. Anastsssiou (“Minimul error drift in frequency scalability for motion-compensated DCT coding”, IEEE Trans. On circuits and systems for video Tech., Vol. 4, No.4, August 1994), and Johnson and Princen (“Drift minimization in frequency scaleable coders using block based filtering”, IEEE workshop on visual signal processing and communication, September 1993. These methods employ two dimensional filters each having 5 taps or 8 taps depending on a typically predicted motion vector of a macro block, when positions of 8 tap filter values are changed depending on the motion vector, to require to increase 4 pels into 8 pels by one 8 tap filter.
  • However, while the foregoing methods are suitable to a progressive sequence having DCT coded blocks in frame units, matters on a video of blocks DCT coded in frame units and DCT coded in field units mixed therein are not taken into account. Moreover, the foregoing methods have a frame type memory structure, a down converting of blocks DCT coded in field units is carried out after the blocks DCT coded in field units is converted into blocks DCT coded in frame units, that results in unfavorable influence of prediction error accumulation in making motion compensation in an area having a great motion. Furthermore, the only employment of low frequency parts (in general, called as 4×4 cuts) among 8×8 DCT coefficients in the motion compensation causes to lost signals of high frequency band, that causes to occur block artifacts.
  • Eventually, an interlaced sequence processed at an MPEG-2 video decoder has a problem of data loss occurred in the down conversion.
  • SUMMARY OF THE INVENTION
  • Accordingly, the present invention is directed to a video decoder with a down conversion function, and a method for decoding a video signal that substantially obviates one or more of the problems due to limitations and disadvantages of the related art.
  • An object of the present invention is to provide a video decoder with a down conversion function, and a method for decoding a video signal which permits an SD class display of a small memory capacity to display an HD class signal.
  • Another object of the present invention is to provide a video decoder with a down conversion function, and a method for decoding a video signal which permits to reduce different video signals in ½, or ¾ reduction ratio, and store in an external memory at a time, or display on one screen at a time, regardless of a progressive scanning type picture or interlaced scanning type picture.
  • Additional features and advantages of the invention will be set forth in the description which follows, and in part will be apparent from the description, or may be learned by practice of the invention. The objectives and other advantages of the invention will be realized and attained by the structure particularly pointed out in the written description and claims hereof as well as the appended drawings.
  • To achieve these and other advantages and in accordance with the purpose of the present invention, as embodied and broadly described, and according to a first characteristic of the present invention, frame DCT coded blocks and field DCT coded block received at the video decoder are always down converted into a picture of a field basis vertical pel structure.
  • According to a second characteristic of the present invention, a macro block adder module adds a motion compensated macro block from a motion compensation buffer and an IDCT macro block from a DCT buffer according to a picture structure and a DCT type. In a 75% reduction mode, a device is included for arranging positions of pels of a block predicted as a field structure to suit to an IDCT type.
  • According to a third characteristic of the present invention, a down sampler module has modes for horizontal ½ reduction in 8×8 block units, and for vertical and horizontal ¾ reductions.
  • According to a four characteristic of the present invention, a down sampler module divides a frame DCT coded block into field signals and extracts frequency components in a 8×8 block in a ¾ reduction mode. In this instance, different down sampling filters are used in a vertical down sampling depending on a color component, because a number of fields for chrominance components are smaller than a number of fields for luminance components.
  • According to a fifth characteristic of the present invention, in a down sampling, down sampled pels are obtained by a down sampling matrix conversion. That is, C4×8=C4 T·T8, where C4 = [ T 4 ϕ ] 2 ,
    and T4 denotes a 4×4 DCT basis matrix, except that C2×4=C2 T·T4 filter is used in vertical down sampling of a chrominance component.
  • According to a sixth characteristic of the present invention, in motion compensation, a field fit to a motion vector is selected, and reads a reduced field reference signal on a memory. Then, horizontal and vertical direction up sampling are carried out for each fields.
  • According to a seventh characteristic of the present invention, in field prediction compensation, a reference address is provided to a memory by using a motion vector to read a reference block. Then, horizontal and vertical up sampling is carried out for each filed, a ½ pel prediction is made for the up sampled blocks, to provide motion compensated blocks. Finally, the motion compensated blocks are forwarded to a macro block adder in field units.
  • According to an eighth characteristic of the present invention, in frame prediction compensation, a reference address is provided to a memory by using a motion vector, to read field unit reference blocks. Then, horizontal and vertical up sampling is carried out for each field, and a frame unit reference block is formed of up sampled blocks of each field. Then, a motion compensated block is formed by making ½ pel prediction. Finally, motion compensated frame unit blocks are forwarded to a macro block adder according to IDCT macro block type.
  • According to a ninth characteristic of the present invention, an up sampler module has a ½ reduction mode in which a horizontal up sampling in 8×4 block units is made, and a ¾ reduction mode in which vertical and horizontal up sampling in 4×4 block units are made.
  • According to a tenth characteristic of the present invention, a motion compensator uses 2·C4×8 T, and 2·C2×4 T filters in up sampling in filtering.
  • It is to be understood that both the foregoing general description and the following detailed description are exemplary and explanatory and are intended to provide further explanation of the invention as claimed.
  • BRIEF DESCRIPTION OF THE DRAWINGS
  • The accompanying drawings, which are included to provide a further understanding of the invention and are incorporated in and constitute a part of this specification, illustrate embodiments of the invention and together with the description serve to explain the principles of the invention:
  • In the drawings:
  • FIG. 1 illustrates a block diagram showing a system of a scaleable MPEG-2 video decoder having a down conversion function in accordance with a preferred embodiment of the present invention;
  • FIG. 2 illustrates a block diagram showing a system of a video decoder having a down conversion algorithm for memory reduction in accordance with a preferred embodiment of the present invention;
  • FIG. 3 illustrates a diagram showing a pel architecture after data in DCT domain is down sampled;
  • FIG. 4 illustrates a diagram showing a form of data from the IDCT and stored in the DCT buffer;
  • FIG. 5 illustrates a diagram showing a case when an MC buffer converts and stores a field unit picture into a frame unit picture;
  • FIG. 6 illustrates a diagram showing a case when an MC buffer stores a field unit picture as it is;
  • FIG. 7 illustrates a diagram for explaining operation of a macro block adder;
  • FIG. 8 illustrates a block diagram showing a detailed system of the down sampler in FIG. 2;
  • FIG. 9 illustrates a block diagram for explaining operation of the down sampler in FIG.
  • FIG. 10 illustrates detailed systems of the up sampler and the motion compensator in FIG. 2;
  • FIG. 11 illustrates a detailed system of the up sampler 9 in FIG. 2;
  • FIG. 12 illustrates a block diagram showing a process for up sampling field data stored in a field basis external memory by means of frame prediction; and,
  • FIG. 13 illustrates a diagram for explaining a method for making motion compensation having ½ pel interpolation of the present invention.
  • DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENT
  • Reference will now be made in detail to the preferred embodiments of the present invention, examples of which are illustrated in the accompanying drawings. The video decoder with a down conversion function of present invention relates to a technology required for displaying interlaced scanning, coded, different video signals of HD class on the same screen on the same time, or displaying an HD class signal on a low resolution class display. The video decoder of the present invention can reduce a capacity of an external memory by 50% or 75% compared to an existing HD class video decoder as required, and is applicable to an MPEG-2 (Moving Picture Expert Group-2) decoding chip, a standard in a digital video signal transmission field.
  • As explained, the MPEG-2 video decoder of the present invention reduces a video, and stores in a memory or displays on a screen, regardless of a progressive scanning type picture or an interlaced scanning type picture. FIG. 1 illustrates a block diagram showing a system of a scaleable MPEG-2 video decoder having a down conversion function in accordance with a preferred embodiment of the present invention. The down conversion function of the system in FIG. 1 is for 50% or 75% memory reduction.
  • Referring to FIG. 1, the scaleable MPEG-2 video decoder having a down conversion function in accordance with a preferred embodiment of the present invention includes a buffer 2 for receiving a compressed bitstream 1, a VLD (Variable Length Decoder) 3 for analyzing the compressed bitstream from the buffer 2, an IQ (Inverse Quantizer) 4 for inverse quantizing the compressed bitstream analyzed at the VLD 3, an IDCT for inverse discrete cosine transform of the bitstream from the IQ 4, an MC (Motion Compensator) 6 for making motion compensation of a data up sampled by motion signals, such as motion vectors, extracted from the VLD 3, an adder 7 for adding a data from the IDCT 5 and a data from the MC 6, an adaptive down sampler 8 for subjecting a data from the adder to adaptive down sampling, and an adaptive up sampler 9 for up sampling the data down sampled at the adaptive down sampler 8, and providing to the MC 6. The signal from the down sampler 8 is stored in an external video frame memory 12 through an internal memory bus 10 and the memory interface 11. The data stored in the memory 12 is processed to be displayable at a video display processor 14 in response to an instruction signal provided from the external input device 13, and displayed on a display 15. In this instance, the MPEG-2 video decoder carries out IDCT in 8×8 block units according to an MPEG-2 video syntax. On the other hand, in a case of an intra-picture (1-picture), the data subjected to IQ and IDCT at the IQ 4 and IDCT 5 is stored in the external memory right away, and, in a case of a predictive picture (P-picture) or a bi-directional picture (B-picture), the data motion compensated at the MC 6 and the data subjected to IDCT at the IDCT 5 are added together at the adder 7 and stored in the external memory 12. As explained, the video stored in the external memory 12 is displayed after the video is passed through the video display processor 14. The present invention is characterized in that the adaptive down sampler 8 and the adaptive up sampler 9 are provided additionally, for storing different video signals, reducing a capacity of the external memory 12, and reducing a bandwidth of the data to be stored in the external memory 12. Both of the adaptive down sampler 8 and the adaptive up sampler 9 reduce a size of a video data to be stored in the external memory 12 by ½ or ¼. Also, the two samplers 8 and 9 reduce a drift error occurred during decoding of the MPEG video data to a maximum and helps to maintain a good display picture quality.
  • FIG. 2 illustrates a block diagram showing a system of a video decoder having a down conversion algorithm for memory reduction in accordance with a preferred embodiment of the present invention.
  • Referring to FIG. 2, the video decoder having a down conversion algorithm for memory reduction in accordance with a preferred embodiment of the present invention includes a VLD 3 for receiving and analyzing a compressed bitstream, an IQ for subjecting the compressed bitstream analyzed at the VLD 3 to IQ, an IDCT 5 for subjecting a bitstream from the IQ 4 to inverse discrete cosine transform in 8×8 block units, an MC 6 for making motion compensation of an up sampled data by using motion signals extracted by analysis of the VLD 3, i.e., motion vectors, motion type, and a motion vertical field selection signal, a DCT buffer 16 for forwarding a data from the IDCT 5 with the data sorted into a top field data and a bottom field data by using signals extracted at the VLD 3, i.e., a DCT type, a picture architecture, and a progressive sequence signal, an MC buffer 17 for forwarding a data from the motion compensator 6 with the data sorted into a top field data and a bottom field data by using the DCT type, the picture architecture, and the progressive sequence signal, an adder 18 for adding the top field data from the DCT buffer 16 and the top field data from the MC buffer 17, an adder 19 for adding the bottom field data from the DCT buffer 16 and the bottom field data from the MC buffer 17, an adaptive down sampler 8 for subjecting the top field data and the bottom field data from the two adders 18 and 19 to adaptive down sampling, an external memory 12 for storing the down sampled data, i.e., a reduced resolution data and a motion compensated data, and an adaptive up sampler 9 for up sampling the down sampled data stored in the external memory 12 and forwarding to the MC 6.
  • In general, the MPEG-2 video decoder reads pels in frame units or field units from the external memory 12 according to architecture frame picture or field picture, and makes motion compensation. However, in the vertical direction down sampling for 75% memory capacity reduction, results of down sampling differ for the frame picture and the field picture. FIG. 3 illustrates a diagram showing a pel architecture after data in DCT domain is down sampled.
  • Referring to FIG. 3, when a block DCT coded in frame units, and a block DCT coded in field units are down sampled in a DCT transform domain respectively, results thereof show pel architecture different from the other, and, particularly, information on a field kind is lost when a motion compensation is made, or the video data in the interlaced scanning type is displayed in field units. In order to compensate for this, the present invention suggests to store the DCT blocks in the external memory 12 in a vertical pel architecture based on a field fixed already regardless of one DCT block in a received video sequence is a block DCT coded in field units or a block DCT coded in frame units. Thereafter, a compensation for a motion prediction is made. Therefore, even if a frame picture is down sampled in a vertical direction, information on a field kind is not lost, and, furthermore, a good picture quality can be maintained.
  • The operation of the video decoder in FIG. 2 will be explained.
  • The DCT coefficients analyzed at the VLD 3 is provided to the IDCT (or a module) 5 after the DCT coefficients are passed through an inverse quantizing process through the IQ 4, when the VLD 3 also provides a signal indicating that the received video signal has a DCT type frame or field, and a signal indicating the received video signal is a frame picture of a picture architecture or a field picture. The VLD 3 also provides the motion vectors MV, a motion type signal motion_type, and a motion vertical field selection signals motion_vertical_field_select. In the meantime, the two adders 18 and 19 in the macro block adder MB_ADD 7 in FIG. 1 add outputs both of the DCT buffer 16 and the MC_buffer 17 to suit to forms of data from the IDCT 5, respectively. Then, data from the adders 18 and 19 are down sampled at the adaptive down sampler 8.
  • FIG. 4 illustrates a diagram showing a form of data from the IDCT and stored in the DCT buffer. In a case of an interlaced scanning type frame picture, in a DCT type code dc_cal_type, there are a frame type dct_type=‘0’ and a field type dct_type=‘1’. When a DCT calculation type code dc_cal_type representing a frame architecture in 8×8 block units is set to be “1”, shuffling of data in field units is carried out. In FIG. 4, code progressive_seq=‘1’ represents a progressive scanning sequence, code progressive_seq=‘0’ represents an interlaced scanning sequence, code picture_structure=‘01’ represents a top field, code picture_structure=‘10’ represents a bottom field, code picture_structure=‘11’ represents a frame picture, code dct_type=‘0’ represents a frame DCT, code dct_type=‘1’ represents a field DCT, and code dc_cal_type=‘0’ represent existence of no data.
  • FIG. 5 illustrates a diagram showing a case when an MC buffer converts and stores a field unit picture into a frame unit picture, and FIG. 6 illustrates a diagram showing a case when an MC buffer stores a field unit picture as it is.
  • Referring to FIGS. 5 and 6, the MC buffer receives, and stores a picture either in a frame structure or in a field structure depending on a picture structure. As explained, the video decoder of the present invention stores a picture data based on the field structure. Therefore, when the video decoder forms a macro block for a motion compensation, the video decoder accesses to the external memory 12 and reads pel values therein in field units. Therefore, in general, in motion compensation for a field picture, the MC_buffer 17 is formed in field units as shown in FIG. 6. However, in frame picture motion compensation types, there are frame unit motion compensation MC-FRAME, and field unit motion compensation MC_FIELD, MC_DMV. At the end, as shown in FIG. 5, in order to obtain a frame structure macro block, pels from the field structure macro block is required to be converted into a frame structure macro block. Finally, a form of the pels stored in the MC_buffer 17 is made suitable to the picture structure provided to the video decoder.
  • FIG. 7 illustrates a diagram for explaining operation of a macro block adder.
  • Referring to FIG. 7, the macro block adder 7 adds data from the MC_buffer 17 and the DCT_buffer 16 such that pels at the same positions are added according to the DCT type and the picture structure.
  • FIG. 8 illustrates a block diagram showing a detailed system of the down sampler 8 in FIG. 2.
  • Referring to FIG. 8, the down sampler 8 includes a down sampling controlling part 20 for controlling down sampling according to received down sampling parameters, a vertical down sampling part for down sampling a received data in a vertical direction under the control of the down sampling controlling part 20, a temporary buffer 22 for temporary storage of the vertical down sampled data, a horizontal down sampling part 23 for down sampling data from the temporary buffer 22 in a horizontal direction under the control of the down sampling controlling part 20, and a forwarding multiplexer 24 for forwarding either of the received data and a data from the horizontal down sampling part 23 selectively under the control of the down sampling controlling part 21. The down sampler 8 reduces sizes of original data according to 1, ½, and ¾ reduction ratios for respective field signals from the macro block adders MB_ADD 18 and 19. To do this, the down sampler 8 includes separate processors for the vertical direction and the horizontal direction. In the ½ original data reduction, the down sampler 8 makes a horizontal down sampling only.
  • The following is a down sampling equation. [ X ] = [ X 0 X 1 X 2 X 3 X 4 X 5 X 6 X 7 ] = T S [ x ] , ( 1 )
      • where, [X] denotes 8 DCT coefficients, and [x] denotes 8 pel values. [ T8 ] = [ t 00 t 01 t 02 t 03 t 04 t 05 t 06 t 07 t 10 t 11 t 12 t 13 t 14 t 15 t 16 t 17 t 20 t 21 t 22 t 23 t 24 t 25 t 26 t 27 t 30 t 31 t 32 t 33 t 34 t 35 t 36 t 37 t 40 t 41 t 42 t 43 t 44 t 45 t 46 t 47 t 50 t 51 t 52 t 53 t 54 t 55 t 56 t 57 t 60 t 61 t 62 t 63 t 64 t 65 t 66 t 67 t 70 t 71 t 72 t 73 t 74 t 75 t 76 t 77 ] , ( 2 )
      • where, [T8] represents an 8×8 DCT matrix of 8-point DCT bases.
  • Similar to equation (2), a 4×4 DCT matrix of 4-point DCT bases is represented with [T4]. A down sampling process of removing high frequency components in the horizontal direction and in the vertical direction, and subjecting to IDCT can be expressed with the following equation. [ y y y y 0 0 0 0 ] = [ P4 T ] [ X 0 X 1 X 2 X 3 X 4 X 5 X 6 X 7 ] , ( 3 )
      • where, [P4] represents [ P4 ] = [ T4 ϕ ϕ ϕ ] 2 . ( 4 )
  • At the end, an one dimensional down sampling can be expressed as the following equation (5) by using equations (2) and (3). y 4 × 1 = C 4 T · X 8 × 1 = [ T 4 T ϕ ] 2 · [ T8 ] · X 8 × 1 , ( 5 )
    where, ‘x’represents 8×1 pels, ‘y’ represents down sampled 4×1 pels, and ‘X’ represents coefficient blocks subjected to DCT with respect to ‘x’. And, C 4 = [ T 4 ϕ ] 2 .
    Then, the equation (5) can be expressed in the following equation (6).
    y 4×1 =C 4×8 ·X 8×1  (6),
    where, C4×8=C4 T·T8 is defined as a 4×8 dimension down sampling matrix, which converts 8 pels into 4 pels.
  • Similar to the equation (6), a down sampling matrix having an input of 4 pels and an output of 2 pels can be represented as the following equation (7).
    Y 2×1 =C 2×4 ·X 4×1  (7),
    where, C2×4 represents [ T 2 ϕ ] T · T 4 2 ,
    and T2 represents a matrix based on 2×2 DCT as shown in the equation (2).
  • FIG. 9 illustrates a block diagram for explaining operation of the down sampler in FIG. 2, showing a field basis down sampling by using the equations (6) and (7).
  • Referring to FIG. 9, in a 50% original data reduction, only a horizontal down sampling is carried out, when an 8×8 field block is converted into an 8×4 field block by using the matrix in the equation (6), and stored in the external memory 12. In 75% original data reduction, it is required to process a luminance signal ‘Y’ and a chrominance signal ‘C’ in the original data separately for maintaining information on field in the external memory 12. As shown in FIG. 4, in a case of frame structured picture, the chrominance signal “C” is divided into a 4×8 sized top field and a 4×8 sized bottom field. Different from the chrominance signal, the luminance signal ‘Y’ is divided into an 8×8 sized top field and an 8×8 sized bottom field. At the end, since the chrominance signal has a number of vertical direction field lines half of the luminance signal, down conversion is carried out, by using the equation (7) for the chrominance signal, and by using the equation (6) for the luminance signal. Finally, as shown in FIG. 3, the down converted field unit pels are stored in the external memory 12.
  • FIG. 10 illustrates detailed systems of the up sampler and the motion compensator in FIG. 2, showing a motion compensation for an up sampling.
  • Referring to FIG. 10, the motion compensator having up samplers includes a motion vector translator 28 for translating a motion type signal, a motion vector, and a motion vertical field selection signal from the VLD 3, to obtain a reference memory read address, and a reference pel for prediction, a horizontal up sampling filter 29 for making a horizontal up sampling by using the motion vector, the reference memory address, and the reference pels for prediction, a vertical up sampling filter 27 for making a vertical up sampling a data from the horizontal up sampling filter 29 by using the motion vector, and the motion type, a combiner 26 for combining up sampled field blocks from the vertical up sampling filter 27 into frame blocks when a frame prediction is used, and an ½ pel interpolator 25 for interpolating a data from the combiner 26 by ½ pels, and forwarding to the MC_buffer 17.
  • The operation of the video decoder for the foregoing motion compensation will be explained.
  • In a case of an intra picture, a result passed through the IDCT 5 in FIG. 2 is down sampled right away, and stored in the external memory 12. On the other hand, a prediction picture ‘P’ or a bi-directional picture ‘B’ is added to motion prediction compensated blocks, and stored in the external memory 12. On the other hand, in order to obtain a motion compensated frame, a video encoder in a transmission side reproduces the present frame block from a prior frame by using a motion vector MV of a perfect resolution. Therefore, for enhancing a picture quality, the present invention uses the motion vector of a perfect resolution as it is, rather than scaling down the vertical and horizontal motion vectors. At first, for using the motion vector MV of a perfect resolution, it is required to up sample a reference picture of a reduced resolution stored in the external memory 12 to a picture of an original resolution.
  • As explained, the external memory 12 in FIG. 2 has field based vertical structure pictures stored therein. In the MPEG video, there are a frame prediction and field prediction according to motion types. In the field prediction, an up sampling is made for fields selected in response to a motion vertical field selection signal motion_vertical_field_select. However, in a case of the frame prediction, after the top field and the bottom field are up sampled respectively, one frame block is provided from two up sampled fields. Then, a frame predicted block is provided and ½ pel prediction is carried out.
  • In this instance, a picture quality is greatly dependent on characteristics of the up sampling filter. The up sampling filter type used in the present invention, a reverse type of the foregoing down sampling type, uses a matrix of the DCT bases. FIG. 11 illustrates a detailed system of the up sampler 9 in FIG. 2.
  • Referring to FIG. 11, the up sampler 9 includes an up sampling controlling part 30 for controlling up sampling according to received up sampling parameters, a horizontal up sampling part 31 for subjecting a received data to horizontal up sampling under the control of the up sampling controlling part 30, a temporary buffer 32 for temporary storage of the horizontal up sampled data, a vertical up sampling part 33 for subjecting a data from the temporary buffer 32 to vertical up sampling under the control of the up sampling controlling part 30, and a forwarding multiplexer 34 for forwarding either the received data or a data from the vertical up sampling part 33 under the control of the up sampling controlling part 31, selectively. As shown in FIG. 11, alike the down sampler, the up sampler adjusts extents of vertical and horizontal up sampling according to unity, ½, or ¾ reduction mode. For an example, in the ½ reduction mode, only horizontal up sampling is made, and in the ¾ reduction mode, both vertical and horizontal up sampling are made.
  • Above up sampling, reversal of the equation (6), converts four pels into 8 pels by using the following equations. At first, upon obtaining DCT coefficients for four pels, and making all DCT coefficients to be ‘0’ for the rest of high frequencies, the following equation is obtained. X [ 8 × 1 ] 1 = [ T4 ϕ ] · 2 · y 4 × 1 = C 4 · y 4 × 1 · 2 ( 8 )
  • A result of conduction of an 8-point IDCT according to the equation (8) can be expressed in the following equation (9).
    X [8×1] UP T8T ·X [8×1] 1  (9)
  • At the end, equations (8) and (9) can be expressed as the following equation (10).
    X [8×1] UP =T8T ·C 4 ·y 4×1·2=2·C 4×8 T ·y 4×1  (10)
  • Above equation (10) represents a process for up sampling a picture with a ½ resolution stored in the memory 2. A process for up sampling from the down sampled pel explained in the equation (7) to four pels can be expressed in the following equation (11).
    X [4×1] UP =T4T ·C 2 ·y 2×1·2=2·C 2×4 T ·y 2×1  (11)
  • FIG. 12 illustrates a block diagram showing a process for up sampling field data stored in a field basis external memory by means of frame prediction.
  • Referring to FIG. 12, a luminance signal and a chrominance signal are up sampled, separately. At first, up sampling of the luminance signal will be explained. A data from the field structure memory 12 is up sampling filtered by using the up sampling matrix, to obtain an up sampled top field and bottom field, which are added together. The added data is ½ pel predicted, and forwarded to the macro block adder 7 in FIG. 2. Next, up sampling of a chrominance signal will be explained. A data from the field structure memory 12 is up sampling filtered by using the up sampling matrix in the equation (11), to obtain an up sampled top field and bottom field respectively, which are added together. The added data is ½ pel predicted and forwarded to the macro block adder 7 in FIG. 2. In other words, the data from the field structure memory 12 is reproduced into a macro block in conformity to original resolution in vertical and horizontal directions, and a motion compensation block is obtained from this reproduced block. Alike the down sampling, the vertical up sampling of the chrominance signal is carried out by using the matrix in the equation (11). Particularly, in the case of 75% memory reduction, if a ½ pel interpolation presents in vertical and horizontal directions, or a motion vector MV of a perfect resolution is not an exact multiple of 8, adjacent 4×4 unit blocks in vertical and horizontal directions are taken for motion compensation.
  • FIG. 13 illustrates a diagram for explaining a method for making motion compensation having ½ pel interpolation of the present invention.
  • Referring to FIG. 13, in order to produce a macro block D0 of an original picture from a memory of a reduced resolution, blocks B1, B2, B3, and B4 adjoining to a macro block B0 of a reduced resolution are taken. Then, blocks D1, D2, D3, and D4 of perfect resolutions in vertical and horizontal directions are restored from the blocks B1, B2, B3, and B4 by using the up sampling matrices derived in the equations (10) and (11). A ½ pel interpolation is carried out for area D0 of a motion vector MV of perfect resolution, to obtain a desired motion compensated block. When a 50% memory reduction is desired, if no ½ pel interpolation is present in a horizontal direction, or a horizontal motion vector MV of a perfect resolution is not an exact multiple of 8, adjoining blocks in a horizontal direction are taken, and up sampled by using the equation (10), and a ½ pel interpolation is carried out.
  • Blocks motion compensated according to the foregoing process is down sampled at the down sampler, and stored in the external memory 12, again. Then, the stored data is displayed on a display through the video display processor.
  • As has been explained, the video decoder with a down conversion function, and the method for decoding a video signal have the following advantages. First, the scaleable video decoder of an HD class MPEG sequence of the present invention can reduce memory capacity by 50% or 75% effectively while a picture quality is maintained.
  • Second, the implementation of a video decoder for PIP (Picture In Picture) or low resolution display is very easy.
  • Third, a plurality of HD class video signals and a plurality of SD class video signals can be displayed on one screen by employing a memory of a capacity for processing one HD class video signal only.
  • Fourth, an HD class video signal can be displayed on a display of a low resolution without any additional expense for hardware.
  • Fifth, as an essential source technology in application fields of digital TV broadcasting and video conference, implementation of a high performance video that can make multi-decoding or process a plurality of pictures is possible.
  • It will be apparent to those skilled in the art that various modifications and variations can be made in the video decoder with a down conversion function, and a method for decoding a video signal of the present invention without departing from the spirit or scope of the invention. Thus, it is intended that the present invention cover the modifications and variations of this invention provided they come within the scope of the appended claims and their equivalents.

Claims (25)

1. A video decoder comprising:
a VLD (Variable Length Decoder) for analyzing a received compressed bitstream;
an IQ (Inverse Quantizer) for inverse quantizing the compressed bitstream analyzed at the VLD;
an IDCT for discrete cosine transform of a data from the IQ;
an MC (Motion Compensator) for making motion compensation of a data up sampled by using motion signals extracted at the VLD;
an adder for adding a data from the IDCT and a data from the MC;
an adaptive down sampler of a matrix for converting a data from the adder to be in conformity with a picture structure of the compressed bitstream, subjecting the data to adaptive down sampling, and storing the data in an external memory in a field basis; and,
an adaptive up sampler of a structure converted into a transposed matrix of a matrix form for up sampling the data down sampled at the adaptive down sampler, and providing to the MC.
2. A video decoder as claimed in claim 1, wherein the compressed bitstream is an MPEG-2 signal.
3. A video decoder as claimed in claim 2, wherein the MPEG-2 signal is a predictive picture signal or a bi-directional picture signal.
4. A video decoder as claimed in claim 1, wherein the video decoder carries out IDCT in 8×8 block units to suit to a MPEG-2 video syntax.
5. A video decoder comprising:
a VLD for analyzing a received compressed bitstream;
an IQ for inverse quantizing the bitstream analyzed at the VLD;
an IDCT for inverse discrete cosine transform of a data from the IQ in macro block units;
an MC for making motion compensation of a data up sampled by using motion vectors, a motion type, and a motion vertical field selection signal extracted at the VLD;
a DCT buffer for separating a data from the IDCT into a top field data and a bottom field data by using a DCT type signal, a picture structure signal, and a progressive sequence signal extracted at the VLD;
an MC buffer for separating a data from the MC into a top field data and a bottom field data by using the DCT type signal, the picture structure signal, and the progressive sequence signal;
a first adder for adding the top field data from the DCT buffer and the top field data from the MC;
a second adder for adding the bottom field data from the DCT buffer and the bottom field data from the MC;
an adaptive down sampler for subjecting added top field data and added bottom field data from above two adders to adaptive down sampling, and storing in an external memory; and,
an adaptive up sampler for up sampling a down sampled data stored in the external memory and providing to the MC.
6. A video decoder as claimed in claim 5, wherein the block is an 8×8 block.
7. A video decoder as claimed in claim 5, wherein the down sampler includes;
a down sampling controlling part for controlling down sampling according to received down sampling parameters,
a vertical down sampling part for down sampling a received data in a vertical direction on a data from the adders under the control of the down sampling controlling part,
a temporary buffer for temporary storage of the vertical down sampled data,
a horizontal down sampling part for down sampling a data from the temporary buffer in a horizontal direction under the control of the down sampling controlling part, and
a forwarding multiplexer for forwarding either of the received data and a data from the horizontal down sampling part selectively under the control of the down sampling controlling part.
8. A video decoder as claimed in claim 7, wherein the down sampler reduces each field data from the adders by one of reduction ratios selected from unity, ½, and ¾.
9. A video decoder as claimed in claim 8, wherein the down sampler carries out down sampling only in a horizontal direction when the down sampler reduces an original data by the ½ reduction ratio.
10. A video decoder as claimed in claim 5, wherein the motion compensator and the up sampler includes;
a motion vector translator for translating a motion type signal, a motion vector, and a motion vertical field selection signal from the VLD, to obtain a reference memory read address, and a reference pel for prediction,
a horizontal up sampling filter for making a horizontal up sampling by using the motion vector, the reference memory address, and the reference pels for prediction,
a vertical up sampling filter for making a vertical up sampling a data from the horizontal up sampling filter by using the motion vector, and the motion type,
a combiner for combining up sampled field blocks from the vertical up sampling filter into up sampled frame blocks when a frame prediction is used, and
an ½ pel interpolator for interpolating a data from the combiner by ½ pels, and forwarding to the MC_buffer.
11. A video decoder as claimed in claim 5, wherein, when the received bitstream is an intra picture, data from the IDCT is stored in the external memory right away after the data is down sampled.
12. A video decoder as claimed in claim 5, wherein the up sampler includes;
an up sampling controlling part for controlling up sampling according to received up sampling parameters,
a horizontal up sampling part for subjecting a data accessed from the external memory to horizontal up sampling under the control of the up sampling controlling part,
a temporary buffer for temporary storage of the horizontal up sampled data,
a vertical up sampling part for subjecting a data from the temporary buffer to vertical up sampling under the control of the up sampling controlling part, and
a forwarding multiplexer for forwarding either the data access by the external memory or a data from the vertical up sampling part under the control of the up sampling controlling part, selectively.
13. A video decoder as claimed in claim 12, wherein the up sampler adjusts extents of up sampling in horizontal and vertical directions according to unity, ½, or ¾ reduction mode.
14. A video decoder as claimed in claim 13, wherein the up sampler carries out up sampling only in a horizontal direction in the ½ reduction mode, and in vertical and horizontal directions in the ¾ reduction mode.
15. A video decoder as claimed in claim 13, wherein, when C4×8 T denotes a 4×8 dimension down sampling transposed matrix, and y4×1 denotes a down sampling pel value, the up sampler of a luminance carries out up sampling by carrying out 2·C4×8 T·y4×1, and, when y2×1 denotes a down sampled 2×1 pels, and C2×4 denotes a down sampling matrix of 2×4 dimension, the up sampler of chrominance carries out up sampling by carrying out X[4×1] UP2·C2×4·y2×1.
16. A method for decoding a video signal, comprising the steps of:
(a) detecting signals related to a motion and a picture structure signal from a received video sequence;
(b) processing the received video sequence, for providing data of macro block units;
(c) subjecting the data of macro block units to down conversion, and storing in an external memory as a field basis vertical pel structure; and,
(d) subjecting the down converted data stored in the external memory to motion prediction compensation by using the detected motion signals, and the picture structure signal, to obtain a final down converted data.
17. A method as claimed in claim 16, wherein the step (b) includes the steps of,
subjecting the video sequence to VLD to obtain DCT coefficients,
subjecting the DCT coefficients to inverse quantizing, and
subjecting inverse quantized coefficients to IDCT, to provide data of the macro block unit.
18. A method as claimed in claim 16, wherein the macro block unit is 8×8 block suitable for MPEG-2.
19. A method as claimed in claim 16, wherein the detected motion related signals includes a motion vector signal, a motion type signal, and a motion vertical field selection signal.
20. A method as claimed in claim 16, wherein the step (d) includes the steps of,
making access to pel values in field units from the external memory for the motion compensation,
converting the accessed field unit pel values if the detected picture structure signal is a frame picture, and
making motion prediction compensation on the frame unit pel values.
21. A method as claimed in claim 16, wherein the step (d) includes the steps of,
dividing the frame picture signal into a luminance signal and a chrominance signal,
subjecting a luminance data accessed from the external memory to up sampling filtering by using an up sampling matrix of 2·C4×8 T·y4×1 (C4×8 T denotes a 4×8 dimension down sampling transposed matrix, and y4×1 denotes a down sampled pel value), to obtain up sampled top field and bottom field, respectively,
adding the top field and bottom field of the up sampled luminance data together,
subjecting the added luminance signal data to ½ pel prediction, subjecting a chrominance data accessed from the external memory to up sampling filtering by using an up sampling matrix of X[4×1] UP=2·C2×4·y2×1 (where C2×4 denotes a 2×4 dimension down sampling transposed matrix, and y2×1 denotes a down sampled pel value), to obtain up sampled top field and bottom field, respectively,
adding obtained top field and bottom field of the chrominance data, and
subjecting the added chrominance data to ½ pel prediction.
22. A method as claimed in claim 21, wherein the step of obtaining top fields and bottom fields of the luminance data and the chrominance data, before carrying out up sampling filtering for obtaining ½ pel interpolation, includes the steps of;
making access to a macro block of a reduced resolution from the external memory,
taking blocks adjoining to the macro block of the reduced resolution for producing a macro block of an original picture, and
restoring blocks of perfect resolutions in vertical and horizontal directions of the taken adjoining blocks by using up sampling matrices of X[×1] UP=2·C4×8 T·y4×1 (where C4×8 T denotes a 4×8 dimension down sampling transposed matrix, and y4×1 denotes a down sampled pel value), and X[4×1] UP=2·C2×4·y2×1 (where C2×4 denotes a 2×4 dimension down sampling transposed matrix, and y2×1 denotes a down sampled pel value).
23. A method as claimed in claim 21, wherein the step of obtaining top fields and bottom fields of the luminance data and the chrominance data, before carrying out up sampling filtering for obtaining ½ pel interpolation, includes the steps of;
malting access to a macro block of a reduced resolution from the external memory,
taking blocks adjoining to the macro block of the reduced resolution in a horizontal direction if there is a ½ pel interpolation in the horizontal direction or a horizontal perfect resolution motion vector is not exact multiple of 8, and
up sampling the taken adjoining blocks by using X[8×1]UP=2·C4×8 T·y4×1 (where C2×4 T denotes a 4×8 dimension down sampling transposed matrix, and y4×1 denotes a down sampled pel value).
24. A method as claimed in claim 16, wherein the step (c) includes, when the picture structure signal is for frame picture and it is intended to reduce the picture by 75%, the steps of;
dividing the chrominance signal into n×2n sized top field and bottom field, and dividing the luminance signal to 2n×2n top field and bottom field, and
down sampling the chrominance signal by using an equation y[2×1]=C2×4·X4×1 (where C2×4 denotes a down sampling matrix of 2×4 dimension, and y4×1 denotes 4×1 pels), and down sampling the luminance signal by using an equation y[4×1]=C4×8·X8×1 (where C4×8 denotes a down sampling matrix of 4×8 dimension, and X8×1 denotes 8×1 pels).
25. A method as claimed in claim 24, wherein the n×2n denotes 4×8, and 2n×2n denotes 8×8.
US10/916,404 2000-07-27 2004-08-12 Video decoder with down conversion function and method for decoding video signal Abandoned US20050013374A1 (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
US10/916,404 US20050013374A1 (en) 2000-07-27 2004-08-12 Video decoder with down conversion function and method for decoding video signal

Applications Claiming Priority (4)

Application Number Priority Date Filing Date Title
KR10-2000-0043520A KR100370076B1 (en) 2000-07-27 2000-07-27 video decoder with down conversion function and method of decoding a video signal
KR43520/2000 2000-07-27
US09/911,607 US6823014B2 (en) 2000-07-27 2001-07-25 Video decoder with down conversion function and method for decoding video signal
US10/916,404 US20050013374A1 (en) 2000-07-27 2004-08-12 Video decoder with down conversion function and method for decoding video signal

Related Parent Applications (1)

Application Number Title Priority Date Filing Date
US09/911,607 Continuation US6823014B2 (en) 2000-07-27 2001-07-25 Video decoder with down conversion function and method for decoding video signal

Publications (1)

Publication Number Publication Date
US20050013374A1 true US20050013374A1 (en) 2005-01-20

Family

ID=19680418

Family Applications (2)

Application Number Title Priority Date Filing Date
US09/911,607 Expired - Lifetime US6823014B2 (en) 2000-07-27 2001-07-25 Video decoder with down conversion function and method for decoding video signal
US10/916,404 Abandoned US20050013374A1 (en) 2000-07-27 2004-08-12 Video decoder with down conversion function and method for decoding video signal

Family Applications Before (1)

Application Number Title Priority Date Filing Date
US09/911,607 Expired - Lifetime US6823014B2 (en) 2000-07-27 2001-07-25 Video decoder with down conversion function and method for decoding video signal

Country Status (2)

Country Link
US (2) US6823014B2 (en)
KR (1) KR100370076B1 (en)

Cited By (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20060023784A1 (en) * 2004-07-30 2006-02-02 Broadcom Corporation Tertiary content addressable memory based motion estimator
US20060192706A1 (en) * 2005-02-28 2006-08-31 Sanyo Electric Co., Ltd. High frequency compensator and reproducing device
WO2006129266A2 (en) * 2005-06-01 2006-12-07 Nxp B.V. Multiple pass video decoding method and device
US20100238355A1 (en) * 2007-09-10 2010-09-23 Volker Blume Method And Apparatus For Line Based Vertical Motion Estimation And Compensation
US20110044410A1 (en) * 2008-04-24 2011-02-24 Jang Euee-Seon Device and method for encoding/decoding
US20130129326A1 (en) * 2010-08-04 2013-05-23 Nxp B.V. Video player
US10257524B2 (en) * 2015-07-01 2019-04-09 Mediatek Inc. Residual up-sampling apparatus for performing transform block up-sampling and residual down-sampling apparatus for performing transform block down-sampling

Families Citing this family (28)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR100370076B1 (en) * 2000-07-27 2003-01-30 엘지전자 주식회사 video decoder with down conversion function and method of decoding a video signal
US20030095603A1 (en) * 2001-11-16 2003-05-22 Koninklijke Philips Electronics N.V. Reduced-complexity video decoding using larger pixel-grid motion compensation
KR100463515B1 (en) * 2001-12-29 2004-12-29 엘지전자 주식회사 Video decoding system
KR100425136B1 (en) * 2002-01-07 2004-03-31 엘지전자 주식회사 Video decoding system
US7379496B2 (en) * 2002-09-04 2008-05-27 Microsoft Corporation Multi-resolution video coding and decoding
US20040264579A1 (en) * 2003-06-30 2004-12-30 Sandeep Bhatia System, method, and apparatus for displaying a plurality of video streams
US7822123B2 (en) * 2004-10-06 2010-10-26 Microsoft Corporation Efficient repeat padding for hybrid video sequence with arbitrary video resolution
BRPI0414397A (en) * 2003-09-17 2006-11-21 Thomson Licensing adaptive reference imaging
US7649539B2 (en) * 2004-03-10 2010-01-19 Microsoft Corporation Image formats for video capture, processing and display
US8340177B2 (en) * 2004-07-12 2012-12-25 Microsoft Corporation Embedded base layer codec for 3D sub-band coding
US8442108B2 (en) * 2004-07-12 2013-05-14 Microsoft Corporation Adaptive updates in motion-compensated temporal filtering
US8374238B2 (en) * 2004-07-13 2013-02-12 Microsoft Corporation Spatial scalability in 3D sub-band decoding of SDMCTF-encoded video
US8243820B2 (en) * 2004-10-06 2012-08-14 Microsoft Corporation Decoding variable coded resolution video with native range/resolution post-processing operation
US9071847B2 (en) * 2004-10-06 2015-06-30 Microsoft Technology Licensing, Llc Variable coding resolution in video codec
US7839933B2 (en) * 2004-10-06 2010-11-23 Microsoft Corporation Adaptive vertical macroblock alignment for mixed frame video sequences
KR100722972B1 (en) * 2004-10-26 2007-05-30 삼성전자주식회사 Device and method for processing image signal in digital broadcasting receiver
CN101185338B (en) * 2005-05-25 2010-11-24 Nxp股份有限公司 Multiple instance video decoder for macroblocks coded in a progressive and an interlaced way
US7956930B2 (en) 2006-01-06 2011-06-07 Microsoft Corporation Resampling and picture resizing operations for multi-resolution video coding and decoding
US8880571B2 (en) * 2006-05-05 2014-11-04 Microsoft Corporation High dynamic range data format conversions for digital media
US8054886B2 (en) 2007-02-21 2011-11-08 Microsoft Corporation Signaling and use of chroma sample positioning information
US8107571B2 (en) * 2007-03-20 2012-01-31 Microsoft Corporation Parameterized filters and signaling techniques
CN101472179A (en) * 2007-12-29 2009-07-01 辉达公司 Two-dimension interpolation structure for movement compensation of multiple video standards
US8953673B2 (en) 2008-02-29 2015-02-10 Microsoft Corporation Scalable video coding and decoding with sample bit depth and chroma high-pass residual layers
US8711948B2 (en) * 2008-03-21 2014-04-29 Microsoft Corporation Motion-compensated prediction of inter-layer residuals
US9571856B2 (en) 2008-08-25 2017-02-14 Microsoft Technology Licensing, Llc Conversion operations in scalable video encoding and decoding
US8213503B2 (en) 2008-09-05 2012-07-03 Microsoft Corporation Skip modes for inter-layer residual video coding and decoding
US8339512B2 (en) 2009-03-05 2012-12-25 Sony Corporation Method and apparatus for enhancement of high-definition video content
CN113302934B (en) * 2019-12-23 2022-10-18 Oppo广东移动通信有限公司 Image prediction method, encoder, decoder, and storage medium

Citations (13)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5262854A (en) * 1992-02-21 1993-11-16 Rca Thomson Licensing Corporation Lower resolution HDTV receivers
US5644361A (en) * 1994-11-30 1997-07-01 National Semiconductor Corporation Subsampled frame storage technique for reduced memory size
US5818530A (en) * 1996-06-19 1998-10-06 Thomson Consumer Electronics, Inc. MPEG compatible decoder including a dual stage data reduction network
US6061402A (en) * 1994-10-11 2000-05-09 Hitachi America, Ltd. Methods and apparatus for efficiently decoding bi-directionally coded image data
US6233277B1 (en) * 1999-04-02 2001-05-15 Sony Corporation Reduced-memory video decoder for compressed high-definition video data
US6310919B1 (en) * 1998-05-07 2001-10-30 Sarnoff Corporation Method and apparatus for adaptively scaling motion vector information in an information stream decoder
US6442201B2 (en) * 1997-08-13 2002-08-27 Lg Electronics Inc. Down conversion decoding device of digital television
US6487248B1 (en) * 1998-02-20 2002-11-26 Lg Electronics Inc. Video decoding device of a TV receiver
US6493391B1 (en) * 1998-07-23 2002-12-10 Sony Corporation Picture decoding method and apparatus
US6539120B1 (en) * 1997-03-12 2003-03-25 Matsushita Electric Industrial Co., Ltd. MPEG decoder providing multiple standard output signals
US6584154B1 (en) * 1998-11-26 2003-06-24 Oki Electric Industry Co., Ltd. Moving-picture coding and decoding method and apparatus with reduced computational cost
US6628714B1 (en) * 1998-12-18 2003-09-30 Zenith Electronics Corporation Down converting MPEG encoded high definition sequences to lower resolution with reduced memory in decoder loop
US6823014B2 (en) * 2000-07-27 2004-11-23 Lg Electronics Inc. Video decoder with down conversion function and method for decoding video signal

Patent Citations (13)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5262854A (en) * 1992-02-21 1993-11-16 Rca Thomson Licensing Corporation Lower resolution HDTV receivers
US6061402A (en) * 1994-10-11 2000-05-09 Hitachi America, Ltd. Methods and apparatus for efficiently decoding bi-directionally coded image data
US5644361A (en) * 1994-11-30 1997-07-01 National Semiconductor Corporation Subsampled frame storage technique for reduced memory size
US5818530A (en) * 1996-06-19 1998-10-06 Thomson Consumer Electronics, Inc. MPEG compatible decoder including a dual stage data reduction network
US6539120B1 (en) * 1997-03-12 2003-03-25 Matsushita Electric Industrial Co., Ltd. MPEG decoder providing multiple standard output signals
US6442201B2 (en) * 1997-08-13 2002-08-27 Lg Electronics Inc. Down conversion decoding device of digital television
US6487248B1 (en) * 1998-02-20 2002-11-26 Lg Electronics Inc. Video decoding device of a TV receiver
US6310919B1 (en) * 1998-05-07 2001-10-30 Sarnoff Corporation Method and apparatus for adaptively scaling motion vector information in an information stream decoder
US6493391B1 (en) * 1998-07-23 2002-12-10 Sony Corporation Picture decoding method and apparatus
US6584154B1 (en) * 1998-11-26 2003-06-24 Oki Electric Industry Co., Ltd. Moving-picture coding and decoding method and apparatus with reduced computational cost
US6628714B1 (en) * 1998-12-18 2003-09-30 Zenith Electronics Corporation Down converting MPEG encoded high definition sequences to lower resolution with reduced memory in decoder loop
US6233277B1 (en) * 1999-04-02 2001-05-15 Sony Corporation Reduced-memory video decoder for compressed high-definition video data
US6823014B2 (en) * 2000-07-27 2004-11-23 Lg Electronics Inc. Video decoder with down conversion function and method for decoding video signal

Cited By (13)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20060023784A1 (en) * 2004-07-30 2006-02-02 Broadcom Corporation Tertiary content addressable memory based motion estimator
US7986733B2 (en) * 2004-07-30 2011-07-26 Broadcom Corporation Tertiary content addressable memory based motion estimator
US20060192706A1 (en) * 2005-02-28 2006-08-31 Sanyo Electric Co., Ltd. High frequency compensator and reproducing device
CN101189879B (en) * 2005-06-01 2010-11-24 三叉微系统(远东)有限公司 Multiple pass video decoding method and device
US20100135414A1 (en) * 2005-06-01 2010-06-03 Nxp B.V. Multiple pass video decoding method and device
WO2006129266A3 (en) * 2005-06-01 2007-06-21 Nxp Bv Multiple pass video decoding method and device
WO2006129266A2 (en) * 2005-06-01 2006-12-07 Nxp B.V. Multiple pass video decoding method and device
US8520741B2 (en) 2005-06-01 2013-08-27 Entropic Communications, Inc. Multiple pass video decoding method and device
US20100238355A1 (en) * 2007-09-10 2010-09-23 Volker Blume Method And Apparatus For Line Based Vertical Motion Estimation And Compensation
US8526502B2 (en) * 2007-09-10 2013-09-03 Entropic Communications, Inc. Method and apparatus for line based vertical motion estimation and compensation
US20110044410A1 (en) * 2008-04-24 2011-02-24 Jang Euee-Seon Device and method for encoding/decoding
US20130129326A1 (en) * 2010-08-04 2013-05-23 Nxp B.V. Video player
US10257524B2 (en) * 2015-07-01 2019-04-09 Mediatek Inc. Residual up-sampling apparatus for performing transform block up-sampling and residual down-sampling apparatus for performing transform block down-sampling

Also Published As

Publication number Publication date
KR20020009909A (en) 2002-02-02
US20020037053A1 (en) 2002-03-28
KR100370076B1 (en) 2003-01-30
US6823014B2 (en) 2004-11-23

Similar Documents

Publication Publication Date Title
US6823014B2 (en) Video decoder with down conversion function and method for decoding video signal
US7054366B2 (en) Systems and methods for MPEG subsample decoding
US6028635A (en) Reducing the memory required for decompression by storing compressed information using DCT based techniques
US6104753A (en) Device and method for decoding HDTV video
KR100574415B1 (en) Multiple standard decompression and / or compression units
US6917652B2 (en) Device and method for decoding video signal
US7088775B2 (en) Apparatus and method for converting image data
US6256045B1 (en) Device and method for processing picture in MPEG decoder
US6665343B1 (en) Methods and arrangements for a converting a high definition image to a lower definition image using wavelet transforms
KR20040013765A (en) Video decoding system
US20010016010A1 (en) Apparatus for receiving digital moving picture
JP2001285863A (en) Device and method for converting image information
KR100282307B1 (en) Digital TV Receive Decoder Device
KR100323676B1 (en) Apparatus for receiving digital moving picture
KR100463515B1 (en) Video decoding system
KR100323688B1 (en) Apparatus for receiving digital moving picture
KR100734348B1 (en) apparatus for down conversion processing in DTV
KR100359824B1 (en) Apparatus for decoding video and method for the same
KR100255777B1 (en) Digital tv receiver decoder device
JP2002034046A (en) Method and device for converting image information
JP2002034041A (en) Method and device for converting image information
KR19990081408A (en) Digital TV Receive Decoder Device
KR19990081409A (en) Digital TV Receive Decoder Device
JP2003143603A (en) Image decoding apparatus

Legal Events

Date Code Title Description
STCB Information on status: application discontinuation

Free format text: ABANDONED -- FAILURE TO RESPOND TO AN OFFICE ACTION