US9438882B2 - Method for image prediction of multi-view video codec and computer readable recording medium therefor - Google Patents

Method for image prediction of multi-view video codec and computer readable recording medium therefor Download PDF

Info

Publication number
US9438882B2
US9438882B2 US14/460,945 US201414460945A US9438882B2 US 9438882 B2 US9438882 B2 US 9438882B2 US 201414460945 A US201414460945 A US 201414460945A US 9438882 B2 US9438882 B2 US 9438882B2
Authority
US
United States
Prior art keywords
base
view image
different
image
residual
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Ceased, expires
Application number
US14/460,945
Other versions
US20140355680A1 (en
Inventor
Ji-Ho Park
Byeong-Ho Choi
Yong-Hwan Kim
Je-woo Kim
Hwa-seon Shin
Yo-Sung Ho
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Korea Electronics Technology Institute
Original Assignee
Korea Electronics Technology Institute
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Korea Electronics Technology Institute filed Critical Korea Electronics Technology Institute
Priority to US14/460,945 priority Critical patent/US9438882B2/en
Assigned to KOREA ELECTRONICS TECHNOLOGY INSTITUTE reassignment KOREA ELECTRONICS TECHNOLOGY INSTITUTE ASSIGNMENT OF ASSIGNORS INTEREST (SEE DOCUMENT FOR DETAILS). Assignors: CHOI, BYEONG-HO, HO, YO-SUNG, KIM, JE-WOO, KIM, YONG-HWAN, PARK, JI-HO, SHIN, HWA-SEON
Publication of US20140355680A1 publication Critical patent/US20140355680A1/en
Application granted granted Critical
Publication of US9438882B2 publication Critical patent/US9438882B2/en
Priority to US16/123,956 priority patent/USRE47897E1/en
Ceased legal-status Critical Current
Adjusted expiration legal-status Critical

Links

Images

Classifications

    • H04N13/0048
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/10Processing, recording or transmission of stereoscopic or multi-view image signals
    • H04N13/106Processing image signals
    • H04N13/161Encoding, multiplexing or demultiplexing different image signal components
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00Stereoscopic video systems; Multi-view video systems; Details thereof
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/102Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or selection affected or controlled by the adaptive coding
    • H04N19/103Selection of coding mode or of prediction mode
    • H04N19/105Selection of the reference unit for prediction within a chosen coding or prediction mode, e.g. adaptive choice of position and number of pixels used for prediction
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/169Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding
    • H04N19/17Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object
    • H04N19/176Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object the region being a block, e.g. a macroblock
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/50Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/50Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding
    • H04N19/597Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding specially adapted for multi-view video sequence encoding
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/60Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using transform coding
    • H04N19/61Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using transform coding in combination with predictive coding

Definitions

  • the present disclosure relates to multi-view video coding, and more particularly, to a method for image prediction of a multi-view video codec and a computer readable recording medium therefore.
  • a multi-view video codec is a video codec that outputs a plurality of images captured from different views as one or multiple compressed bitstreams.
  • the multi-view video codec performs compression using a correlation between different views, i.e., inter-view correlation, as well as compression using spatial/temporal correlations, which is one of characteristics of a related-art video codec.
  • inter-view correlation a technique for effectively compressing images of different views must be added.
  • the related-art technique that uses the spatial/temporal correlation is still being used. In actuality, there is almost no technique that uses the inter-view correlation.
  • the related art multi-view video codec employing the existing H.264 standard, temporal prediction is conducted to remove temporal redundancy between images, thereby improving coding efficiency.
  • the related art multi-view video codec performs coding by using an image of a different view simply as a reference image, failing to perform inter-view motion compensation in due consideration of a disparity, which is a displacement value between views.
  • improvement of coding efficiency is limited because no technique is used for removing inter-view redundancy between images.
  • an object of the present invention is to provide a method for image prediction of a multi-view video codec capable of improving coding efficiency, and a computer readable recording medium therefor.
  • Another object of the present invention is to provide a method for image prediction of a multi-view video codec capable of effectively using images of multiple different views, and a computer readable recording medium therefor.
  • Another object of the present invention is to provide a method for image prediction of a multi-view video codec capable of proposing a new prediction scheme suitable for multi-view video coding, and a computer readable recording medium therefor.
  • a method for image prediction of a multi-view video codec in accordance with an aspect of the present invention includes: partitioning an image to a plurality of base blocks; acquiring information of reference images which are temporally different; acquiring information of reference images which have different views; and predicting a target block based on the acquired information.
  • a computer-readable recording medium storing a program for executing image prediction of a multi-view video codec in accordance with another aspect of the present invention, wherein the image prediction includes partitioning a target image to a plurality of base blocks; acquiring information of reference images which are temporally different; acquiring information of reference images which have different views; and predicting a target block based on the acquired information.
  • FIG. 1 is a flowchart illustrating a method for image prediction of a multi-view video codec according to an embodiment of the present invention
  • FIG. 2 illustrates an image reference structure in the method for image prediction of a multi-view video codec according to the embodiment of the present invention
  • FIG. 3 illustrates encoding/decoding using residual information of a macroblock according to an embodiment of the present invention
  • FIG. 4 illustrates a weighting value reference model according to an embodiment of the present invention.
  • a codec that supports multi-view prediction can be performed based on images of multiple different views, besides using a technique employed in the related-art two-dimensional codec.
  • the prediction based on images of multiple different views must be concerned with how to obtain the most similar image to an image of a view to be currently compressed, using multiple images of different views.
  • MVC multi-view codec
  • a technique using images having multiple different views has not yet been employed therein. For this reason, a technique for effectively compressing an image of a view to be currently compressed, based on images of different views will be described according to embodiments of the present invention.
  • a method for image prediction of a multi-view video codec according to exemplary embodiments of the present invention can be realized as programs and stored in a computer-readable recording medium that can execute the programs.
  • a computer or an equivalent digital device operates the programs for execution of the method for image prediction of a multi-view video codec according to the exemplary embodiments of the present invention.
  • control unit a control means of an arithmetic device.
  • FIG. 1 is a flowchart of a method for image prediction of a multi-view video codec according to an embodiment of the present invention
  • FIG. 2 illustrates an image reference structure according to the embodiment of the present invention.
  • a control unit partitions a target image to a number of base blocks suitably for block-unit compression.
  • two prediction methods may be used for a block 210 to be currently encoded/decoded (hereinafter, referred to as a target block).
  • One of the prediction methods computes a temporal difference value with a reference image to obtain motion information, reference-image information and a difference value between images.
  • the other method uses an image of a different view as a reference image to obtain motion information, and reference image information.
  • reference blocks 220 and 230 are images that the target block 210 references
  • residual blocks 240 and 250 are residual images that the target block references 210 .
  • the residual means a difference between an original image and an encoded image, which is resulted from quantization of an encoding process.
  • the control unit acquires information of reference images that are temporally different (hereinafter, referred to as temporally different reference images). That is, a temporal difference value with a reference image is computed to acquire motion information and reference-image information.
  • the target block 210 uses a temporally different image as a reference image, the target image can acquire motion information and a residual associated with the referenced image.
  • the residual information does not include a temporal correlation but include an inter-view correlation.
  • information quantity can be reduced by just addition or subtraction with residual information of an image having a different view.
  • information reporting the use of the residual information of the different-view image may be added at the time of encoding.
  • the information reporting the use of the residual information may be contained in macroblock layer or a higher layer.
  • residual information pieces of multiple images having different views Even if residual information pieces of multiple images having different views are present, residual information of an image that is most similar to the target block 210 in terms of view may be used. Also, optimum residual information may be selected among residual information pieces of multiple images having different views. In this case, information that reports view information of the image of the residual information being used may be added. For example, information reporting the use of residual information of VIEW3 may be added. The information reporting the use of the residual information of the image having a specific view may be contained in a macroblock or a higher layer.
  • new residual information may be used, which is obtained by combining optimum residual information pieces among the residual information pieces of images having different views.
  • a mean value of the residual information pieces between at least two selected images having two different views may be used as the residual information, or new residual information may be generated by applying a low-pass filter (LPF) such as a deblocking filter to the mean value obtained in the aforementioned manner.
  • LPF low-pass filter
  • the control unit acquires information of reference images having different views. That is, a difference value with a reference image having a different view is computed to acquire motion information and reference-image information.
  • the target block 210 uses an image having a different view as a reference image, the target image can obtain motion information and residual information with respect to the referenced image.
  • a method of using residual information present in a temporally different image is provided so as to minimize residual information to be currently encoded/decoded.
  • the residual information does not include an inter-view (spatial) correlation but include a temporal correlation.
  • the image quantity can be reduced by just addition or subtraction with the residual of the temporally different image.
  • information reporting the use of the residual information of the temporally different image can be added at the time of encoding.
  • the information reporting the use of the residual may be contained in a macroblock layer or a higher layer.
  • residual information of an image that is most similar to the target block 210 in terms of time may be used. Also, optimum residual information may be selected among the residual information pieces of the temporally different images. In this case, information reporting the time of the image of the residual information may be added. The information reporting the use of the residual information of the image of the specific time may be contained in a macroblock or a higher layer.
  • new residual information may be used, which is obtained by combining optimum residual information pieces among the residual information pieces of the multiple temporally different images.
  • the mean value of the residual information pieces between two temporally different images may be used as the residual information, or new residual information may be generated by applying a filter to the mean value obtained in the aforementioned manner.
  • a location obtained by computation using a global disparity may be used as a reference residual block of the target block 210 .
  • ResPred is inferred as 0. It can be located in slice layer or higher layer (SPS (Sequence Parameter Set), SPSE (SPS Extension), PPS (Picture Parameter Set), PPSE (PPS Extension), slice header, slice header extension, SEI (Supplementary Enhancement Information)).
  • SPS Sequence Parameter Set
  • SPSE SPS Extension
  • PPS Picture Parameter Set
  • PPSE PPS Extension
  • slice header slice header extension
  • SEI Supplemental Enhancement Information
  • ResPredFlag is equal to 1” specifies that the residual signal is predicted by the reconstructed residual signal of neighbor view or temporally collocated macroblock, if possible, with the considering of the global disparity. “ResPredFlag is equal to 0” specifies any residual signal is not predicted. When ViewPredFlag is not present, ViewPredFlag is inferred as 0. ⁇
  • control unit predicts the target block based on the acquired information pieces. That is, those information pieces are contained as prediction information of a corresponding image at the time of encoding, and the prediction is performed based on the prediction information at the time of decoding. This will now be described with reference to FIG. 3 in more detail.
  • FIG. 3 illustrates encoding/decoding using residual information of a macroblock according to the embodiment of the present invention.
  • a disparity corresponding to a target macroblock 310 indicates a reference macroblock 320
  • residual information at time (t) is generated using motion information of the reference macroblock
  • a difference value with residual information generated by using motion information of a target macroblock is encoded/decoded.
  • information reporting the use of the residual information may be contained in a residual data layer.
  • a value transmitted to a slice header or a value computed by a time interval with a transmitted slice may be used as a disparity.
  • Pred F (Pred′+Res′) (2)
  • Pred is obtained by applying a proper filter, e.g., an LPF such as a deblocking filter in H.264, to a value obtained by adding a residual to a certain reference image.
  • a proper filter e.g., an LPF such as a deblocking filter in H.264
  • Equation (3) is rearranged with respect to the terms Pred′ and Res′ by distributing F, F(Pred′) is represented by Pred, and Res is represented by F(Res′)+Res′′.
  • F(Pred′) is represented by Pred
  • Res is represented by F(Res′)+Res′′.
  • the term Res′ is obtained from a view domain
  • the term Res′ is obtained from a temporal domain
  • F( ) which is a filter suitable for the obtained term Res′ may be additionally used.
  • the simplest filter having a filter coefficient ⁇ 1 ⁇ 2, 1 ⁇ 2 ⁇ may be used, or a filter such as 1/20 ⁇ 1, ⁇ 4. 20, 20, ⁇ 4, 1 ⁇ may be used.
  • NewPred is equal to 1
  • NewPred is equal to 0
  • NewPred specifies that the current slice does not use new view prediction method according to the present invention.
  • NewPred is inferred as 0. It can be located in slice layer or higher layer (SPS, PPS, Slice header, slice header extension, SEI).
  • the current macroblock is coded by inter-view mode (view direction)
  • residual signal of collocated block(s) and reference block of the current macroblock(s) is used as the predictor (Deblocking filter can be applied on the predictor.)
  • ResPredFlag is equal to 0” specifies any residual signal is not predicted. When ViewPredFlag is not present, ViewPredFlag is inferred as 0. ⁇ .
  • a weighting value or a weighted prediction value may be established. For example, if an image has a certain temporal characteristic such as image fading in/out, a weighting value of an image of a different view may be used.
  • the weighting value means information indicating an extent to which image brightness or chrominance signals change over time as illustrated in FIG. 4 .
  • FIG. 4 illustrates a weighting-value reference model according to the embodiment of the present invention.
  • an encoder may send a proper weighting value to a decoder so that the decoder can collectively apply the weighting value to the images of the different views.
  • weighting information may be defined for each view.
  • this method may be inefficient because multiple redundant information pieces may be transmitted.
  • weighting information in order to reduce redundant information and overcome a limitation caused by using different light sources, a weighting value of a specific view such as a BaseView or VIEW0 of FIG. 4 is shared, and information reporting whether weighting values of different views are used as they are (hereinafter, referred to as weighting information) is used.
  • images of VIEW1 may contain weighting information reporting the use of a weighting value of BaseView (View0), and images of View2 may contain weighting information reporting the use of their own weighting values without using the weighting value of BaseView.
  • the weighting information is inserted in a bit stream to prevent mutual mis-operation between an encoder and a decoder.
  • the weighting information may be contained in a slice header, a slice header extension or a higher layer such as PPS, PPSE, SPS, SPSE or SEI.
  • baseview_pred_weight_table_flag ⁇ “baseview_pred_weight_table_flag is equal to 1” specifies that the variables for weighted prediction are inferred.
  • baseview_pred_weight_table_flag When baseview_pred_weight_table_flag is not present, it shall be inferred as follows:
  • base_pred_weight_table_flag (which indicates whether baseview or not) is equal to 0.
  • baseview_pred_weight_table_flag shall be inferred to be equal to 1. ⁇ .
  • an image that is most similar to an image of a view to be currently compressed is generated by using inter-view prediction, i.e., using images of multiple different views, thereby improving coding efficiency.
  • the methods for image prediction of a multi-view video codec can be realized as programs and stored in a computer-readable recording medium that can execute the programs.
  • Examples of the computer-readable recording medium include CD-ROM, RAM, ROM, floppy disks, hard disks, magneto-optical disks and the like.

Abstract

Provided are a method for image prediction of a multi-view video codec capable of improving coding efficiency, and a computer readable recording medium therefor. The method for image prediction of a multi-view video codec includes partitioning an image to a plurality of base blocks, acquiring information of reference images which are temporally different, acquiring information of reference images which have different views, and predicting a target block based on the acquired information. Accordingly, an image that is most similar to an image of a view to be currently compressed is generated using multiple images of different views, so that coding efficiency can be improved.

Description

CROSS-REFERENCE TO RELATED APPLICATIONS
This is a Continuation of application Ser. No. 11/972,794 filed Jan. 11, 2008, which claims priority under 35 U.S.C. §119 to U.S. Provisional Application Nos. 60/884,495 and 60/886,759, filed on Jan. 11, 2007 and Jan. 26, 2007, the disclosure of which is incorporated herein by reference in its entirety.
BACKGROUND OF THE INVENTION
1. Field of the Invention
The present disclosure relates to multi-view video coding, and more particularly, to a method for image prediction of a multi-view video codec and a computer readable recording medium therefore.
2. Description of the Related Art
A multi-view video codec is a video codec that outputs a plurality of images captured from different views as one or multiple compressed bitstreams. The multi-view video codec performs compression using a correlation between different views, i.e., inter-view correlation, as well as compression using spatial/temporal correlations, which is one of characteristics of a related-art video codec. In the multi-view video codec, a technique for effectively compressing images of different views must be added. However, in most cases, the related-art technique that uses the spatial/temporal correlation is still being used. In actuality, there is almost no technique that uses the inter-view correlation.
In the related art multi-view video codec employing the existing H.264 standard, temporal prediction is conducted to remove temporal redundancy between images, thereby improving coding efficiency. However, the related art multi-view video codec performs coding by using an image of a different view simply as a reference image, failing to perform inter-view motion compensation in due consideration of a disparity, which is a displacement value between views. Thus, improvement of coding efficiency is limited because no technique is used for removing inter-view redundancy between images.
SUMMARY
Therefore, an object of the present invention is to provide a method for image prediction of a multi-view video codec capable of improving coding efficiency, and a computer readable recording medium therefor.
Another object of the present invention is to provide a method for image prediction of a multi-view video codec capable of effectively using images of multiple different views, and a computer readable recording medium therefor.
Another object of the present invention is to provide a method for image prediction of a multi-view video codec capable of proposing a new prediction scheme suitable for multi-view video coding, and a computer readable recording medium therefor.
To achieve these and other advantages and in accordance with the purpose(s) of the present invention as embodied and broadly described herein, a method for image prediction of a multi-view video codec in accordance with an aspect of the present invention includes: partitioning an image to a plurality of base blocks; acquiring information of reference images which are temporally different; acquiring information of reference images which have different views; and predicting a target block based on the acquired information.
To achieve these and other advantages and in accordance with the purpose(s) of the present invention, there is provided a computer-readable recording medium storing a program for executing image prediction of a multi-view video codec in accordance with another aspect of the present invention, wherein the image prediction includes partitioning a target image to a plurality of base blocks; acquiring information of reference images which are temporally different; acquiring information of reference images which have different views; and predicting a target block based on the acquired information.
The foregoing and other objects, features, aspects and advantages of the present invention will become more apparent from the following detailed description of the present invention when taken in conjunction with the accompanying drawings.
BRIEF DESCRIPTION OF THE DRAWINGS
The accompanying drawings, which are included to provide a further understanding of the invention and are incorporated in and constitute a part of this specification, illustrate embodiments of the invention and together with the description serve to explain the principles of the invention.
FIG. 1 is a flowchart illustrating a method for image prediction of a multi-view video codec according to an embodiment of the present invention;
FIG. 2 illustrates an image reference structure in the method for image prediction of a multi-view video codec according to the embodiment of the present invention;
FIG. 3 illustrates encoding/decoding using residual information of a macroblock according to an embodiment of the present invention; and
FIG. 4 illustrates a weighting value reference model according to an embodiment of the present invention.
DETAILED DESCRIPTION OF EMBODIMENTS
In a codec that supports multi-view, prediction can be performed based on images of multiple different views, besides using a technique employed in the related-art two-dimensional codec. The prediction based on images of multiple different views must be concerned with how to obtain the most similar image to an image of a view to be currently compressed, using multiple images of different views. Even if a multi-view codec (MVC) is also a codec that supports multi-view, a technique using images having multiple different views has not yet been employed therein. For this reason, a technique for effectively compressing an image of a view to be currently compressed, based on images of different views will be described according to embodiments of the present invention.
A method for image prediction of a multi-view video codec according to exemplary embodiments of the present invention can be realized as programs and stored in a computer-readable recording medium that can execute the programs. A computer or an equivalent digital device operates the programs for execution of the method for image prediction of a multi-view video codec according to the exemplary embodiments of the present invention. Thus, description will be made on the assumption that the operations are performed by a control means (hereinafter, referred to as a ‘control unit’) of an arithmetic device.
Hereinafter, specific embodiments will be described in detail with reference to the accompanying drawings. Like reference numerals refer to like elements throughout. In some embodiments, well-known processes, well-known device structures, and well-known techniques will not be described in detail to avoid ambiguous interpretation of the present invention.
FIG. 1 is a flowchart of a method for image prediction of a multi-view video codec according to an embodiment of the present invention, and FIG. 2 illustrates an image reference structure according to the embodiment of the present invention. In operation S110, a control unit partitions a target image to a number of base blocks suitably for block-unit compression.
As illustrated in FIG. 2, two prediction methods may be used for a block 210 to be currently encoded/decoded (hereinafter, referred to as a target block). One of the prediction methods computes a temporal difference value with a reference image to obtain motion information, reference-image information and a difference value between images. The other method uses an image of a different view as a reference image to obtain motion information, and reference image information. In the drawing, reference blocks 220 and 230 are images that the target block 210 references, and residual blocks 240 and 250 are residual images that the target block references 210. The residual means a difference between an original image and an encoded image, which is resulted from quantization of an encoding process.
In operation S120, the control unit acquires information of reference images that are temporally different (hereinafter, referred to as temporally different reference images). That is, a temporal difference value with a reference image is computed to acquire motion information and reference-image information. When the target block 210 uses a temporally different image as a reference image, the target image can acquire motion information and a residual associated with the referenced image.
The residual information does not include a temporal correlation but include an inter-view correlation. Thus, information quantity can be reduced by just addition or subtraction with residual information of an image having a different view. In this case, for a decoding operation, information reporting the use of the residual information of the different-view image may be added at the time of encoding. The information reporting the use of the residual information may be contained in macroblock layer or a higher layer.
Even if residual information pieces of multiple images having different views are present, residual information of an image that is most similar to the target block 210 in terms of view may be used. Also, optimum residual information may be selected among residual information pieces of multiple images having different views. In this case, information that reports view information of the image of the residual information being used may be added. For example, information reporting the use of residual information of VIEW3 may be added. The information reporting the use of the residual information of the image having a specific view may be contained in a macroblock or a higher layer.
Also, new residual information may be used, which is obtained by combining optimum residual information pieces among the residual information pieces of images having different views. For example, a mean value of the residual information pieces between at least two selected images having two different views may be used as the residual information, or new residual information may be generated by applying a low-pass filter (LPF) such as a deblocking filter to the mean value obtained in the aforementioned manner.
In operation S130, the control unit acquires information of reference images having different views. That is, a difference value with a reference image having a different view is computed to acquire motion information and reference-image information. When the target block 210 uses an image having a different view as a reference image, the target image can obtain motion information and residual information with respect to the referenced image.
According to the embodiment of the present invention, to minimize this residual information, a method of using residual information present in a temporally different image is provided so as to minimize residual information to be currently encoded/decoded. Here, the residual information does not include an inter-view (spatial) correlation but include a temporal correlation. The image quantity can be reduced by just addition or subtraction with the residual of the temporally different image. In this case, for decoding, information reporting the use of the residual information of the temporally different image can be added at the time of encoding. The information reporting the use of the residual may be contained in a macroblock layer or a higher layer.
Even if residual information pieces of multiple temporally different images are present, residual information of an image that is most similar to the target block 210 in terms of time may be used. Also, optimum residual information may be selected among the residual information pieces of the temporally different images. In this case, information reporting the time of the image of the residual information may be added. The information reporting the use of the residual information of the image of the specific time may be contained in a macroblock or a higher layer.
Also, new residual information may be used, which is obtained by combining optimum residual information pieces among the residual information pieces of the multiple temporally different images. For example, the mean value of the residual information pieces between two temporally different images may be used as the residual information, or new residual information may be generated by applying a filter to the mean value obtained in the aforementioned manner.
A location obtained by computation using a global disparity may be used as a reference residual block of the target block 210.
To report the application of the above techniques, information of the following exemplary format may be used:
{“ResPred is equal to 1” specifies that the current slice uses view residual prediction method. “ResPred is equal to 0” specifies that the current slice does not use view residual prediction method. When ResPred is not present, ResPred is inferred as 0. It can be located in slice layer or higher layer (SPS (Sequence Parameter Set), SPSE (SPS Extension), PPS (Picture Parameter Set), PPSE (PPS Extension), slice header, slice header extension, SEI (Supplementary Enhancement Information)).
“ResPredFlag is equal to 1” specifies that the residual signal is predicted by the reconstructed residual signal of neighbor view or temporally collocated macroblock, if possible, with the considering of the global disparity. “ResPredFlag is equal to 0” specifies any residual signal is not predicted. When ViewPredFlag is not present, ViewPredFlag is inferred as 0.}
In operation S140, the control unit predicts the target block based on the acquired information pieces. That is, those information pieces are contained as prediction information of a corresponding image at the time of encoding, and the prediction is performed based on the prediction information at the time of decoding. This will now be described with reference to FIG. 3 in more detail.
FIG. 3 illustrates encoding/decoding using residual information of a macroblock according to the embodiment of the present invention. Referring to FIG. 3, if a disparity corresponding to a target macroblock 310 indicates a reference macroblock 320, residual information at time (t) is generated using motion information of the reference macroblock, and a difference value with residual information generated by using motion information of a target macroblock is encoded/decoded. In this case, information reporting the use of the residual information may be contained in a residual data layer. Also, a value transmitted to a slice header or a value computed by a time interval with a transmitted slice may be used as a disparity.
According to another embodiment, a target block 210 may be expressed as the following Equation (1):
Recon=Pred+Res  (1)
where Pred denotes a reference image of a specific size, which is most similar to a target block 210 of FIG. 2 in a temporal/spatial domain and can be represented by motion information, and Res denotes residual information indicating a difference between a reference image and a target block 210.
According to the embodiment of the present invention, to minimize this residual information, a method of using residual information present in an image having a different view is proposed, thereby reducing the residual information being currently encoded/decoded. A video codec can be implemented such that Pred is properly selected to minimize Res. As Pred in the multi-view codec, an image that is proper in terms of view or time may be used. Pred may be defined by the following Equation (2):
Pred=F(Pred′+Res′)  (2)
That is, Pred is obtained by applying a proper filter, e.g., an LPF such as a deblocking filter in H.264, to a value obtained by adding a residual to a certain reference image.
When Equation (2) is applied to Equation (1), the following Equation (3) can be obtained:
Recon=F(Pred′+Res′)+Res″  (3)
where Pred′ and Res′ are a reference image and a residual of an image that the target block 210 references, respectively. A combination of Pred′ and Res′ that are properly induced is used as a reference image of a current image, i.e., a target image, and residual information therebetween is minimized.
If Equation (3) is rearranged with respect to the terms Pred′ and Res′ by distributing F, F(Pred′) is represented by Pred, and Res is represented by F(Res′)+Res″. Thus, a gain is obtained by transmitting Res″ instead of Res as in the related art.
If Pred acquires a reference image in a temporal domain, the term Res′ is obtained from a view domain, whereas if Pred acquires a reference image in a view domain, the term Res′ is obtained from a temporal domain. F( ), which is a filter suitable for the obtained term Res′ may be additionally used. For example, the simplest filter having a filter coefficient {½, ½} may be used, or a filter such as 1/20{1, −4. 20, 20, −4, 1} may be used.
To report the application of the above techniques, information of the following exemplary format may be used:
{“NewPred is equal to 1” specifies that the current slice uses new view prediction method according to the present invention. “NewPred is equal to 0” specifies that the current slice does not use new view prediction method according to the present invention. When NewPred is not present, NewPred is inferred as 0. It can be located in slice layer or higher layer (SPS, PPS, Slice header, slice header extension, SEI).
“ResPredFlag is equal to 1” specifies that the predictor of the current macroblock is derivate as following,
If the current macroblock is coded by inter mode (temporal direction), residual signal of neighbor view(s) and reference block of the current macroblock(s) are used as the predictor (Deblocking filter can be applied on the predictor).
Otherwise (the current macroblock is coded by inter-view mode (view direction)), residual signal of collocated block(s) and reference block of the current macroblock(s) is used as the predictor (Deblocking filter can be applied on the predictor.)
if possible, with the considering of the global disparity. “ResPredFlag is equal to 0” specifies any residual signal is not predicted. When ViewPredFlag is not present, ViewPredFlag is inferred as 0.}.
According to another embodiment of the present invention, a weighting value or a weighted prediction value may be established. For example, if an image has a certain temporal characteristic such as image fading in/out, a weighting value of an image of a different view may be used. The weighting value means information indicating an extent to which image brightness or chrominance signals change over time as illustrated in FIG. 4. FIG. 4 illustrates a weighting-value reference model according to the embodiment of the present invention.
In general, even if images have different views, they may have similar temporal characteristics. That is, in the case where images are gradually brightened, an encoder may send a proper weighting value to a decoder so that the decoder can collectively apply the weighting value to the images of the different views.
If a different light source is used for each view, it may be difficult to collectively apply the weighting value. In this case, a new weighting value must be used.
As the simplest implementation method, weighting information may be defined for each view. However, this method may be inefficient because multiple redundant information pieces may be transmitted.
According to the embodiment of the present invention, in order to reduce redundant information and overcome a limitation caused by using different light sources, a weighting value of a specific view such as a BaseView or VIEW0 of FIG. 4 is shared, and information reporting whether weighting values of different views are used as they are (hereinafter, referred to as weighting information) is used.
For example, as illustrated in FIG. 4, images of VIEW1 may contain weighting information reporting the use of a weighting value of BaseView (View0), and images of View2 may contain weighting information reporting the use of their own weighting values without using the weighting value of BaseView.
The weighting information is inserted in a bit stream to prevent mutual mis-operation between an encoder and a decoder. The weighting information may be contained in a slice header, a slice header extension or a higher layer such as PPS, PPSE, SPS, SPSE or SEI.
To report the application of the above techniques, information of the following exemplary format may be used:
{“baseview_pred_weight_table_flag is equal to 1” specifies that the variables for weighted prediction are inferred. When baseview_pred_weight_table_flag is not present, it shall be inferred as follows:
If baseViewFlag (which indicates whether baseview or not) is equal to 1, base_pred_weight_table_flag shall be inferred to be equal to 0.
Otherwise, baseview_pred_weight_table_flag shall be inferred to be equal to 1.}.
The method for image prediction of a multi-view video codec and the computer readable recording medium therefor according to the embodiments of the present invention, an image that is most similar to an image of a view to be currently compressed is generated by using inter-view prediction, i.e., using images of multiple different views, thereby improving coding efficiency.
The methods for image prediction of a multi-view video codec according to the exemplary embodiments can be realized as programs and stored in a computer-readable recording medium that can execute the programs. Examples of the computer-readable recording medium include CD-ROM, RAM, ROM, floppy disks, hard disks, magneto-optical disks and the like.
As the present invention may be embodied in several forms without departing from the spirit or essential characteristics thereof, it should also be understood that the above-described embodiments are not limited by any of the details of the foregoing description, unless otherwise specified, but rather should be construed broadly within its spirit and scope as defined in the appended claims, and therefore all changes and modifications that fall within the metes and bounds of the claims, or equivalents of such metes and bounds are therefore intended to be embraced by the appended claims.

Claims (17)

What is claimed is:
1. A method for image prediction of a multi-view video codec, which encodes multi-view images comprising a base-view image and at least one different-view image which is captured from a different viewpoint from a viewpoint capturing the base-view image, the base-view image and the different-view image being captured at a same time, the method comprising:
partitioning the base-view image into a plurality of base blocks;
predicting a base block among the base blocks based on the different-view image and a different-time image Which is captured at a time different from a time when the base-view image is captured, the base-view image and the different-time image being captured from a same viewpoint;
acquiring a difference between a prediction result of the base block and the base block, and encoding the difference; and
generating a bitstream comprising the encoded difference,
wherein the predicting the base block comprises using at least one of a first residual adjusted using a second residual and the second residual adjusted using the first residual, and
wherein the first residual is a difference between the base-view image and the different-time image, and the second residual is a difference between the base-view image and the different-view image.
2. The method of claim 1, wherein information about the first residual and the second residual is contained in a macroblock layer or a higher layer than the macroblock layer.
3. The method of claim 2, wherein the higher layer than the macroblock layer is a slice header extension (SHE), a picture parameter set extension (PPSE), or a sequence parameter set extension (SPSE).
4. The method of claim 1, wherein the adjusted first residual is a result of adding the second residual to the first residual or subtracting the second residual from the first residual, and the adjusted second residual is a result of adding the first residual to the second residual or subtracting the first residual from the second residual.
5. The method of claim 1, wherein the predicting the base block based on the different-view image comprises performing weighted prediction by applying a weighting value to at least one of the base-view image and the different-view image.
6. The method of claim 5, wherein the generating the bitstream comprises including the weighting value in the bitstream.
7. The method of claim 5, wherein in the predicting the base block, a same weighting value is applied to both the base-view image and the different-view image.
8. The method of claim 5, wherein in the predicting the base block, different weighting values are applied to the base-view image and the different-view image, respectively.
9. The method of claim 5, wherein the generating the bitstream comprises including information about the weighted prediction in the bitstream.
10. The method of claim 1, wherein the different-time image is an image which is the most similar to the base-view image among a plurality of different-time images with respect to the base-view image, and the different-view image is an image which is the most-similar to the base-view image among a plurality of different-view images with respect to the base-view image.
11. A non-transitory computer-readable recording medium storing a program for executing a method for image prediction of a multi-view video codec, which encodes multi-view images comprising a base-view image and at least one different-view image which is captured from a different viewpoint from a viewpoint capturing the base-view image, the base-view image and the different-view image being captured at a same time, the method comprising:
partitioning the base view image into a plurality of base blocks;
predicting a base block among the base blocks based on the different-view image and a different-time image which is captured at a time different from a time when the base view image is captured, the base view image and the different-time image being captured from a same viewpoint;
acquiring a difference between a prediction result of the base block and the base block, and encoding the difference; and
generating a bitstream comprising the encoded difference,
wherein the predicting the base block comprises using at least one of a first residual adjusted using a second residual and a second residual adjusted using the first residual, and
wherein the first residual is a difference between the base-view image and the different-time image, and the second residual is a difference between the base-view image and the different-view image.
12. A method for image prediction of a multi-view video codec, which encodes multi-view images comprising a base-view image and at least one different-view image which is captured from a different viewpoint from a viewpoint capturing the base-view image, the base-view image and the different-view image being captured at a same time, the method comprising:
partitioning the base-view image into a plurality of base blocks;
predicting a base block among the base blocks based on the different-view image or a different-time image which is captured at a time different from a time when the base-view image is captured, the base-view image and the different-time image being captured from a same viewpoint;
acquiring a difference between a prediction result of the base block and the base block, and encoding the difference; and
generating a bitstream comprising the encoded difference,
wherein in case where the base block is predicted by using the different-view image, the predicting the base block comprises performing weighted prediction by applying at least one weighting value to the base-view image and the different-view image.
13. The method of claim 12, wherein the generating the bitstream comprises including the weighting value in the bitstream.
14. The method of claim 12, wherein in case where the base block is predicted by using the different-view image, a same weighting value is applied to both the base-view image and the different-view image.
15. The method of claim 12, wherein in case where the base block is predicted by using the different-view image, different weighting values are applied to the base-view image and the different-view image, respectively.
16. The method of claim 12, wherein in case where the base block is predicted by using the different-view image, the generating the bitstream comprises of including information about the weighted prediction in the bitstream.
17. The method of claim 12, wherein the different-time image is an image which is the most similar to the base-view image among a plurality of different-time images with respect to the base-view image, and the different-view image is an image which is the most-similar to the base-view image among a plurality of different-view images with respect to the base-view image.
US14/460,945 2007-01-11 2014-08-15 Method for image prediction of multi-view video codec and computer readable recording medium therefor Ceased US9438882B2 (en)

Priority Applications (2)

Application Number Priority Date Filing Date Title
US14/460,945 US9438882B2 (en) 2007-01-11 2014-08-15 Method for image prediction of multi-view video codec and computer readable recording medium therefor
US16/123,956 USRE47897E1 (en) 2007-01-11 2018-09-06 Method for image prediction of multi-view video codec and computer readable recording medium therefor

Applications Claiming Priority (4)

Application Number Priority Date Filing Date Title
US88449507P 2007-01-11 2007-01-11
US88675907P 2007-01-26 2007-01-26
US11/972,794 US20080170753A1 (en) 2007-01-11 2008-01-11 Method for Image Prediction of Multi-View Video Codec and Computer Readable Recording Medium Therefor
US14/460,945 US9438882B2 (en) 2007-01-11 2014-08-15 Method for image prediction of multi-view video codec and computer readable recording medium therefor

Related Parent Applications (1)

Application Number Title Priority Date Filing Date
US11/972,794 Continuation US20080170753A1 (en) 2007-01-11 2008-01-11 Method for Image Prediction of Multi-View Video Codec and Computer Readable Recording Medium Therefor

Related Child Applications (1)

Application Number Title Priority Date Filing Date
US16/123,956 Reissue USRE47897E1 (en) 2007-01-11 2018-09-06 Method for image prediction of multi-view video codec and computer readable recording medium therefor

Publications (2)

Publication Number Publication Date
US20140355680A1 US20140355680A1 (en) 2014-12-04
US9438882B2 true US9438882B2 (en) 2016-09-06

Family

ID=39617819

Family Applications (3)

Application Number Title Priority Date Filing Date
US11/972,794 Abandoned US20080170753A1 (en) 2007-01-11 2008-01-11 Method for Image Prediction of Multi-View Video Codec and Computer Readable Recording Medium Therefor
US14/460,945 Ceased US9438882B2 (en) 2007-01-11 2014-08-15 Method for image prediction of multi-view video codec and computer readable recording medium therefor
US16/123,956 Active 2028-03-07 USRE47897E1 (en) 2007-01-11 2018-09-06 Method for image prediction of multi-view video codec and computer readable recording medium therefor

Family Applications Before (1)

Application Number Title Priority Date Filing Date
US11/972,794 Abandoned US20080170753A1 (en) 2007-01-11 2008-01-11 Method for Image Prediction of Multi-View Video Codec and Computer Readable Recording Medium Therefor

Family Applications After (1)

Application Number Title Priority Date Filing Date
US16/123,956 Active 2028-03-07 USRE47897E1 (en) 2007-01-11 2018-09-06 Method for image prediction of multi-view video codec and computer readable recording medium therefor

Country Status (2)

Country Link
US (3) US20080170753A1 (en)
KR (1) KR100968204B1 (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20150271523A1 (en) * 2012-10-08 2015-09-24 Lg Electronics Inc. Multiview video signal encoding method and decoding method, and device therefor

Families Citing this family (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP2308239B8 (en) 2008-07-20 2017-08-02 Dolby Laboratories Licensing Corporation Compatible stereoscopic video delivery
WO2010123909A1 (en) 2009-04-20 2010-10-28 Dolby Laboratories Licensing Corporation Directed interpolation and data post-processing
WO2013039348A1 (en) * 2011-09-16 2013-03-21 엘지전자 주식회사 Method for signaling image information and video decoding method using same
KR102057194B1 (en) 2012-01-19 2019-12-19 삼성전자주식회사 Method and apparatus for Multiview video prediction encoding capable of view switching, method and apparatus for Multiview video prediction decoding capable of view switching
WO2013115562A1 (en) * 2012-01-30 2013-08-08 삼성전자 주식회사 Method and apparatus for multiview video encoding based on prediction structures for viewpoint switching, and method and apparatus for multiview video decoding based on prediction structures for viewpoint switching
US9503702B2 (en) 2012-04-13 2016-11-22 Qualcomm Incorporated View synthesis mode for three-dimensional video coding
US9939253B2 (en) * 2014-05-22 2018-04-10 Brain Corporation Apparatus and methods for distance estimation using multiple image sensors
CN104506752B (en) * 2015-01-06 2017-08-25 河海大学常州校区 A kind of similar image compression method based on residual error compressed sensing
US11558597B2 (en) * 2018-08-13 2023-01-17 Lg Electronics Inc. Method for transmitting video, apparatus for transmitting video, method for receiving video, and apparatus for receiving video
CN110312164A (en) * 2019-07-24 2019-10-08 Oppo(重庆)智能科技有限公司 Method for processing video frequency, device and computer storage medium and terminal device

Citations (21)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6122321A (en) 1998-05-12 2000-09-19 Hitachi America, Ltd. Methods and apparatus for reducing the complexity of inverse quantization operations
US6148107A (en) 1996-09-06 2000-11-14 Thomson Multimedia S.A. Quantization process for video encoding
US6480547B1 (en) 1999-10-15 2002-11-12 Koninklijke Philips Electronics N.V. System and method for encoding and decoding the residual signal for fine granular scalable video
US20030169817A1 (en) * 2002-03-05 2003-09-11 Samsung Electronics Co., Ltd. Method to encode moving picture data and apparatus therefor
US20030169933A1 (en) * 2002-03-09 2003-09-11 Samsung Electronics Co., Ltd. Method for adaptively encoding motion image based on temporal and spatial complexity and apparatus therefor
US20030202592A1 (en) * 2002-04-20 2003-10-30 Sohn Kwang Hoon Apparatus for encoding a multi-view moving picture
US6650705B1 (en) * 2000-05-26 2003-11-18 Mitsubishi Electric Research Laboratories Inc. Method for encoding and transcoding multiple video objects with variable temporal resolution
US20050152450A1 (en) * 2003-03-06 2005-07-14 Sony Corporation Coding apparatus and method, program, and recording medium
US20050175093A1 (en) 2004-02-06 2005-08-11 Haskell Barin G. Target bitrate estimator, picture activity and buffer management in rate control for video coder
US20050249288A1 (en) * 2004-05-10 2005-11-10 Samsung Electronics Co., Ltd. Adaptive-weighted motion estimation method and frame rate converting apparatus employing the method
KR20060065553A (en) 2004-12-10 2006-06-14 한국전자통신연구원 Apparatus for universal coding for multi-view video
US20060165303A1 (en) 2005-01-21 2006-07-27 Samsung Electronics Co., Ltd. Video coding method and apparatus for efficiently predicting unsynchronized frame
US20060262856A1 (en) 2005-05-20 2006-11-23 Microsoft Corporation Multi-view video coding based on temporal and view decomposition
US20060262853A1 (en) 2005-05-20 2006-11-23 Microsoft Corporation Low complexity motion compensated frame interpolation method
US20070019727A1 (en) * 2002-01-18 2007-01-25 Shinichiro Koto Video encoding method and apparatus and video decoding method and apparatus
US20070237232A1 (en) * 2006-04-07 2007-10-11 Microsoft Corporation Dynamic selection of motion estimation search ranges and extended motion vector ranges
US20070274388A1 (en) * 2006-04-06 2007-11-29 Samsung Electronics Co., Ltd. Method and apparatus for encoding/decoding FGS layers using weighting factor
US7742657B2 (en) 2005-10-18 2010-06-22 Korea Electronics Technology Institute Method for synthesizing intermediate image using mesh based on multi-view square camera structure and device using the same and computer-readable medium having thereon program performing function embodying the same
US7903736B2 (en) * 2005-11-04 2011-03-08 Electronics And Telecommunications Research Institute Fast mode-searching apparatus and method for fast motion-prediction
US7912298B2 (en) 2004-09-16 2011-03-22 Ntt Docomo, Inc. Video evaluation device, frame rate determination device, video process device, video evaluation method, and video evaluation program
US8265156B2 (en) * 2005-07-19 2012-09-11 Samsung Electronics Co., Ltd. Video encoding/decoding method and apparatus in temporal direct mode in hierarchical structure

Family Cites Families (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US8005145B2 (en) * 2000-08-11 2011-08-23 Nokia Corporation Method and apparatus for transferring video frame in telecommunication system
JP4114859B2 (en) * 2002-01-09 2008-07-09 松下電器産業株式会社 Motion vector encoding method and motion vector decoding method
KR100779875B1 (en) * 2005-01-14 2007-11-27 주식회사 휴맥스 Method for setting reference frame order for multi-view coding and computer readable medium storing thereof
KR100732961B1 (en) * 2005-04-01 2007-06-27 경희대학교 산학협력단 Multiview scalable image encoding, decoding method and its apparatus
US8644386B2 (en) * 2005-09-22 2014-02-04 Samsung Electronics Co., Ltd. Method of estimating disparity vector, and method and apparatus for encoding and decoding multi-view moving picture using the disparity vector estimation method
KR101244911B1 (en) * 2005-10-11 2013-03-18 삼성전자주식회사 Apparatus for encoding and decoding muti-view image by using camera parameter, and method thereof, a recording medium having a program to implement thereof
KR100754205B1 (en) * 2006-02-07 2007-09-03 삼성전자주식회사 Multi-view video encoding apparatus and method
KR20080066522A (en) * 2007-01-11 2008-07-16 삼성전자주식회사 Method and apparatus for encoding and decoding multi-view image

Patent Citations (22)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6148107A (en) 1996-09-06 2000-11-14 Thomson Multimedia S.A. Quantization process for video encoding
US6122321A (en) 1998-05-12 2000-09-19 Hitachi America, Ltd. Methods and apparatus for reducing the complexity of inverse quantization operations
US6480547B1 (en) 1999-10-15 2002-11-12 Koninklijke Philips Electronics N.V. System and method for encoding and decoding the residual signal for fine granular scalable video
US6650705B1 (en) * 2000-05-26 2003-11-18 Mitsubishi Electric Research Laboratories Inc. Method for encoding and transcoding multiple video objects with variable temporal resolution
US20070019727A1 (en) * 2002-01-18 2007-01-25 Shinichiro Koto Video encoding method and apparatus and video decoding method and apparatus
US20030169817A1 (en) * 2002-03-05 2003-09-11 Samsung Electronics Co., Ltd. Method to encode moving picture data and apparatus therefor
US20030169933A1 (en) * 2002-03-09 2003-09-11 Samsung Electronics Co., Ltd. Method for adaptively encoding motion image based on temporal and spatial complexity and apparatus therefor
US7280708B2 (en) 2002-03-09 2007-10-09 Samsung Electronics Co., Ltd. Method for adaptively encoding motion image based on temporal and spatial complexity and apparatus therefor
US20030202592A1 (en) * 2002-04-20 2003-10-30 Sohn Kwang Hoon Apparatus for encoding a multi-view moving picture
US20050152450A1 (en) * 2003-03-06 2005-07-14 Sony Corporation Coding apparatus and method, program, and recording medium
US20050175093A1 (en) 2004-02-06 2005-08-11 Haskell Barin G. Target bitrate estimator, picture activity and buffer management in rate control for video coder
US20050249288A1 (en) * 2004-05-10 2005-11-10 Samsung Electronics Co., Ltd. Adaptive-weighted motion estimation method and frame rate converting apparatus employing the method
US7912298B2 (en) 2004-09-16 2011-03-22 Ntt Docomo, Inc. Video evaluation device, frame rate determination device, video process device, video evaluation method, and video evaluation program
KR20060065553A (en) 2004-12-10 2006-06-14 한국전자통신연구원 Apparatus for universal coding for multi-view video
US20060165303A1 (en) 2005-01-21 2006-07-27 Samsung Electronics Co., Ltd. Video coding method and apparatus for efficiently predicting unsynchronized frame
US20060262856A1 (en) 2005-05-20 2006-11-23 Microsoft Corporation Multi-view video coding based on temporal and view decomposition
US20060262853A1 (en) 2005-05-20 2006-11-23 Microsoft Corporation Low complexity motion compensated frame interpolation method
US8265156B2 (en) * 2005-07-19 2012-09-11 Samsung Electronics Co., Ltd. Video encoding/decoding method and apparatus in temporal direct mode in hierarchical structure
US7742657B2 (en) 2005-10-18 2010-06-22 Korea Electronics Technology Institute Method for synthesizing intermediate image using mesh based on multi-view square camera structure and device using the same and computer-readable medium having thereon program performing function embodying the same
US7903736B2 (en) * 2005-11-04 2011-03-08 Electronics And Telecommunications Research Institute Fast mode-searching apparatus and method for fast motion-prediction
US20070274388A1 (en) * 2006-04-06 2007-11-29 Samsung Electronics Co., Ltd. Method and apparatus for encoding/decoding FGS layers using weighting factor
US20070237232A1 (en) * 2006-04-07 2007-10-11 Microsoft Corporation Dynamic selection of motion estimation search ranges and extended motion vector ranges

Non-Patent Citations (4)

* Cited by examiner, † Cited by third party
Title
J.M. Boyce, "Weighted prediction in the H.264/MPEG AVC video coding standard", In: Circuits and Systems, 2004. ISCAS '04. Proceedings of the 2004 International Symposium on vol. 3, May 23-26, 2004, pp. III 789-792, vol. 3, Digital Object Identifier 10.1109/ISCAS.2004.1328865. *
Jiefu Zhai: Keman Yu; Jiang Li; Shipeng Li;, "A low complexity motion compensated frame interpolation method", Circuits and Systems, 2005. ISCAS 2005. IEEE International Symposium on, vol., No., pp. 4927-4930 vol. 5, May 23-26, 2005.
T. Chen, "Adaptive temporal interpolation using bidirectional motion estimation and compensation", IEEE International Conference of Image Processing 2002, pp. 313-316.
Tao Chen, "Adaptive temporal interpolation using bidirectional motion estimation and compensation," in Image Processing. 2002. Proceedings. 2002 International Conference on , vol. 2, No., pp. II-313-II-316 vol. 2, 2002. *

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20150271523A1 (en) * 2012-10-08 2015-09-24 Lg Electronics Inc. Multiview video signal encoding method and decoding method, and device therefor
US9894384B2 (en) * 2012-10-08 2018-02-13 Lg Electronics Inc. Multiview video signal encoding method and decoding method, and device therefor

Also Published As

Publication number Publication date
US20140355680A1 (en) 2014-12-04
USRE47897E1 (en) 2020-03-03
US20080170753A1 (en) 2008-07-17
KR100968204B1 (en) 2010-07-06
KR20080066591A (en) 2008-07-16

Similar Documents

Publication Publication Date Title
USRE47897E1 (en) Method for image prediction of multi-view video codec and computer readable recording medium therefor
EP3518544B1 (en) Video decoding with improved motion vector diversity
US8711940B2 (en) Method and apparatus of motion vector prediction with extended motion vector predictor
US10574863B2 (en) Video encoding and decoding
US20120230405A1 (en) Video coding methods and video encoders and decoders with localized weighted prediction
US20090116558A1 (en) Motion skip and single-loop encoding for multi-view video content
CN111492659A (en) Method and apparatus for video encoding
EP3871417B1 (en) Methods of accessing affine history-based motion vector predictor buffer
US20150172714A1 (en) METHOD AND APPARATUS of INTER-VIEW SUB-PARTITION PREDICTION in 3D VIDEO CODING
CN110944202A (en) Video encoding and decoding method and device, computer equipment and storage medium
US20140002594A1 (en) Hybrid skip mode for depth map coding and decoding
US20150365698A1 (en) Method and Apparatus for Prediction Value Derivation in Intra Coding
TWI653881B (en) Method and apparatus of motion vector prediction
US11736709B2 (en) Method and apparatus for video coding
JP2023505270A (en) Method and apparatus for video coding
CN111726622A (en) Method and device for video decoding
GB2499831A (en) Determining missing coding units while decoding a video bitstream
CN113497940A (en) Video decoding method, video decoding device, computer equipment and storage medium
US20230078392A1 (en) Geometric partition based intra prediction
CN117716688A (en) Externally enhanced prediction for video coding
KR101672008B1 (en) Method And Apparatus For Estimating Disparity Vector
KR20230117428A (en) Adaptive Resolution for Motion Vector Differences
GB2512563A (en) Method and apparatus for encoding an image into a video bitstream and decoding corresponding video bitstream with weighted residual predictions

Legal Events

Date Code Title Description
AS Assignment

Owner name: KOREA ELECTRONICS TECHNOLOGY INSTITUTE, KOREA, REP

Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNORS:PARK, JI-HO;CHOI, BYEONG-HO;KIM, YONG-HWAN;AND OTHERS;REEL/FRAME:033550/0126

Effective date: 20140526

FEPP Fee payment procedure

Free format text: PAYOR NUMBER ASSIGNED (ORIGINAL EVENT CODE: ASPN); ENTITY STATUS OF PATENT OWNER: SMALL ENTITY

STCF Information on status: patent grant

Free format text: PATENTED CASE

RF Reissue application filed

Effective date: 20180906

MAFP Maintenance fee payment

Free format text: PAYMENT OF MAINTENANCE FEE, 4TH YR, SMALL ENTITY (ORIGINAL EVENT CODE: M2551); ENTITY STATUS OF PATENT OWNER: SMALL ENTITY

Year of fee payment: 4

RF Reissue application filed

Effective date: 20200128

RF Reissue application filed

Effective date: 20200128

RF Reissue application filed

Effective date: 20200128

RF Reissue application filed

Effective date: 20200128