CA2293927A1 - Multi-functional transcoder for compressed bit streams - Google Patents
Multi-functional transcoder for compressed bit streams Download PDFInfo
- Publication number
- CA2293927A1 CA2293927A1 CA002293927A CA2293927A CA2293927A1 CA 2293927 A1 CA2293927 A1 CA 2293927A1 CA 002293927 A CA002293927 A CA 002293927A CA 2293927 A CA2293927 A CA 2293927A CA 2293927 A1 CA2293927 A1 CA 2293927A1
- Authority
- CA
- Canada
- Prior art keywords
- reconstructed data
- intermediate reconstructed
- format
- modified
- data
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Abandoned
Links
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
- H04N21/236—Assembling of a multiplex stream, e.g. transport stream, by combining a video stream with other content or additional data, e.g. inserting a URL [Uniform Resource Locator] into a video stream, multiplexing software data into a video stream; Remultiplexing of multiplex streams; Insertion of stuffing bits into the multiplex stream, e.g. to obtain a constant bit-rate; Assembling of a packetised elementary stream
- H04N21/2365—Multiplexing of several video streams
- H04N21/23655—Statistical multiplexing, e.g. by controlling the encoder to alter its bitrate to optimize the bandwidth utilization
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
- H04N19/102—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or selection affected or controlled by the adaptive coding
- H04N19/117—Filters, e.g. for pre-processing or post-processing
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
- H04N19/134—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or criterion affecting or controlling the adaptive coding
- H04N19/162—User input
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
- H04N19/169—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding
- H04N19/17—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object
- H04N19/172—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object the region being a picture, frame or field
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/40—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using video transcoding, i.e. partial or full decoding of a coded input stream followed by re-encoding of the decoded output stream
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/80—Details of filtering operations specially adapted for video compression, e.g. for pixel interpolation
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/85—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using pre-processing or post-processing specially adapted for video compression
- H04N19/86—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using pre-processing or post-processing specially adapted for video compression involving reduction of coding artifacts, e.g. of blockiness
Abstract
A method and apparatus for transcoding digital video data, for example, at the headend of a cable or satellite television network. A generic multi-functional transcoder architecture has a "post-pre-processing engine" that provides a number of processing functions for implementing desired format conversions according to a user selection signal or an automatically generated selection signal. The processing functions can change frame size, frame rate, color space sampling format, interlaced or progressive scan format, resolution, and provide noise/deblocking filtering, for example. The system also allows the control of several transcoders to convert several bit streams with different formats into corresponding bit streams with a common format.
Furthermore, the transcoder avoids the need for motion estimation.
Furthermore, the transcoder avoids the need for motion estimation.
Description
MULTI-FUNCTIONAL TRANSCODER FOR COMPRESSED BIT
STREAMS
BACKGROUND OF THE INVENTION
The present invention relates to a method and apparatus for transcoding digital video data, for example, at the headend of a cable or satellite television network.
The transmission of digital video data via broadband communication systems such as cable television or satellite television networks has become increasingly popular. Digital decoders, e.g.
set-top boxes, are provided in consumers' homes for use in receiving the digital video signals and processing the signals in a format that is suitable for display on a television, video display terminal, or the like.
In general, source video sequences can be of any format, e.g., in terms of spatial resolution, frame rate, frame size, color sampling format, interlaced or progressive scan format, bit rate, resolution (e. g., high-definition or standard definition), or amount and type of noise filtering.
Additionally, the source video sequences can be pre-encoded at any rate, and with a constant bit rate (CBR) or variable bit rate (VBR).
For many applications, however, the pre-compressed bitstreams must correspond with only specific allowable, or otherwise desirable, video formats and rates. Accordingly, it is often necessary to change the format or other characteristics of the video data prior to communicating it to a set-top box and/or some intermediate point in a network. -For example, the data may be originally obtained via a storage medium or transmission point in a format that is not compatible with, or optimally suitable for, the set-top box, headend equipment, channel capacity, or other system limitation or property.
In the past, the required format conversion was achieved by decompressing the pre-compressed data to the pixel domain, performing the required format or bit rate conversion, then re-compressing the data, including motion compensation and motion estimation processing for inter-frame coded data, for transmission. However, this approach is undesirable due to the extensive computational requirements, in particular, due to motion estimation. Additionally, the different required format conversions are not provided in an integrated package.
An article by N. Bjork et al., entitled "Transcoder Architectures for Video Coding", IEEE
Transactions on Consumer Electronics, Vol. 44, No.
1, Feb, 1998, discusses the possibility of using a downsampling filter for resolution reduction transcoding with H.263 data for low bit rate communications. However, the article does not discuss a generic multi-functional transcoder that allows the selection of one or more of a variety of format-modifying processes.
Accordingly, it would be desirable to provide a generic, integrated transcoder architecture which is able to convert a pre-compressed digital video bit stream into another bit stream at a specific bit rate and format. The system should be compatible with MPEG-2 and other digital video standards. The system should provide the capability for modification of spatial resolution, frame rate., frame size, color sampling format, interlaced or progressive scan format, bit rate, resolution, and/or amount and type of noise filtering, in an integrated transcoder architecture.
The system should allow the selection of one or more of several available processing functions according to a user selection signal or an automatically generated selection signal, e.g., that is responsive to detected characteristics of the received pre-compressed bit stream, or some other criteria, including a default setting.
The system should allow the control of several transcoders to convert several bit streams with different formats into corresponding bit streams with a common format.
The system should provide re-use of motion vectors obtained from decoding for re-encoding, with optional motion estimation refinement during re-encoding as required.
The system should avoid the complexity introduced by motion estimation in a transcoder.
The present invention provides a system having the above and other advantages.
STREAMS
BACKGROUND OF THE INVENTION
The present invention relates to a method and apparatus for transcoding digital video data, for example, at the headend of a cable or satellite television network.
The transmission of digital video data via broadband communication systems such as cable television or satellite television networks has become increasingly popular. Digital decoders, e.g.
set-top boxes, are provided in consumers' homes for use in receiving the digital video signals and processing the signals in a format that is suitable for display on a television, video display terminal, or the like.
In general, source video sequences can be of any format, e.g., in terms of spatial resolution, frame rate, frame size, color sampling format, interlaced or progressive scan format, bit rate, resolution (e. g., high-definition or standard definition), or amount and type of noise filtering.
Additionally, the source video sequences can be pre-encoded at any rate, and with a constant bit rate (CBR) or variable bit rate (VBR).
For many applications, however, the pre-compressed bitstreams must correspond with only specific allowable, or otherwise desirable, video formats and rates. Accordingly, it is often necessary to change the format or other characteristics of the video data prior to communicating it to a set-top box and/or some intermediate point in a network. -For example, the data may be originally obtained via a storage medium or transmission point in a format that is not compatible with, or optimally suitable for, the set-top box, headend equipment, channel capacity, or other system limitation or property.
In the past, the required format conversion was achieved by decompressing the pre-compressed data to the pixel domain, performing the required format or bit rate conversion, then re-compressing the data, including motion compensation and motion estimation processing for inter-frame coded data, for transmission. However, this approach is undesirable due to the extensive computational requirements, in particular, due to motion estimation. Additionally, the different required format conversions are not provided in an integrated package.
An article by N. Bjork et al., entitled "Transcoder Architectures for Video Coding", IEEE
Transactions on Consumer Electronics, Vol. 44, No.
1, Feb, 1998, discusses the possibility of using a downsampling filter for resolution reduction transcoding with H.263 data for low bit rate communications. However, the article does not discuss a generic multi-functional transcoder that allows the selection of one or more of a variety of format-modifying processes.
Accordingly, it would be desirable to provide a generic, integrated transcoder architecture which is able to convert a pre-compressed digital video bit stream into another bit stream at a specific bit rate and format. The system should be compatible with MPEG-2 and other digital video standards. The system should provide the capability for modification of spatial resolution, frame rate., frame size, color sampling format, interlaced or progressive scan format, bit rate, resolution, and/or amount and type of noise filtering, in an integrated transcoder architecture.
The system should allow the selection of one or more of several available processing functions according to a user selection signal or an automatically generated selection signal, e.g., that is responsive to detected characteristics of the received pre-compressed bit stream, or some other criteria, including a default setting.
The system should allow the control of several transcoders to convert several bit streams with different formats into corresponding bit streams with a common format.
The system should provide re-use of motion vectors obtained from decoding for re-encoding, with optional motion estimation refinement during re-encoding as required.
The system should avoid the complexity introduced by motion estimation in a transcoder.
The present invention provides a system having the above and other advantages.
SUMbIARY OF THE INVENTION
The present invention relates to a method and apparatus for transcoding digitalwideo data, for example, at the headend of a cable or satellite television network.
A method for transcoding compressed digital video data includes the step of partially decompressing first compressed digital video data to provide first intermediate reconstructed data having an associated first format. The format may include one or more of the following characteristics: frame size, frame rate, color space sampling format (i.e., sampling ratio), interlaced or progressive scan, resolution (e. g., high-definition or standard definition), and noise filtering status (e. g., whether the data is noise filtered or not, and if so, the amount and type of noise filtering).
A post-pre-processing engine is provided that has a plurality of different available processing functions for achieving any of the above format changes. The term ~~post-pre-processing~~ indicates that processing occurs after decoding, but before re-encoding in the transcoder.
A first selection signal is provided for selecting at least one of the processing functions.
The selection signal may be provided by a user, or automatically generated, for example, by reading the first compressed digital video data and determining its format. The detected format may then be compared to a desired format, e.g., based on data stored in a memory, to determine if a change is required.
The first intermediate reconstructed data is processed according to the selected processing 5 function to provide corresponding first modified intermediate reconstructed data having a first modified format that is different than the first format. The first modified intermediate reconstructed data is then compressed to provide first modified compressed digital video data with the first modified format.
For example, the post-pre-processing engine may be provided at the headend of a cable or satellite television network, in which case the first modified compressed digital video data is transmitted to a decoder population via optical fiber, co-axial cable, and/or a satellite link.
The first compressed digital video data may also be processed to change its bit rate according to a second selection signal. For example, a relatively high bit rate may be used for premium television programming, while the bit rate is reduced for standard programming services. The bit rate may also be changed from variable to fixed, or from fixed to variable.
One of the available processing functions may process the first intermediate reconstructed data with a noise-reduction/deblocking filter, such as a fixed or adaptive filter. The noise filtering condition of the data is considered to be a component of the data's format. Thus, data that is not noise filtered has one format, while the same data after noise filtering has another format. The first intermediate reconstructed data may be delayed to provide noise-reduction filtering of a current image region using a future image region.
For example, the current image region and the future image region may be in different video frames, or in a common video frame, where the future image region follows the current image region according to a display scan sequence of the first intermediate reconstructed data.
The current image region and the future image region may be provided as respective macroblocks.
One of the available processing functions may provide the first modified intermediate reconstructed data with a different resolution (e. g., standard definition vs. high-definition) than that of the first intermediate reconstructed data.
One of the available processing functions may either (a) provide the first modified intermediate reconstructed data with an interlaced scan format when the first intermediate reconstructed data has a progressive scan format, or (b) provide the first modified intermediate reconstructed data with a progressive scan format when the first intermediate reconstructed data has an interlaced scan format.
One of the available processing functions may provide the first modified intermediate reconstructed data with a color space sampling format that is different than that of the first intermediate reconstructed data.
One of the plurality of different available processing functions may provide the first modified intermediate reconstructed data with a frame size or rate that is different than that of the first intermediate reconstructed data.
Additionally, several transcoders with post-pre-processing engines may be provided for converting different bit streams with different formats to a common format, e.g., prior to transmission to a decoder population.
The method may include the further steps of:
obtaining motion vector data from the first intermediate reconstructed data, e.g., at the decoder of a transcoder, and providing the motion vector data for use in compressing the first modified intermediate reconstructed data, e.g., at the encoder of the transcoder. The motion vector data may be refined as required for use in the compressing step. with this technique, the transcoder avoids the need to re-generate motion vectors from scratch in the encoder of a transcoder, thereby significant reducing memory and computational requirements.
A corresponding apparatus is presented.
The present invention relates to a method and apparatus for transcoding digitalwideo data, for example, at the headend of a cable or satellite television network.
A method for transcoding compressed digital video data includes the step of partially decompressing first compressed digital video data to provide first intermediate reconstructed data having an associated first format. The format may include one or more of the following characteristics: frame size, frame rate, color space sampling format (i.e., sampling ratio), interlaced or progressive scan, resolution (e. g., high-definition or standard definition), and noise filtering status (e. g., whether the data is noise filtered or not, and if so, the amount and type of noise filtering).
A post-pre-processing engine is provided that has a plurality of different available processing functions for achieving any of the above format changes. The term ~~post-pre-processing~~ indicates that processing occurs after decoding, but before re-encoding in the transcoder.
A first selection signal is provided for selecting at least one of the processing functions.
The selection signal may be provided by a user, or automatically generated, for example, by reading the first compressed digital video data and determining its format. The detected format may then be compared to a desired format, e.g., based on data stored in a memory, to determine if a change is required.
The first intermediate reconstructed data is processed according to the selected processing 5 function to provide corresponding first modified intermediate reconstructed data having a first modified format that is different than the first format. The first modified intermediate reconstructed data is then compressed to provide first modified compressed digital video data with the first modified format.
For example, the post-pre-processing engine may be provided at the headend of a cable or satellite television network, in which case the first modified compressed digital video data is transmitted to a decoder population via optical fiber, co-axial cable, and/or a satellite link.
The first compressed digital video data may also be processed to change its bit rate according to a second selection signal. For example, a relatively high bit rate may be used for premium television programming, while the bit rate is reduced for standard programming services. The bit rate may also be changed from variable to fixed, or from fixed to variable.
One of the available processing functions may process the first intermediate reconstructed data with a noise-reduction/deblocking filter, such as a fixed or adaptive filter. The noise filtering condition of the data is considered to be a component of the data's format. Thus, data that is not noise filtered has one format, while the same data after noise filtering has another format. The first intermediate reconstructed data may be delayed to provide noise-reduction filtering of a current image region using a future image region.
For example, the current image region and the future image region may be in different video frames, or in a common video frame, where the future image region follows the current image region according to a display scan sequence of the first intermediate reconstructed data.
The current image region and the future image region may be provided as respective macroblocks.
One of the available processing functions may provide the first modified intermediate reconstructed data with a different resolution (e. g., standard definition vs. high-definition) than that of the first intermediate reconstructed data.
One of the available processing functions may either (a) provide the first modified intermediate reconstructed data with an interlaced scan format when the first intermediate reconstructed data has a progressive scan format, or (b) provide the first modified intermediate reconstructed data with a progressive scan format when the first intermediate reconstructed data has an interlaced scan format.
One of the available processing functions may provide the first modified intermediate reconstructed data with a color space sampling format that is different than that of the first intermediate reconstructed data.
One of the plurality of different available processing functions may provide the first modified intermediate reconstructed data with a frame size or rate that is different than that of the first intermediate reconstructed data.
Additionally, several transcoders with post-pre-processing engines may be provided for converting different bit streams with different formats to a common format, e.g., prior to transmission to a decoder population.
The method may include the further steps of:
obtaining motion vector data from the first intermediate reconstructed data, e.g., at the decoder of a transcoder, and providing the motion vector data for use in compressing the first modified intermediate reconstructed data, e.g., at the encoder of the transcoder. The motion vector data may be refined as required for use in the compressing step. with this technique, the transcoder avoids the need to re-generate motion vectors from scratch in the encoder of a transcoder, thereby significant reducing memory and computational requirements.
A corresponding apparatus is presented.
BRIEF DESCRIPTION OF THE DRAWINGS
FIG. 1 illustrates a prior art transcoder.
FIG. 2 illustrates a transcoder wherein motion estimation has been removed from the encoder, in accordance with the present invention.
FIG. 3 illustrates a transcoder with a post-pre-processing engine in accordance with the present invention.
FIG. 4 illustrates a plurality of transcoders with post-pre-processing engines in accordance with the present invention.
FIG. 5 illustrates a post-pre-processing engine with a first processing function for noise reduction/deblocking filtering of intermediate reconstructed frames in accordance with the present invention.
FIG. 6 illustrates a post-pre-processing engine with a second processing function for noise reduction filtering of intermediate reconstructed frames with a delay function in accordance with the present invention.
FIG. 7(a) illustrates a filtering scheme for an intermediate reconstructed frame with the second processing function of FIG. 6 in accordance with the present invention.
FIG. 7(b) illustrates filtering of pixels in the current block of FIG. 7(a) using pixels in a neighboring block in accordance with the present invention.
FIG. 8 illustrates a post-pre-processing engine with a third processing function for noise reduction filtering of intermediate reconstructed frames with a delay function, and downsampling in accordance with the present invention.
DETAILED DESCRIPTION OF THE INVENTION .
The present invention relates to a method and apparatus for transcoding digital~video data, for example, at the headend of a cable or satellite 5 television network.
FIG. 1 illustrates a prior art transcoder. A
straightforward transcoder for an MPEG bitstream can simply be a cascaded MPEG decoder and encoder. The cascaded transcoder first decodes a compressed 10 bitstream, e.g. that is obtained from a library or transmission source, to obtain a reconstructed video sequence. The reconstructed video sequence is then re-encoded to obtain a different compressed bitstream that is suitable for transmission, e.g., to a decoder population.
In particular, the transcoder 100 includes a decoder 110 and an encoder 150. A pre-compressed video bitstream is input to a Variable Length Decoder (VLD) 115. A dequantizer function 120 processes the output of the VLD 115 using a first quantization step size, Q1. An Inverse Discrete Cosine Transform (IDCT) function 125 processes the output of the inverse quantizer 120 to provide pixel domain data to an adder 130. This data is summed with either a motion compensation difference signal from a Motion Compensator (MC) 135 or a null signal, according to the position of a switch 140.
The code mode for each input macroblock (MB), either intra or inter mode, embedded in the input pre-compressed bit stream, is provided to the switch 140. The output of the adder 130 is provided to the encoder 150 and to a Current Frame Buffer (C FB) 145 of the decoder 110. The MC function 135 uses data from the current FB 145 and from a Previous Frame Buffer (P-FB) 150 along with motion vector (MV) data from the VLD 115.
In the encoder 150, pixel data is provided to an intra/inter mode switch 155, an adder 160, and a Motion Estimation (ME) function 165. The switch 155 selects either the current pixel data, or the difference between the current pixel data and pixel data from a previous frame, for processing by a Discrete Cosine Transform (DCT) function 170, quantizer 175, and Variable Length Coding (VLC) function 180. The output of the VLC function 180 is a bitstream that is transmitted to a decoder. The bitstream includes Motion Vector (MV) data from the ME function 165.
The bit output rate of the transcoder is adjusted by changing Q2.
In a feedback path, processing at an inverse quantizer 182 and an inverse DCT function 184 is performed to recover the pixel domain data. This data is summed with motion compensated data or a null signal at an adder 186, and the sum thereof is provided to a Current Frame Buffer (C FB) 190. Data from the C-FB 190 and a P-FB 192 are provided to the ME function 165 and a MC function 194. A switch 196 directs either a null signal or the output of the MC
function 194 to the adder 186 in response to an intra/inter mode switch control signal.
However, this approach is undesirable due to the extensive computational requirements incurred when fully decompressing the pre-compressed data to the pixel domain, and fully re-compressing the intermediate reconstructed video frames, including motion compensation and estimation processing for the inter-frame coded data. Additionally, the implementation costs of the cascaded transcoder is relatively high due to the need for one full MPEG
decoder and one full MPEG encoder.
Computer simulation results have indicated that if the picture type for each frame is maintained during transcoding, the motion vectors decoded from the decoder can be used for motion compensation in the encoder without significantly impairing the perceptual quality of the resulting image. This indicates that motion estimation, the most expensive operation, can be removed from the cascaded transcoder, as discussed in connection with FIG. 2, below.
FIG. 2 illustrates a transcoder wherein motion estimation has been removed from the encoder, in accordance with the present invention. Like-numbered elements correspond to the elements of FIG.
1. The transcoder 200 includes a decoder 210 and an encoder 250. Here, the motion vectors from the VLD
115 are provided to the MC 194 in the encoder 250.
The transcoder architecture of FIG. 2 will therefore generate a new bitstream and a new bit rate, but with the same video format as the pre-compressed bitstream.
FIG. 3 illustrates a generic transcoder with a post-pre-processing engine in accordance with the present invention. Like-numbered elements correspond to the elements of FIG. 1.
FIG. 1 illustrates a prior art transcoder.
FIG. 2 illustrates a transcoder wherein motion estimation has been removed from the encoder, in accordance with the present invention.
FIG. 3 illustrates a transcoder with a post-pre-processing engine in accordance with the present invention.
FIG. 4 illustrates a plurality of transcoders with post-pre-processing engines in accordance with the present invention.
FIG. 5 illustrates a post-pre-processing engine with a first processing function for noise reduction/deblocking filtering of intermediate reconstructed frames in accordance with the present invention.
FIG. 6 illustrates a post-pre-processing engine with a second processing function for noise reduction filtering of intermediate reconstructed frames with a delay function in accordance with the present invention.
FIG. 7(a) illustrates a filtering scheme for an intermediate reconstructed frame with the second processing function of FIG. 6 in accordance with the present invention.
FIG. 7(b) illustrates filtering of pixels in the current block of FIG. 7(a) using pixels in a neighboring block in accordance with the present invention.
FIG. 8 illustrates a post-pre-processing engine with a third processing function for noise reduction filtering of intermediate reconstructed frames with a delay function, and downsampling in accordance with the present invention.
DETAILED DESCRIPTION OF THE INVENTION .
The present invention relates to a method and apparatus for transcoding digital~video data, for example, at the headend of a cable or satellite 5 television network.
FIG. 1 illustrates a prior art transcoder. A
straightforward transcoder for an MPEG bitstream can simply be a cascaded MPEG decoder and encoder. The cascaded transcoder first decodes a compressed 10 bitstream, e.g. that is obtained from a library or transmission source, to obtain a reconstructed video sequence. The reconstructed video sequence is then re-encoded to obtain a different compressed bitstream that is suitable for transmission, e.g., to a decoder population.
In particular, the transcoder 100 includes a decoder 110 and an encoder 150. A pre-compressed video bitstream is input to a Variable Length Decoder (VLD) 115. A dequantizer function 120 processes the output of the VLD 115 using a first quantization step size, Q1. An Inverse Discrete Cosine Transform (IDCT) function 125 processes the output of the inverse quantizer 120 to provide pixel domain data to an adder 130. This data is summed with either a motion compensation difference signal from a Motion Compensator (MC) 135 or a null signal, according to the position of a switch 140.
The code mode for each input macroblock (MB), either intra or inter mode, embedded in the input pre-compressed bit stream, is provided to the switch 140. The output of the adder 130 is provided to the encoder 150 and to a Current Frame Buffer (C FB) 145 of the decoder 110. The MC function 135 uses data from the current FB 145 and from a Previous Frame Buffer (P-FB) 150 along with motion vector (MV) data from the VLD 115.
In the encoder 150, pixel data is provided to an intra/inter mode switch 155, an adder 160, and a Motion Estimation (ME) function 165. The switch 155 selects either the current pixel data, or the difference between the current pixel data and pixel data from a previous frame, for processing by a Discrete Cosine Transform (DCT) function 170, quantizer 175, and Variable Length Coding (VLC) function 180. The output of the VLC function 180 is a bitstream that is transmitted to a decoder. The bitstream includes Motion Vector (MV) data from the ME function 165.
The bit output rate of the transcoder is adjusted by changing Q2.
In a feedback path, processing at an inverse quantizer 182 and an inverse DCT function 184 is performed to recover the pixel domain data. This data is summed with motion compensated data or a null signal at an adder 186, and the sum thereof is provided to a Current Frame Buffer (C FB) 190. Data from the C-FB 190 and a P-FB 192 are provided to the ME function 165 and a MC function 194. A switch 196 directs either a null signal or the output of the MC
function 194 to the adder 186 in response to an intra/inter mode switch control signal.
However, this approach is undesirable due to the extensive computational requirements incurred when fully decompressing the pre-compressed data to the pixel domain, and fully re-compressing the intermediate reconstructed video frames, including motion compensation and estimation processing for the inter-frame coded data. Additionally, the implementation costs of the cascaded transcoder is relatively high due to the need for one full MPEG
decoder and one full MPEG encoder.
Computer simulation results have indicated that if the picture type for each frame is maintained during transcoding, the motion vectors decoded from the decoder can be used for motion compensation in the encoder without significantly impairing the perceptual quality of the resulting image. This indicates that motion estimation, the most expensive operation, can be removed from the cascaded transcoder, as discussed in connection with FIG. 2, below.
FIG. 2 illustrates a transcoder wherein motion estimation has been removed from the encoder, in accordance with the present invention. Like-numbered elements correspond to the elements of FIG.
1. The transcoder 200 includes a decoder 210 and an encoder 250. Here, the motion vectors from the VLD
115 are provided to the MC 194 in the encoder 250.
The transcoder architecture of FIG. 2 will therefore generate a new bitstream and a new bit rate, but with the same video format as the pre-compressed bitstream.
FIG. 3 illustrates a generic transcoder with a post-pre-processing engine in accordance with the present invention. Like-numbered elements correspond to the elements of FIG. 1.
The transcoder 300 includes a decoder 310 and an encoder 365. A copy function 370 is provided for copying information from the incoming bitstream to the outgoing bitstream. This information may include sequence, picture, splice, and macroblock headers, along with motion vectors, and data designating a new mode decision, if required.
Additionally, the quantization level Qz used by the quantizer 175 may be provided by the function 370 to the output bitstream.
A rate control function 360 receives information from the VLC 180 indicating the bit rate of the output bitstream and determines a corresponding quantization level for maintaining the bit rate within a desired constraint. The rate control function 360 provides a corresponding control signal to the quantizer 175 to set a corresponding quantization level (e. g., step sizes).
In this manner, a desired constant bit rate, or a variable bit rate with minimum and maximum boundaries may be provided.
The post-pre-processing engine 350 includes a number of processing functions, e.g., 352, 354, and 356, and may provide a variety of processing functions, including:
1) Converting of bit rate to meet a rate requirement, e.g., from a high to a low rate, from CBR to VBR, and so forth;
2) Filtering of the intermediate reconstructed frames for better picture quality, especially for low bit rate applications; and 3) Converting of video formats, e.g., from high to low resolution, from interlaced scan to progressive scan, from high definition to standard definition, from CCIR Recommendation 601 resolution to Half Horizontal Resolution (HHR), from 4:4:4 to 4:2:2 color sampling format, from-4:2:2 to 4:2:0 color sampling format, and so forth. Additionally, changes in the frame rate and/or frame size may be provided.
A control 390 provides a select signal to the post-pre-processing engine 350 to select one or more of the available processing functions 352, 354, 356.
Processing by the processing functions 352, 354, 356 may occur serially or in parallel. While three processing functions are shown, fewer or more may be provided. The control 390 may be responsive to a user input, e.g., entered via a keyboard or the like, and/or information recovered from the bit stream. The user input may alternatively be provided from a remote location. In this manner, multiple generic transcoders may be deployed in the field, and the specific processing functions selected or revised at a later date.
The processing functions 352, 354, 356 may comprise fixed filters that perform the different processing functions. In this case, the select signal activates the appropriate filter(s).
Alternatively, the post-pre-processing engine may have a filter that can be configured to embody the different processing functions, e.g., using adjustable coefficients. In this case, the selection signal causes the filter to be configured with the appropriate coefficients or other parameters.
Generally, the processing functions 352, 354, 356 in the post-pre-processing engine 350 may be implemented using any known hardware, firmware, and/or software. Additionally, processing by the 5 processing functions 352, 354, 356 may occur serially or.in parallel.
The control 390 may also be responsive to the bit stream received at the transcoder 300. In particular, the control may recover data, e.g., 10 header information, from the bit stream that identifies format characteristics of the bit stream.
For example, the control 390 may be programmed to convert the color sampling ratio from 4:2:2 to 4:2:0 for those bit streams with the 4:2:2 ratio. Then, 15 the control 390 may detect the sampling ratio of the received bit stream and perform the conversion only when necessary.
Generally, the control need not be responsive to the bit stream to implement noise reduction filtering.
In this manner, the transcoder 300 can receive data having a variety of different formats, yet the output data will always have the desired, specified format.
The control 390 may also be programmed to provide a select signal to the pre-post-processing engine to provide a default output format.
Moreover, as shown in FIG. 4, a number of the transcoders may be used at the same time for processing data from different programming sources which may have different formats. The corresponding output formats can be made uniform and therefore suitable for use, e.g., by a decoder population in a broadband communication network.
For example, the transcoder apparatus 410 of FIG. 4 is shown having three individual transcoders 420, 425 and 430, where each transcoder has a corresponding post-pre-processing engine 422, 427, 432, respectively. Fewer or more transcoders may be used. Transcoder 1 (420) receives a corresponding pre-compressed bit stream having a first format (Format 1), while transcoder 2 (425) receives a pre-compressed bit stream having a second format (Format 2), and transcoder 3 (430) receives a pre-compressed bit stream having a third format (Format 3). The formats are assumed to be different from one another. The respective bit streams may also be provided to a master rate and format control engine 415, which can determine the format of the bit streams by reading the appropriate header information, although this is not generally required for noise reduction filtering.
The master rate and format control engine 415 communicates with the transcoders 420, 425 and 430 and the respective post-pre-processing engines 422, 425, 432 to send select signals to select one or more of the processing functions in the post-pre-processing engines. A user input may be provided for this purpose. As a result, it is possible to convert the bit streams to a common format, e.g., Format A. The converted bit streams, e.g., bit stream 1', 2' and 3', may be provided to a multiplexer (MUX) 435 to form a combined bit stream having the format A.
Additionally, the quantization level Qz used by the quantizer 175 may be provided by the function 370 to the output bitstream.
A rate control function 360 receives information from the VLC 180 indicating the bit rate of the output bitstream and determines a corresponding quantization level for maintaining the bit rate within a desired constraint. The rate control function 360 provides a corresponding control signal to the quantizer 175 to set a corresponding quantization level (e. g., step sizes).
In this manner, a desired constant bit rate, or a variable bit rate with minimum and maximum boundaries may be provided.
The post-pre-processing engine 350 includes a number of processing functions, e.g., 352, 354, and 356, and may provide a variety of processing functions, including:
1) Converting of bit rate to meet a rate requirement, e.g., from a high to a low rate, from CBR to VBR, and so forth;
2) Filtering of the intermediate reconstructed frames for better picture quality, especially for low bit rate applications; and 3) Converting of video formats, e.g., from high to low resolution, from interlaced scan to progressive scan, from high definition to standard definition, from CCIR Recommendation 601 resolution to Half Horizontal Resolution (HHR), from 4:4:4 to 4:2:2 color sampling format, from-4:2:2 to 4:2:0 color sampling format, and so forth. Additionally, changes in the frame rate and/or frame size may be provided.
A control 390 provides a select signal to the post-pre-processing engine 350 to select one or more of the available processing functions 352, 354, 356.
Processing by the processing functions 352, 354, 356 may occur serially or in parallel. While three processing functions are shown, fewer or more may be provided. The control 390 may be responsive to a user input, e.g., entered via a keyboard or the like, and/or information recovered from the bit stream. The user input may alternatively be provided from a remote location. In this manner, multiple generic transcoders may be deployed in the field, and the specific processing functions selected or revised at a later date.
The processing functions 352, 354, 356 may comprise fixed filters that perform the different processing functions. In this case, the select signal activates the appropriate filter(s).
Alternatively, the post-pre-processing engine may have a filter that can be configured to embody the different processing functions, e.g., using adjustable coefficients. In this case, the selection signal causes the filter to be configured with the appropriate coefficients or other parameters.
Generally, the processing functions 352, 354, 356 in the post-pre-processing engine 350 may be implemented using any known hardware, firmware, and/or software. Additionally, processing by the 5 processing functions 352, 354, 356 may occur serially or.in parallel.
The control 390 may also be responsive to the bit stream received at the transcoder 300. In particular, the control may recover data, e.g., 10 header information, from the bit stream that identifies format characteristics of the bit stream.
For example, the control 390 may be programmed to convert the color sampling ratio from 4:2:2 to 4:2:0 for those bit streams with the 4:2:2 ratio. Then, 15 the control 390 may detect the sampling ratio of the received bit stream and perform the conversion only when necessary.
Generally, the control need not be responsive to the bit stream to implement noise reduction filtering.
In this manner, the transcoder 300 can receive data having a variety of different formats, yet the output data will always have the desired, specified format.
The control 390 may also be programmed to provide a select signal to the pre-post-processing engine to provide a default output format.
Moreover, as shown in FIG. 4, a number of the transcoders may be used at the same time for processing data from different programming sources which may have different formats. The corresponding output formats can be made uniform and therefore suitable for use, e.g., by a decoder population in a broadband communication network.
For example, the transcoder apparatus 410 of FIG. 4 is shown having three individual transcoders 420, 425 and 430, where each transcoder has a corresponding post-pre-processing engine 422, 427, 432, respectively. Fewer or more transcoders may be used. Transcoder 1 (420) receives a corresponding pre-compressed bit stream having a first format (Format 1), while transcoder 2 (425) receives a pre-compressed bit stream having a second format (Format 2), and transcoder 3 (430) receives a pre-compressed bit stream having a third format (Format 3). The formats are assumed to be different from one another. The respective bit streams may also be provided to a master rate and format control engine 415, which can determine the format of the bit streams by reading the appropriate header information, although this is not generally required for noise reduction filtering.
The master rate and format control engine 415 communicates with the transcoders 420, 425 and 430 and the respective post-pre-processing engines 422, 425, 432 to send select signals to select one or more of the processing functions in the post-pre-processing engines. A user input may be provided for this purpose. As a result, it is possible to convert the bit streams to a common format, e.g., Format A. The converted bit streams, e.g., bit stream 1', 2' and 3', may be provided to a multiplexer (MUX) 435 to form a combined bit stream having the format A.
FIG. 5 illustrates a post-pre-processing engine for noise reduction/deblocking filtering of intermediate reconstructed frames in accordance with the present invention. For MPEG applications, sequence, picture, splice and macroblock (MB) head bits, and MVs can be copied into the new bitstream, with modifications as required.
Experiments have indicated that at low bit rates, it may be desirable to soften the picture prior to re-encoding. Accordingly, the post-pre-processing engine 350 may be provided with a low pass, or noise reduction filter 400 that can remove or attenuate unwanted high frequency information in the intermediate reconstructed frame.
Furthermore, MPEG video coding is a block coding technique. At low bit rates, the reconstructed video frames may show annoying block artifacts. The block artifacts are high frequency information, and hence require more bits to be re-encoded. An adaptive deblocking filter can significantly reduce block artifacts in the intermediate reconstructed frame, and therefore smooth/soften the block boundaries. Block artifacts are caused by spatial transformation and quantization of neighboring pixel blocks. By removing or reducing block artifacts, the re-encoder of the transcoder can allocate more bits for the more important low frequency information, thereby improving the quality of the resulting image.
The noise reduction/deblocking filter 400 may be selected from a variety of known filter types, including fixed or adaptive filters. Additionally, the filter may be 1-D (e.g., one dimensional), 2-D, or 3-D.
The noise reduction/deblocking filtering may be performed over the current reconstructed frame.
Moreover, pixels in a current block may be filtered using future pixels in another block in the same frame, as discussed in connection with FIGs 7(a) and 7 (b) below.
Furthermore, the filter 400 can also be used for converting the video format from interlaced scan to progressive scan, or vice versa, using known processing techniques. This kind of filter will smooth the vertical transition between lines in a frame. The filtering may be performed over the temporal domain.
FIG. 7(a) illustrates a scheme for filtering of pixel blocks in a frame using neighboring blocks in accordance with the present invention. In an image area 700a block (e.g., macroblock) 710 has neighboring blocks 715, 720, 725 and 730. To reduce the noise in each current block, pixels near the edge region of the current block may be filtered according to a weighted average or other function of the edge region pixel values in a neighboring block (see FIG. 7(b)) and other pixel values in the current block.
Note that in the image 700, the display scan order is assumed to progress from the top to the bottom of the image, and from left to right in each pixel line. Therefore, blocks 725 and 730 are future blocks relative to the current pixel 710.
Accordingly, a delay function 600 may be required, as shown in the post-pre-processing engine 350 of FIG. 6, to store the data from pixels 710, 715, 720 and 725, along with the intervening pixels, until pixel 730 is reached. Essentially, one full row of blocks is stored. Generally, the~delay should not be beyond one block row.
FIG. 7(b) illustrates filtering of pixels in the current block of FIG. 7(a) using pixels in a neighboring block in accordance with the present invention. Like numbered elements correspond to those of FIG. 7(a). An imaginary boundary 750 separates the current block 710 and a following neighboring block 730. Here, pixels in a bottom row 712 of block 710 may be filtered using pixels in a top row 732 of block 730. The filtering for each pixel may extend over one or more pixels in each direction.
FIG. 8 illustrates a post-pre-processing engine with a third processing function for noise reduction filtering of intermediate reconstructed frames with a delay function, and downsampling in accordance with the present invention. For a format conversion from high resolution to low resolution, a down sampling operation is added into the post-pre-processing engine 350. The transcoder 800 includes a decoder 310, and an encoder 850, where like-numbered elements correspond to those of the previous figures. Here, the post-pre-processing engine 350 includes a motion vector scaling/processing function 810, which reduces the length of the motion vectors in accordance with the reduction in the image size. The scaled motion vectors are provided from the function 810 to an optional motion estimation refinement function 820 at the encoder 850, which provides local refinement of the scaled motion vectors, if required.
The processing function 356 corresponds to the processing function 354 of FIG. 6-but adds a down 5 sampler 805.
Applications of the transcoder 800 include transcoding of a pre-compressed bitstream from a high spatial resolution to a low spatial resolution, e.g., from high-definition (HD) to standard-10 definition (SD), from SD to common intermediate format (CIF)/standard intermediate format (SIF), from CIF/SIF to quarter CIF (QCIF) or even smaller resolutions, or from a high color sampling ratio to a low color sampling ratio, e.g., from 4:4:4 to 15 4:2:2, or from 4:2:2 to 4:2:0.
Accordingly, it can be seen that the present invention provides a generic multi-functional transcoder architecture that converts one or more pre-compressed digital video bit streams into 20 corresponding bit streams at a specific bit rate and format. A post-pre-processing engine in the transcoder provides a number of processing functions for implementing the desired format conversions according to a user selection signal or an automatically generated selection signal.
Furthermore, the transcoder avoids the need for motion estimation.
The transcoder can handle pre-compressed digital video bit streams from a variety of sources and with a variety of formats. Moreover, a single generic transcoder type can be deployed in a network to handle a variety of formatting requirements, while the specific desired processing functions can be selected or revised at a later date.
Although the invention has been described in connection with various specific embodiments, those skilled in the art will appreciate that numerous adaptations and modifications may be made thereto without departing from the spirit and scope of the invention as set forth in the claims.
For example, while the invention was discussed in connection with a cable or satellite television broadband communication networks, it will be appreciated that other networks such as local area networks (LANs), metropolitan area networks (MANs), wide area networks (WANs), internets, intranets, and the Internet may be used.
Additionally, the invention is compatible with digital video standards other than MPEG-2.
Experiments have indicated that at low bit rates, it may be desirable to soften the picture prior to re-encoding. Accordingly, the post-pre-processing engine 350 may be provided with a low pass, or noise reduction filter 400 that can remove or attenuate unwanted high frequency information in the intermediate reconstructed frame.
Furthermore, MPEG video coding is a block coding technique. At low bit rates, the reconstructed video frames may show annoying block artifacts. The block artifacts are high frequency information, and hence require more bits to be re-encoded. An adaptive deblocking filter can significantly reduce block artifacts in the intermediate reconstructed frame, and therefore smooth/soften the block boundaries. Block artifacts are caused by spatial transformation and quantization of neighboring pixel blocks. By removing or reducing block artifacts, the re-encoder of the transcoder can allocate more bits for the more important low frequency information, thereby improving the quality of the resulting image.
The noise reduction/deblocking filter 400 may be selected from a variety of known filter types, including fixed or adaptive filters. Additionally, the filter may be 1-D (e.g., one dimensional), 2-D, or 3-D.
The noise reduction/deblocking filtering may be performed over the current reconstructed frame.
Moreover, pixels in a current block may be filtered using future pixels in another block in the same frame, as discussed in connection with FIGs 7(a) and 7 (b) below.
Furthermore, the filter 400 can also be used for converting the video format from interlaced scan to progressive scan, or vice versa, using known processing techniques. This kind of filter will smooth the vertical transition between lines in a frame. The filtering may be performed over the temporal domain.
FIG. 7(a) illustrates a scheme for filtering of pixel blocks in a frame using neighboring blocks in accordance with the present invention. In an image area 700a block (e.g., macroblock) 710 has neighboring blocks 715, 720, 725 and 730. To reduce the noise in each current block, pixels near the edge region of the current block may be filtered according to a weighted average or other function of the edge region pixel values in a neighboring block (see FIG. 7(b)) and other pixel values in the current block.
Note that in the image 700, the display scan order is assumed to progress from the top to the bottom of the image, and from left to right in each pixel line. Therefore, blocks 725 and 730 are future blocks relative to the current pixel 710.
Accordingly, a delay function 600 may be required, as shown in the post-pre-processing engine 350 of FIG. 6, to store the data from pixels 710, 715, 720 and 725, along with the intervening pixels, until pixel 730 is reached. Essentially, one full row of blocks is stored. Generally, the~delay should not be beyond one block row.
FIG. 7(b) illustrates filtering of pixels in the current block of FIG. 7(a) using pixels in a neighboring block in accordance with the present invention. Like numbered elements correspond to those of FIG. 7(a). An imaginary boundary 750 separates the current block 710 and a following neighboring block 730. Here, pixels in a bottom row 712 of block 710 may be filtered using pixels in a top row 732 of block 730. The filtering for each pixel may extend over one or more pixels in each direction.
FIG. 8 illustrates a post-pre-processing engine with a third processing function for noise reduction filtering of intermediate reconstructed frames with a delay function, and downsampling in accordance with the present invention. For a format conversion from high resolution to low resolution, a down sampling operation is added into the post-pre-processing engine 350. The transcoder 800 includes a decoder 310, and an encoder 850, where like-numbered elements correspond to those of the previous figures. Here, the post-pre-processing engine 350 includes a motion vector scaling/processing function 810, which reduces the length of the motion vectors in accordance with the reduction in the image size. The scaled motion vectors are provided from the function 810 to an optional motion estimation refinement function 820 at the encoder 850, which provides local refinement of the scaled motion vectors, if required.
The processing function 356 corresponds to the processing function 354 of FIG. 6-but adds a down 5 sampler 805.
Applications of the transcoder 800 include transcoding of a pre-compressed bitstream from a high spatial resolution to a low spatial resolution, e.g., from high-definition (HD) to standard-10 definition (SD), from SD to common intermediate format (CIF)/standard intermediate format (SIF), from CIF/SIF to quarter CIF (QCIF) or even smaller resolutions, or from a high color sampling ratio to a low color sampling ratio, e.g., from 4:4:4 to 15 4:2:2, or from 4:2:2 to 4:2:0.
Accordingly, it can be seen that the present invention provides a generic multi-functional transcoder architecture that converts one or more pre-compressed digital video bit streams into 20 corresponding bit streams at a specific bit rate and format. A post-pre-processing engine in the transcoder provides a number of processing functions for implementing the desired format conversions according to a user selection signal or an automatically generated selection signal.
Furthermore, the transcoder avoids the need for motion estimation.
The transcoder can handle pre-compressed digital video bit streams from a variety of sources and with a variety of formats. Moreover, a single generic transcoder type can be deployed in a network to handle a variety of formatting requirements, while the specific desired processing functions can be selected or revised at a later date.
Although the invention has been described in connection with various specific embodiments, those skilled in the art will appreciate that numerous adaptations and modifications may be made thereto without departing from the spirit and scope of the invention as set forth in the claims.
For example, while the invention was discussed in connection with a cable or satellite television broadband communication networks, it will be appreciated that other networks such as local area networks (LANs), metropolitan area networks (MANs), wide area networks (WANs), internets, intranets, and the Internet may be used.
Additionally, the invention is compatible with digital video standards other than MPEG-2.
Claims (37)
1. A method for transcoding compressed digital video data, comprising the steps of:
partially decompressing first compressed digital video data to provide first intermediate reconstructed data having an associated first format;
providing a post-pre-processing engine having a plurality of different available processing functions;
providing a first selection signal for selecting at least one of said processing functions;
processing said first intermediate reconstructed data according to said at least one selected processing function to provide corresponding first modified intermediate reconstructed data having a first modified format that is different than said first format; and compressing the first modified intermediate reconstructed data to provide first modified compressed digital video data with said first modified format.
partially decompressing first compressed digital video data to provide first intermediate reconstructed data having an associated first format;
providing a post-pre-processing engine having a plurality of different available processing functions;
providing a first selection signal for selecting at least one of said processing functions;
processing said first intermediate reconstructed data according to said at least one selected processing function to provide corresponding first modified intermediate reconstructed data having a first modified format that is different than said first format; and compressing the first modified intermediate reconstructed data to provide first modified compressed digital video data with said first modified format.
2. The method of claim 1, comprising the further step of:
processing said first compressed digital video data to change a bit rate thereof according to a second selection signal.
processing said first compressed digital video data to change a bit rate thereof according to a second selection signal.
3. The method of claim 1 or 2, wherein:
one of said plurality of different available processing functions processes said first intermediate reconstructed data with a noise-reduction filter.
one of said plurality of different available processing functions processes said first intermediate reconstructed data with a noise-reduction filter.
4. The method of claim 3, wherein:
said noise reduction filter is one of a fixed filter and an adaptive filter.
said noise reduction filter is one of a fixed filter and an adaptive filter.
5. The method of one of the preceding claims, wherein:
one of said plurality of different available processing functions delays at least a portion of said first intermediate reconstructed data to provide noise-reduction filtering of a current image region thereof using a future image region thereof.
one of said plurality of different available processing functions delays at least a portion of said first intermediate reconstructed data to provide noise-reduction filtering of a current image region thereof using a future image region thereof.
6. The method of claim 5, wherein:
said current image region and said future image region are in a common video frame; and said future image region follows said current image region according to a display scan sequence of said first intermediate reconstructed data.
said current image region and said future image region are in a common video frame; and said future image region follows said current image region according to a display scan sequence of said first intermediate reconstructed data.
7. The method of one of the preceding claims, wherein:
one of said plurality of different available processing functions provides said first modified intermediate reconstructed data with a different resolution than a resolution of said first intermediate reconstructed data.
one of said plurality of different available processing functions provides said first modified intermediate reconstructed data with a different resolution than a resolution of said first intermediate reconstructed data.
8. The method of one of the preceding claims, wherein:
one of said plurality of different available processing functions either (a) provides said first modified intermediate reconstructed data with an interlaced scan format when said first intermediate reconstructed data has a progressive scan format, or (b) provides said first modified intermediate reconstructed data with a progressive scan format when said first intermediate reconstructed data has an interlaced scan format.
one of said plurality of different available processing functions either (a) provides said first modified intermediate reconstructed data with an interlaced scan format when said first intermediate reconstructed data has a progressive scan format, or (b) provides said first modified intermediate reconstructed data with a progressive scan format when said first intermediate reconstructed data has an interlaced scan format.
9. The method of one of the preceding claims, wherein:
one of said plurality of different available processing functions provides said first modified intermediate reconstructed data with a color space sampling format that is different than a color space sampling format of said first intermediate reconstructed data.
one of said plurality of different available processing functions provides said first modified intermediate reconstructed data with a color space sampling format that is different than a color space sampling format of said first intermediate reconstructed data.
10. The method of one of the preceding claims, wherein:
one of said plurality of different available processing functions provides said first modified intermediate reconstructed data with a frame rate that is different than a frame rate of said first intermediate reconstructed data.
one of said plurality of different available processing functions provides said first modified intermediate reconstructed data with a frame rate that is different than a frame rate of said first intermediate reconstructed data.
11. The method of one of the preceding claims, wherein:
one of said plurality of different available processing functions provides said first modified intermediate reconstructed data with a frame size that is different than a frame size of said first intermediate reconstructed data.
one of said plurality of different available processing functions provides said first modified intermediate reconstructed data with a frame size that is different than a frame size of said first intermediate reconstructed data.
12. The method of one of the preceding claims, wherein:
said selection signal is user-designated.
said selection signal is user-designated.
13. The method of claims 1 to 11, wherein:
said selection signal is generated by a control in response to a detected characteristic of said first compressed digital video data.
said selection signal is generated by a control in response to a detected characteristic of said first compressed digital video data.
14. The method of one of the preceding claims, wherein:
said post-pre-processing engine is provided in a broadband communication network.
said post-pre-processing engine is provided in a broadband communication network.
15. The method of one of the preceding claims, wherein said method is adapted for transcoding a plurality of bit streams of compressed digital video data, comprising the further steps of:
partially decompressing second compressed digital video data to provide second intermediate reconstructed data having a second format that is different than said first format;
providing a second post-pre-processing engine having an associated plurality of different available processing functions;
providing a second selection signal for selecting at least one of said processing functions of said second post-pre-processing engine;
processing said second intermediate reconstructed data according to said at least one selected processing function of said second post-pre-processing engine to provide corresponding second modified intermediate reconstructed data having said first modified format;
and compressing the second modified intermediate reconstructed data to provide second modified compressed digital video data with said first modified format.
partially decompressing second compressed digital video data to provide second intermediate reconstructed data having a second format that is different than said first format;
providing a second post-pre-processing engine having an associated plurality of different available processing functions;
providing a second selection signal for selecting at least one of said processing functions of said second post-pre-processing engine;
processing said second intermediate reconstructed data according to said at least one selected processing function of said second post-pre-processing engine to provide corresponding second modified intermediate reconstructed data having said first modified format;
and compressing the second modified intermediate reconstructed data to provide second modified compressed digital video data with said first modified format.
16. The method of one of the preceding claims, comprising the further steps of:
obtaining motion vector data from said first intermediate reconstructed data; and providing said motion vector data for use in compressing the first modified intermediate reconstructed data; wherein:
said motion vector data is refined as required for use in said compressing step.
obtaining motion vector data from said first intermediate reconstructed data; and providing said motion vector data for use in compressing the first modified intermediate reconstructed data; wherein:
said motion vector data is refined as required for use in said compressing step.
17. An apparatus for transcoding compressed digital video data, comprising:
means for partially decompressing first compressed digital video data to provide first intermediate reconstructed data having an associated first format;
a post-pre-processing engine having a plurality of different available processing functions;
means for providing a first selection signal for selecting at least one of said processing functions;
wherein said post-pre-processing engine processes said first intermediate reconstructed data according to said at least one selected processing function to provide corresponding first modified intermediate reconstructed data having a first modified format that is different than said first format; and means for compressing the first modified intermediate reconstructed data to provide first modified compressed digital video data with said first modified format.
means for partially decompressing first compressed digital video data to provide first intermediate reconstructed data having an associated first format;
a post-pre-processing engine having a plurality of different available processing functions;
means for providing a first selection signal for selecting at least one of said processing functions;
wherein said post-pre-processing engine processes said first intermediate reconstructed data according to said at least one selected processing function to provide corresponding first modified intermediate reconstructed data having a first modified format that is different than said first format; and means for compressing the first modified intermediate reconstructed data to provide first modified compressed digital video data with said first modified format.
18. The apparatus of claim 17, further comprising:
means for processing said first compressed digital video data to change a bit rate thereof according to a second selection signal.
means for processing said first compressed digital video data to change a bit rate thereof according to a second selection signal.
19. The apparatus of claim 17 or 18, wherein:
said post-pre-processing engine comprises a noise-reduction filter for processing said first intermediate reconstructed data.
said post-pre-processing engine comprises a noise-reduction filter for processing said first intermediate reconstructed data.
20. The apparatus of claim 19, wherein:
said noise reduction filter is one of a fixed filter and an adaptive filter.
said noise reduction filter is one of a fixed filter and an adaptive filter.
21. The apparatus of one of claims 17 to 20, wherein:
said post-pre-processing engine comprises a delay associated with said noise-reduction filter for delaying at least a portion of said first intermediate reconstructed data to provide noise-reduction filtering of a current image region thereof using a future image region thereof.
said post-pre-processing engine comprises a delay associated with said noise-reduction filter for delaying at least a portion of said first intermediate reconstructed data to provide noise-reduction filtering of a current image region thereof using a future image region thereof.
22. The apparatus of claim 21, wherein:
said current image region and said future image region are in a common video frame; and said future image region follows said current image region according to a display scan sequence of said first intermediate reconstructed data.
said current image region and said future image region are in a common video frame; and said future image region follows said current image region according to a display scan sequence of said first intermediate reconstructed data.
23. The apparatus of one of claims 17 to 22, wherein:
said post-pre-processing engine provides said first modified intermediate reconstructed data with a different resolution than a resolution of said first intermediate reconstructed data.
said post-pre-processing engine provides said first modified intermediate reconstructed data with a different resolution than a resolution of said first intermediate reconstructed data.
24. The apparatus of one of claims 17 to 23, wherein:
said post-pre-processing engine either (a) provides said first modified intermediate reconstructed data with an interlaced scan format when said first intermediate reconstructed data has a progressive scan format, or (b) provides said first modified intermediate reconstructed data with a progressive scan format when said first intermediate reconstructed data has an interlaced scan format.
said post-pre-processing engine either (a) provides said first modified intermediate reconstructed data with an interlaced scan format when said first intermediate reconstructed data has a progressive scan format, or (b) provides said first modified intermediate reconstructed data with a progressive scan format when said first intermediate reconstructed data has an interlaced scan format.
25. The apparatus of one of claims 17 to 24, wherein:
said post-pre-processing engine provides said first modified intermediate reconstructed data with a color space sampling format that is different than a color space sampling format of said first intermediate reconstructed data.
said post-pre-processing engine provides said first modified intermediate reconstructed data with a color space sampling format that is different than a color space sampling format of said first intermediate reconstructed data.
26. The apparatus of one of claims 17 to 25, wherein:
said post-pre-processing engine provides said first modified intermediate reconstructed data with a frame rate that is different than a frame rate of said first intermediate reconstructed data.
said post-pre-processing engine provides said first modified intermediate reconstructed data with a frame rate that is different than a frame rate of said first intermediate reconstructed data.
27. The apparatus of one of claims 17 to 26, wherein:
said post-pre-processing engine provides said first modified intermediate reconstructed data with a frame size that is different than a frame size of said first intermediate reconstructed data.
said post-pre-processing engine provides said first modified intermediate reconstructed data with a frame size that is different than a frame size of said first intermediate reconstructed data.
28. The apparatus of one of claims 17 to 27, wherein:
said selection signal is user-designated.
said selection signal is user-designated.
29. The apparatus of one of claims 17 to 27, further comprising:
a control for generating said selection signal in response to a detected characteristic of said first compressed digital video data.
a control for generating said selection signal in response to a detected characteristic of said first compressed digital video data.
30. The apparatus of one of claims 17 to 29, wherein:
said post-pre-processing engine is provided in a broadband communication network.
said post-pre-processing engine is provided in a broadband communication network.
31. The apparatus of one of claims 17 to 30, wherein said apparatus is adapted for transcoding a plurality of bit streams of compressed digital video data, further comprising:
means for partially decompressing second compressed digital video data to provide second intermediate reconstructed data having an associated second format that is different than said first format;
a second post-pre-processing engine having an associated plurality of different available processing functions;
means for providing a second selection signal for selecting at least one of said processing functions of said second post-pre-processing engine;
wherein said second post-pre-processing engine processes said second intermediate reconstructed data according to said at least one selected processing function of said second post-pre-processing engine to provide corresponding second modified intermediate reconstructed data having said first modified format;
and means for compressing the second modified intermediate reconstructed data to provide second modified compressed digital video data with said first modified format.
means for partially decompressing second compressed digital video data to provide second intermediate reconstructed data having an associated second format that is different than said first format;
a second post-pre-processing engine having an associated plurality of different available processing functions;
means for providing a second selection signal for selecting at least one of said processing functions of said second post-pre-processing engine;
wherein said second post-pre-processing engine processes said second intermediate reconstructed data according to said at least one selected processing function of said second post-pre-processing engine to provide corresponding second modified intermediate reconstructed data having said first modified format;
and means for compressing the second modified intermediate reconstructed data to provide second modified compressed digital video data with said first modified format.
32. The apparatus of one of claims 17 to 31, further comprising:
means for obtaining motion vector data from said first intermediate reconstructed data; and means for providing said motion vector data for use by said compressing means in compressing the first modified intermediate reconstructed data; and means for refining said motion vector data as required for use by said compressing means.
means for obtaining motion vector data from said first intermediate reconstructed data; and means for providing said motion vector data for use by said compressing means in compressing the first modified intermediate reconstructed data; and means for refining said motion vector data as required for use by said compressing means.
33. A method for transcoding first compressed digital video data, comprising the steps of:
partially decompressing the first compressed digital video data to provide first intermediate reconstructed data having an associated first format;
providing a post-pre-processing engine having a plurality of different available processing functions;
providing a selection signal for selecting at least one of said processing functions;
partially decompressing the first compressed digital video data to provide first intermediate reconstructed data having an associated first format;
providing a post-pre-processing engine having a plurality of different available processing functions;
providing a selection signal for selecting at least one of said processing functions;
34 processing said first intermediate reconstructed data according to said at least one selected processing function to provide corresponding first modified intermediate reconstructed data having a first modified format that is different than said first format; and compressing the first modified intermediate reconstructed data to provide first modified compressed digital video data with said first modified format;
wherein:
said plurality of different available processing functions perform at least one of:
(a) processing said first intermediate reconstructed data with a noise-reduction filter;
(b) providing said first modified intermediate reconstructed data with a different resolution than a resolution of said first intermediate reconstructed data;
(c) providing said first modified intermediate reconstructed data with an interlaced scan format when said first intermediate reconstructed data has a progressive scan format;
(d) providing said first modified intermediate reconstructed data with a progressive scan format when said first intermediate reconstructed data has an interlaced scan format;
wherein:
said plurality of different available processing functions perform at least one of:
(a) processing said first intermediate reconstructed data with a noise-reduction filter;
(b) providing said first modified intermediate reconstructed data with a different resolution than a resolution of said first intermediate reconstructed data;
(c) providing said first modified intermediate reconstructed data with an interlaced scan format when said first intermediate reconstructed data has a progressive scan format;
(d) providing said first modified intermediate reconstructed data with a progressive scan format when said first intermediate reconstructed data has an interlaced scan format;
35 (e) providing said first modified intermediate reconstructed data with a color space sampling format that is different than a color space sampling format of said first intermediate reconstructed data;
(f) providing said first modified intermediate reconstructed data with a frame rate that is different than a frame rate of said first intermediate reconstructed data; and (g) providing said first modified intermediate reconstructed data with a frame size that is different than a frame size of said first intermediate reconstructed data.
34. An apparatus for transcoding first compressed digital video data, comprising:
means for partially decompressing the first compressed digital video data to provide first intermediate reconstructed data having an associated first format;
a post-pre-processing engine having a plurality of different available processing functions;
means for providing a selection signal for selecting at least one of said processing functions;
wherein said post-pre-processing engine processes said first intermediate reconstructed data according to
(f) providing said first modified intermediate reconstructed data with a frame rate that is different than a frame rate of said first intermediate reconstructed data; and (g) providing said first modified intermediate reconstructed data with a frame size that is different than a frame size of said first intermediate reconstructed data.
34. An apparatus for transcoding first compressed digital video data, comprising:
means for partially decompressing the first compressed digital video data to provide first intermediate reconstructed data having an associated first format;
a post-pre-processing engine having a plurality of different available processing functions;
means for providing a selection signal for selecting at least one of said processing functions;
wherein said post-pre-processing engine processes said first intermediate reconstructed data according to
36 said at least one selected processing function to provide corresponding first modified intermediate reconstructed data having a first modified format that is different than said first format; and means for compressing the first modified intermediate reconstructed data to provide first modified compressed digital video data with said first modified format; wherein:
said plurality of different available processing functions perform at least one of:
(a) processing said first intermediate reconstructed data with a noise-reduction filter;
(b) providing said first modified intermediate reconstructed data with a different resolution than a resolution of said first intermediate reconstructed data;
(c) providing said first modified intermediate reconstructed data with an interlaced scan format when said first intermediate reconstructed data has a progressive scan format;
(d) providing said first modified intermediate reconstructed data with a progressive scan format when said first intermediate reconstructed data has an interlaced scan format;
said plurality of different available processing functions perform at least one of:
(a) processing said first intermediate reconstructed data with a noise-reduction filter;
(b) providing said first modified intermediate reconstructed data with a different resolution than a resolution of said first intermediate reconstructed data;
(c) providing said first modified intermediate reconstructed data with an interlaced scan format when said first intermediate reconstructed data has a progressive scan format;
(d) providing said first modified intermediate reconstructed data with a progressive scan format when said first intermediate reconstructed data has an interlaced scan format;
37 (e) providing said first modified intermediate reconstructed data with a color space sampling format that is different than a color space sampling format of said first intermediate reconstructed data;
(f) providing said first modified intermediate reconstructed data with a frame rate that is different than a frame rate of said first intermediate reconstructed data; and (g) providing said first modified intermediate reconstructed data with a frame size that is different than a frame size of said first intermediate reconstructed data.
(f) providing said first modified intermediate reconstructed data with a frame rate that is different than a frame rate of said first intermediate reconstructed data; and (g) providing said first modified intermediate reconstructed data with a frame size that is different than a frame size of said first intermediate reconstructed data.
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US09/226,796 | 1999-01-07 | ||
US09/226,796 US6434197B1 (en) | 1999-01-07 | 1999-01-07 | Multi-functional transcoder for compressed bit streams |
Publications (1)
Publication Number | Publication Date |
---|---|
CA2293927A1 true CA2293927A1 (en) | 2000-07-07 |
Family
ID=22850444
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CA002293927A Abandoned CA2293927A1 (en) | 1999-01-07 | 1999-12-31 | Multi-functional transcoder for compressed bit streams |
Country Status (3)
Country | Link |
---|---|
US (1) | US6434197B1 (en) |
EP (1) | EP1032217A3 (en) |
CA (1) | CA2293927A1 (en) |
Families Citing this family (128)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US6584154B1 (en) * | 1998-11-26 | 2003-06-24 | Oki Electric Industry Co., Ltd. | Moving-picture coding and decoding method and apparatus with reduced computational cost |
EP1032212A3 (en) * | 1999-02-23 | 2004-04-28 | Matsushita Electric Industrial Co., Ltd. | Transcoder, transcoding system, and recording medium |
JP2000244921A (en) * | 1999-02-24 | 2000-09-08 | Matsushita Electric Ind Co Ltd | Method and device for coding video image |
US7593433B1 (en) * | 1999-03-02 | 2009-09-22 | Cisco Technology, Inc. | System and method for multiple channel statistical re-multiplexing |
WO2000060872A1 (en) * | 1999-03-31 | 2000-10-12 | Matsushita Electric Industrial Co., Ltd. | Method and device for seamless-decoding video stream including streams having different frame rates |
EP1243141B1 (en) | 1999-12-14 | 2011-10-19 | Scientific-Atlanta, LLC | System and method for adaptive decoding of a video signal with coordinated resource allocation |
JP2001251616A (en) * | 2000-03-02 | 2001-09-14 | Media Glue Corp | Method and device for converting multiplexed sound/ moving picture compressing-coded signal, and medium recorded with conversion program |
CN1197386C (en) * | 2000-04-18 | 2005-04-13 | 皇家菲利浦电子有限公司 | Bit rate allocation in joint bit rate transcoding |
JP2001339460A (en) * | 2000-05-26 | 2001-12-07 | Matsushita Electric Ind Co Ltd | Digital transmitting and receiving device |
US6647061B1 (en) * | 2000-06-09 | 2003-11-11 | General Instrument Corporation | Video size conversion and transcoding from MPEG-2 to MPEG-4 |
US6671320B1 (en) * | 2000-06-16 | 2003-12-30 | Lucent Technologies Inc. | CIF to QCIF video bitstream down conversion |
US6909812B1 (en) * | 2000-07-13 | 2005-06-21 | Lucent Technologies Inc. | Methods and apparatus for nearly lossless-concatenated block transform coding |
JP3489735B2 (en) * | 2000-08-16 | 2004-01-26 | 松下電器産業株式会社 | Deblocking filter operation unit |
KR20020064963A (en) * | 2000-10-24 | 2002-08-10 | 코닌클리케 필립스 일렉트로닉스 엔.브이. | Method of transcoding and transcoding device with embedded filters |
US6748020B1 (en) * | 2000-10-25 | 2004-06-08 | General Instrument Corporation | Transcoder-multiplexer (transmux) software architecture |
US20020057363A1 (en) * | 2000-11-15 | 2002-05-16 | Satoru Todate | Image data conversion method and apparatus for converting compressed image data to image data of different format |
US6628709B2 (en) * | 2000-12-21 | 2003-09-30 | Matsushita Electric Corporation Of America | Bit number prediction for VLC coded DCT coefficients and its application in DV encoding/transcoding |
US6407680B1 (en) | 2000-12-22 | 2002-06-18 | Generic Media, Inc. | Distributed on-demand media transcoding system and method |
US7242324B2 (en) | 2000-12-22 | 2007-07-10 | Sony Corporation | Distributed on-demand media transcoding system and method |
EP1354481A2 (en) | 2001-01-12 | 2003-10-22 | Koninklijke Philips Electronics N.V. | Method and device for scalable video transcoding |
US6925501B2 (en) * | 2001-04-17 | 2005-08-02 | General Instrument Corporation | Multi-rate transcoder for digital streams |
FR2823943A1 (en) * | 2001-04-24 | 2002-10-25 | Koninkl Philips Electronics Nv | MPEG coded digital video signal noise detection/noise reduction transcoding process having current image detected/coding search carried out finding reference coded macroblocks/noisy macroblock separated out. |
DE10120806B4 (en) * | 2001-04-27 | 2005-12-15 | Fenkart Informatik & Telekommunikations Kg | Device and method for the transmission of multimedia data objects |
WO2002100112A1 (en) * | 2001-06-03 | 2002-12-12 | Seelive Ltd. | System and method for rapid video compression |
DE10129108A1 (en) * | 2001-06-16 | 2003-01-02 | Harman Becker Automotive Sys | Method and circuit arrangement for data transmission |
US7480703B2 (en) | 2001-11-09 | 2009-01-20 | Sony Corporation | System, method, and computer program product for remotely determining the configuration of a multi-media content user based on response of the user |
US7730165B2 (en) | 2001-11-09 | 2010-06-01 | Sony Corporation | System, method, and computer program product for remotely determining the configuration of a multi-media content user |
US7356575B1 (en) | 2001-11-09 | 2008-04-08 | Sony Corporation | System, method, and computer program product for remotely determining the configuration of a multi-media content user |
US6674804B1 (en) * | 2001-11-12 | 2004-01-06 | Bigband Networks, Inc. | Method for generating a multiplexed sequence of media units |
US20030093515A1 (en) * | 2001-11-14 | 2003-05-15 | Kauffman Marc W. | Quality of service control of streamed content delivery |
US7292602B1 (en) * | 2001-12-27 | 2007-11-06 | Cisco Techonology, Inc. | Efficient available bandwidth usage in transmission of compressed video data |
US7274857B2 (en) | 2001-12-31 | 2007-09-25 | Scientific-Atlanta, Inc. | Trick modes for compressed video streams |
EP1333681A3 (en) | 2002-01-31 | 2004-12-08 | Samsung Electronics Co., Ltd. | Filtering method and apparatus for reducing block artifacts or ringing noise |
US7295610B2 (en) * | 2002-03-27 | 2007-11-13 | Scientific-Atlanta, Inc. | Hybrid rate control in a digital stream transcoder |
US7236521B2 (en) * | 2002-03-27 | 2007-06-26 | Scientific-Atlanta, Inc. | Digital stream transcoder |
US7190723B2 (en) * | 2002-03-27 | 2007-03-13 | Scientific-Atlanta, Inc. | Digital stream transcoder with a hybrid-rate controller |
US7319415B2 (en) * | 2002-05-01 | 2008-01-15 | Thomson Licensing | Chroma deblocking filter |
US6907079B2 (en) * | 2002-05-01 | 2005-06-14 | Thomson Licensing S.A. | Deblocking filter conditioned on pixel brightness |
US7009655B2 (en) * | 2002-07-23 | 2006-03-07 | Mediostream, Inc. | Method and system for direct recording of video information onto a disk medium |
US7529276B1 (en) | 2002-09-03 | 2009-05-05 | Cisco Technology, Inc. | Combined jitter and multiplexing systems and methods |
EP1418764A1 (en) | 2002-11-05 | 2004-05-12 | STMicroelectronics S.A. | Method and apparatus for transcoding sub-picture data, and video display system comprising such apparatus |
WO2004056082A2 (en) * | 2002-11-27 | 2004-07-01 | Rgb Media, Inc. | Method and apparatus for time-multiplexed processing of multiple digital video programs |
US8631451B2 (en) * | 2002-12-11 | 2014-01-14 | Broadcom Corporation | Server architecture supporting adaptive delivery to a variety of media players |
US20040150745A1 (en) * | 2003-01-20 | 2004-08-05 | Hideki Aiba | Video data transmitting/receiving method |
WO2004095825A2 (en) * | 2003-04-21 | 2004-11-04 | Rgb Networks, Inc. | Time-multiplexed multi-program encryption system |
US7898951B2 (en) * | 2003-08-13 | 2011-03-01 | Jones Farm Technology 2, Llc | Encoding and transmitting variable bit streams with utilization of a constrained bit-rate channel |
CA2537280C (en) * | 2003-08-29 | 2014-04-01 | Rgb Networks, Inc. | Advanced, self-balancing video multiplexer system |
US7966642B2 (en) * | 2003-09-15 | 2011-06-21 | Nair Ajith N | Resource-adaptive management of video storage |
US9325998B2 (en) * | 2003-09-30 | 2016-04-26 | Sharp Laboratories Of America, Inc. | Wireless video transmission system |
KR20050049964A (en) * | 2003-11-24 | 2005-05-27 | 엘지전자 주식회사 | Apparatus for high speed resolution changing of compressed digital video |
US7860161B2 (en) * | 2003-12-15 | 2010-12-28 | Microsoft Corporation | Enhancement layer transcoding of fine-granular scalable video bitstreams |
KR100713477B1 (en) * | 2004-03-23 | 2007-05-02 | 삼성전자주식회사 | Apparatus and method for realtime changing of video quality in digital camcorder |
US20050232497A1 (en) * | 2004-04-15 | 2005-10-20 | Microsoft Corporation | High-fidelity transcoding |
US8600217B2 (en) * | 2004-07-14 | 2013-12-03 | Arturo A. Rodriguez | System and method for improving quality of displayed picture during trick modes |
BRPI0506163B1 (en) * | 2004-09-20 | 2018-11-13 | Divx Inc | unlocking method of a reconstructed video frame |
US8356327B2 (en) * | 2004-10-30 | 2013-01-15 | Sharp Laboratories Of America, Inc. | Wireless video transmission system |
CN100373953C (en) * | 2004-12-29 | 2008-03-05 | 华为技术有限公司 | Method for converting coding of video image in conversion equipment |
US20060265382A1 (en) * | 2005-05-17 | 2006-11-23 | Sbc Knowledge Ventures, L.P. | Method and system of managing electronic data |
JP4817990B2 (en) * | 2005-08-17 | 2011-11-16 | キヤノン株式会社 | IMAGING DEVICE, ITS CONTROL METHOD, PROGRAM, AND STORAGE MEDIUM |
US9544602B2 (en) * | 2005-12-30 | 2017-01-10 | Sharp Laboratories Of America, Inc. | Wireless video transmission system |
US8102916B1 (en) * | 2006-01-12 | 2012-01-24 | Zenverge, Inc. | Dynamically changing media compression format in compressed domain |
US7830800B1 (en) | 2006-01-12 | 2010-11-09 | Zenverge, Inc. | Architecture for combining media processing with networking |
US7672377B2 (en) * | 2006-04-21 | 2010-03-02 | Dilithium Holdings, Inc. | Method and system for video encoding and transcoding |
US8087044B2 (en) * | 2006-09-18 | 2011-12-27 | Rgb Networks, Inc. | Methods, apparatus, and systems for managing the insertion of overlay content into a video signal |
US7688889B2 (en) * | 2006-09-18 | 2010-03-30 | Rgb Networks, Inc. | Methods, apparatus, and systems for insertion of overlay content into a video signal with transrating capabilities |
CN101529731B (en) * | 2006-09-18 | 2013-01-02 | Rgb网络有限公司 | Method and apparatus for modifying a data rate of a video signal |
US7801213B2 (en) * | 2006-09-18 | 2010-09-21 | Rgb Networks, Inc. | Method and apparatus for modifying a data rate of a video signal |
US8311114B1 (en) | 2006-12-06 | 2012-11-13 | Zenverge, Inc. | Streamlined transcoder architecture |
WO2008085874A2 (en) | 2007-01-05 | 2008-07-17 | Marvell World Trade Ltd. | Methods and systems for improving low-resolution video |
WO2008090793A1 (en) * | 2007-01-22 | 2008-07-31 | Nec Corporation | Image re-encoding device, image re-encoding method, and image encoding program |
CN101669361B (en) | 2007-02-16 | 2013-09-25 | 马维尔国际贸易有限公司 | Methods and systems for improving low resolution and low frame rate video |
US20080263621A1 (en) * | 2007-04-17 | 2008-10-23 | Horizon Semiconductors Ltd. | Set top box with transcoding capabilities |
US8861591B2 (en) * | 2007-05-11 | 2014-10-14 | Advanced Micro Devices, Inc. | Software video encoder with GPU acceleration |
US8233527B2 (en) * | 2007-05-11 | 2012-07-31 | Advanced Micro Devices, Inc. | Software video transcoder with GPU acceleration |
US20090033791A1 (en) * | 2007-07-31 | 2009-02-05 | Scientific-Atlanta, Inc. | Video processing systems and methods |
US8457958B2 (en) | 2007-11-09 | 2013-06-04 | Microsoft Corporation | Audio transcoder using encoder-generated side information to transcode to target bit-rate |
EP2229779A1 (en) * | 2007-12-11 | 2010-09-22 | Thomson Licensing | Methods and systems for transcoding within the distribution chain |
WO2009091387A1 (en) * | 2008-01-17 | 2009-07-23 | Thomson Licensing | Reduced video flicker |
US8265168B1 (en) | 2008-02-01 | 2012-09-11 | Zenverge, Inc. | Providing trick mode for video stream transmitted over network |
WO2009097284A1 (en) * | 2008-02-01 | 2009-08-06 | Zenverge, Inc. | Intermediate compression of reference frames for transcoding |
US8164862B2 (en) * | 2008-04-02 | 2012-04-24 | Headway Technologies, Inc. | Seed layer for TMR or CPP-GMR sensor |
US8290036B2 (en) * | 2008-06-11 | 2012-10-16 | Optibase Technologies Ltd. | Method, apparatus and system for concurrent processing of multiple video streams |
US8300696B2 (en) * | 2008-07-25 | 2012-10-30 | Cisco Technology, Inc. | Transcoding for systems operating under plural video coding specifications |
US8526506B1 (en) * | 2008-08-15 | 2013-09-03 | Ipera Technology, Inc. | System and method for transcoding with quality enhancement |
US8326075B2 (en) * | 2008-09-11 | 2012-12-04 | Google Inc. | System and method for video encoding using adaptive loop filter |
BRPI0917087A2 (en) * | 2008-09-22 | 2016-06-14 | Avot Media Inc | video transmission device with quantization and quantization method |
BRPI0921986A2 (en) * | 2008-11-25 | 2018-06-05 | Thomson Licensing | methods and apparatus for filtering out sparse matrix artifacts for video encoding and decoding |
US8798150B2 (en) * | 2008-12-05 | 2014-08-05 | Motorola Mobility Llc | Bi-directional video compression for real-time video streams during transport in a packet switched network |
KR101149522B1 (en) * | 2008-12-15 | 2012-05-25 | 한국전자통신연구원 | Apparatus and method for detecting scene change |
US8396114B2 (en) * | 2009-01-29 | 2013-03-12 | Microsoft Corporation | Multiple bit rate video encoding using variable bit rate and dynamic resolution for adaptive video streaming |
US8311115B2 (en) | 2009-01-29 | 2012-11-13 | Microsoft Corporation | Video encoding using previously calculated motion information |
US8270473B2 (en) * | 2009-06-12 | 2012-09-18 | Microsoft Corporation | Motion based dynamic resolution multiple bit rate video encoding |
US9615098B1 (en) * | 2009-11-30 | 2017-04-04 | Google Inc. | Adaptive resolution transcoding for optimal visual quality |
US8705616B2 (en) | 2010-06-11 | 2014-04-22 | Microsoft Corporation | Parallel multiple bitrate video encoding to reduce latency and dependences between groups of pictures |
WO2012050832A1 (en) | 2010-09-28 | 2012-04-19 | Google Inc. | Systems and methods utilizing efficient video compression techniques for providing static image data |
US9538128B2 (en) * | 2011-02-28 | 2017-01-03 | Cisco Technology, Inc. | System and method for managing video processing in a network environment |
US8938001B1 (en) | 2011-04-05 | 2015-01-20 | Google Inc. | Apparatus and method for coding using combinations |
US8780996B2 (en) | 2011-04-07 | 2014-07-15 | Google, Inc. | System and method for encoding and decoding video data |
US8780971B1 (en) | 2011-04-07 | 2014-07-15 | Google, Inc. | System and method of encoding using selectable loop filters |
US8781004B1 (en) | 2011-04-07 | 2014-07-15 | Google Inc. | System and method for encoding video using variable loop filter |
US8989256B2 (en) | 2011-05-25 | 2015-03-24 | Google Inc. | Method and apparatus for using segmentation-based coding of prediction information |
US8891616B1 (en) | 2011-07-27 | 2014-11-18 | Google Inc. | Method and apparatus for entropy encoding based on encoding cost |
US9591318B2 (en) | 2011-09-16 | 2017-03-07 | Microsoft Technology Licensing, Llc | Multi-layer encoding and decoding |
US8885706B2 (en) | 2011-09-16 | 2014-11-11 | Google Inc. | Apparatus and methodology for a video codec system with noise reduction capability |
US9247257B1 (en) | 2011-11-30 | 2016-01-26 | Google Inc. | Segmentation based entropy encoding and decoding |
US11089343B2 (en) | 2012-01-11 | 2021-08-10 | Microsoft Technology Licensing, Llc | Capability advertisement, configuration and control for video coding and decoding |
US9386267B1 (en) * | 2012-02-14 | 2016-07-05 | Arris Enterprises, Inc. | Cooperative transcoding to multiple streams |
US9094681B1 (en) | 2012-02-28 | 2015-07-28 | Google Inc. | Adaptive segmentation |
US9131073B1 (en) | 2012-03-02 | 2015-09-08 | Google Inc. | Motion estimation aided noise reduction |
US11039138B1 (en) | 2012-03-08 | 2021-06-15 | Google Llc | Adaptive coding of prediction modes using probability distributions |
US9113164B1 (en) | 2012-05-15 | 2015-08-18 | Google Inc. | Constant bit rate control using implicit quantization values |
US9774856B1 (en) | 2012-07-02 | 2017-09-26 | Google Inc. | Adaptive stochastic entropy coding |
US9344729B1 (en) | 2012-07-11 | 2016-05-17 | Google Inc. | Selective prediction signal filtering |
US9332276B1 (en) | 2012-08-09 | 2016-05-03 | Google Inc. | Variable-sized super block based direct prediction mode |
US9510019B2 (en) | 2012-08-09 | 2016-11-29 | Google Inc. | Two-step quantization and coding method and apparatus |
US9380298B1 (en) | 2012-08-10 | 2016-06-28 | Google Inc. | Object-based intra-prediction |
US9826229B2 (en) | 2012-09-29 | 2017-11-21 | Google Technology Holdings LLC | Scan pattern determination from base layer pixel information for scalable extension |
US9407915B2 (en) | 2012-10-08 | 2016-08-02 | Google Inc. | Lossless video coding with sub-frame level optimal quantization values |
US9369732B2 (en) | 2012-10-08 | 2016-06-14 | Google Inc. | Lossless intra-prediction video coding |
US9350988B1 (en) | 2012-11-20 | 2016-05-24 | Google Inc. | Prediction mode-based block ordering in video coding |
US9681128B1 (en) | 2013-01-31 | 2017-06-13 | Google Inc. | Adaptive pre-transform scanning patterns for video and image compression |
US9197909B2 (en) * | 2013-03-14 | 2015-11-24 | Comcast Cable Communications, Llc | Allocation of clamping functionality |
US9998750B2 (en) | 2013-03-15 | 2018-06-12 | Cisco Technology, Inc. | Systems and methods for guided conversion of video from a first to a second compression format |
US9509998B1 (en) | 2013-04-04 | 2016-11-29 | Google Inc. | Conditional predictive multi-symbol run-length coding |
US9392288B2 (en) | 2013-10-17 | 2016-07-12 | Google Inc. | Video coding using scatter-based scan tables |
US9179151B2 (en) | 2013-10-18 | 2015-11-03 | Google Inc. | Spatial proximity context entropy coding |
US9521176B2 (en) | 2014-05-21 | 2016-12-13 | Sony Corporation | System, method, and computer program product for media publishing request processing |
US10996980B2 (en) * | 2018-04-23 | 2021-05-04 | Avago Technologies International Sales Pte. Limited | Multi-threaded command processing system |
Family Cites Families (27)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
DE2837120A1 (en) | 1977-09-01 | 1979-03-15 | British Broadcasting Corp | METHOD AND ARRANGEMENT FOR PROCESSING PAL COLOR TELEVISION SIGNALS IN DIGITAL FORM |
US4550335A (en) | 1981-02-02 | 1985-10-29 | Rca Corporation | Compatible and hierarchical digital television system standard |
JPH05168044A (en) | 1991-12-18 | 1993-07-02 | Yamaha Corp | Noise reducing device for composite video signal |
GB2264417B (en) | 1992-02-17 | 1995-12-06 | Sony Broadcast & Communication | Video standards conversion |
US5887115A (en) | 1993-01-13 | 1999-03-23 | Hitachi America, Ltd. | Method and apparatus for implementing a video tape recorder for recording digital video signals having either a fixed or variable data transmission rate |
US5477397A (en) | 1993-02-23 | 1995-12-19 | Matsushita Electric Corporation Of America | Digital high definition television receiver with features that facilitate trick-play modes on a digital VCR |
EP0624032B1 (en) | 1993-05-07 | 2000-07-26 | Lg Electronics Inc. | Video format conversion apparatus and method |
KR950014858B1 (en) | 1993-06-04 | 1995-12-16 | 대우전자주식회사 | Digital image recording apparatus |
NL9301358A (en) | 1993-08-04 | 1995-03-01 | Nederland Ptt | Transcoder. |
US5519446A (en) * | 1993-11-13 | 1996-05-21 | Goldstar Co., Ltd. | Apparatus and method for converting an HDTV signal to a non-HDTV signal |
EP0661885A1 (en) * | 1993-12-28 | 1995-07-05 | Canon Kabushiki Kaisha | Image processing method and apparatus for converting between data coded in different formats |
US5512956A (en) | 1994-02-04 | 1996-04-30 | At&T Corp. | Adaptive spatial-temporal postprocessing for low bit-rate coded image sequences |
JP2933487B2 (en) * | 1994-07-15 | 1999-08-16 | 松下電器産業株式会社 | How to convert chroma format |
US5781184A (en) | 1994-09-23 | 1998-07-14 | Wasserman; Steve C. | Real time decompression and post-decompress manipulation of compressed full motion video |
US5617142A (en) | 1994-11-08 | 1997-04-01 | General Instrument Corporation Of Delaware | Method and apparatus for changing the compression level of a compressed digital signal |
US5619733A (en) | 1994-11-10 | 1997-04-08 | International Business Machines Corporation | Method and apparatus for synchronizing streaming and non-streaming multimedia devices by controlling the play speed of the non-streaming device in response to a synchronization signal |
DE69607696T2 (en) | 1995-02-15 | 2000-10-19 | Koninkl Philips Electronics Nv | DEVICE AND METHOD FOR TRANSCODING VIDEO SIGNALS |
US5513181A (en) * | 1995-02-17 | 1996-04-30 | At&T Corp. | Multi-signal multi-coder transcoder |
US5610942A (en) | 1995-03-07 | 1997-03-11 | Chen; Keping | Digital signal transcoder and method of transcoding a digital signal |
US5737032A (en) | 1995-09-05 | 1998-04-07 | Videotek, Inc. | Serial digital video processing with concurrent adjustment in RGB and luminance/color difference |
DE69730419T2 (en) * | 1996-04-12 | 2005-09-08 | Imedia Corp., San Francisco | System for distributing compressed video signals, with statistical multiplexer with transcoders |
US6389174B1 (en) * | 1996-05-03 | 2002-05-14 | Intel Corporation | Video transcoding with interim encoding format |
US5933500A (en) | 1996-05-31 | 1999-08-03 | Thomson Consumer Electronics, Inc. | Adaptive decoding system for processing encrypted and non-encrypted broadcast, cable or satellite video data |
US5953506A (en) * | 1996-12-17 | 1999-09-14 | Adaptive Media Technologies | Method and apparatus that provides a scalable media delivery system |
US6058143A (en) * | 1998-02-20 | 2000-05-02 | Thomson Licensing S.A. | Motion vector extrapolation for transcoding video sequences |
US6226328B1 (en) * | 1998-05-01 | 2001-05-01 | Boom Corporation | Transcoding apparatus for digital video networking |
US6167084A (en) | 1998-08-27 | 2000-12-26 | Motorola, Inc. | Dynamic bit allocation for statistical multiplexing of compressed and uncompressed digital video signals |
-
1999
- 1999-01-07 US US09/226,796 patent/US6434197B1/en not_active Expired - Lifetime
- 1999-12-23 EP EP99125721A patent/EP1032217A3/en not_active Withdrawn
- 1999-12-31 CA CA002293927A patent/CA2293927A1/en not_active Abandoned
Also Published As
Publication number | Publication date |
---|---|
EP1032217A3 (en) | 2001-12-05 |
EP1032217A2 (en) | 2000-08-30 |
US6434197B1 (en) | 2002-08-13 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US6434197B1 (en) | Multi-functional transcoder for compressed bit streams | |
KR100934290B1 (en) | MPEG-2 4: 2: 2-Method and Architecture for Converting a Profile Bitstream to a Main-Profile Bitstream | |
US6081295A (en) | Method and apparatus for transcoding bit streams with video data | |
US7330509B2 (en) | Method for video transcoding with adaptive frame rate control | |
US7194032B1 (en) | Circuit and method for modifying a region of an encoded image | |
EP0707426B1 (en) | Digital video decoder for decoding digital high definition and/or digital standard definition television signals | |
EP1257127B1 (en) | Video transcoder with spatial resolution reduction | |
US7787541B2 (en) | Dynamic pre-filter control with subjective noise detector for video compression | |
US20120076203A1 (en) | Video encoding device, video decoding device, video encoding method, and video decoding method | |
AU2007231799B8 (en) | High-performance video transcoding method | |
US9071844B2 (en) | Motion estimation with motion vector penalty | |
US6456661B1 (en) | Method of transcoding coded digital signals and corresponding transcoder | |
EP0951184A1 (en) | Method for converting digital signal and apparatus for converting digital signal | |
JP4163006B2 (en) | Video transcoder with drift correction | |
US6498816B1 (en) | Circuit and method for formatting each of a series of encoded video images into respective regions | |
US20010016010A1 (en) | Apparatus for receiving digital moving picture | |
JP2003520513A (en) | Image data compression | |
JP2003061091A (en) | Method and apparatus for up-sampling compressed bitstream | |
MXPA00000319A (en) | Multi-functional transcoder for compressed bit stream | |
Youn et al. | Adaptive motion vector refinement for high performance transcoding | |
Akujuobi | Application of Wavelets to Video Compression | |
Wang et al. | Efficient video downscaling transcoder from MPEG-2 to H. 264 | |
KR980012955A (en) | Image encoder and / or decoder using iterative motion prediction / compensation | |
JP2001145108A (en) | Device and method for converting image information |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
EEER | Examination request | ||
FZDE | Discontinued |