US8983834B2 - Multichannel audio coding - Google Patents

Multichannel audio coding Download PDF

Info

Publication number
US8983834B2
US8983834B2 US10/591,374 US59137405A US8983834B2 US 8983834 B2 US8983834 B2 US 8983834B2 US 59137405 A US59137405 A US 59137405A US 8983834 B2 US8983834 B2 US 8983834B2
Authority
US
United States
Prior art keywords
subband
angle
channel
channels
audio
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active, expires
Application number
US10/591,374
Other versions
US20070140499A1 (en
Inventor
Mark Franklin Davis
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Dolby Laboratories Licensing Corp
Original Assignee
Dolby Laboratories Licensing Corp
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Dolby Laboratories Licensing Corp filed Critical Dolby Laboratories Licensing Corp
Priority to US10/591,374 priority Critical patent/US8983834B2/en
Assigned to DOLBY LABORATORIES LICENSING CORPORATION reassignment DOLBY LABORATORIES LICENSING CORPORATION ASSIGNMENT OF ASSIGNORS INTEREST (SEE DOCUMENT FOR DETAILS). Assignors: DAVIS, MARK FRANKLIN
Publication of US20070140499A1 publication Critical patent/US20070140499A1/en
Priority to US11/888,657 priority patent/US8170882B2/en
Priority to US12/283,712 priority patent/US20090299756A1/en
Priority to US14/614,672 priority patent/US9311922B2/en
Application granted granted Critical
Publication of US8983834B2 publication Critical patent/US8983834B2/en
Priority to US15/060,425 priority patent/US9520135B2/en
Priority to US15/060,382 priority patent/US9454969B2/en
Priority to US15/344,137 priority patent/US9640188B2/en
Priority to US15/422,119 priority patent/US9691404B2/en
Priority to US15/422,107 priority patent/US9715882B2/en
Priority to US15/422,132 priority patent/US9672839B1/en
Priority to US15/446,663 priority patent/US9697842B1/en
Priority to US15/446,678 priority patent/US9691405B1/en
Priority to US15/446,693 priority patent/US9704499B1/en
Priority to US15/446,699 priority patent/US9779745B2/en
Priority to US15/691,309 priority patent/US10269364B2/en
Priority to US16/226,289 priority patent/US10403297B2/en
Priority to US16/226,252 priority patent/US10460740B2/en
Priority to US16/666,276 priority patent/US10796706B2/en
Active legal-status Critical Current
Adjusted expiration legal-status Critical

Links

Images

Classifications

    • GPHYSICS
    • G10MUSICAL INSTRUMENTS; ACOUSTICS
    • G10LSPEECH ANALYSIS OR SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING; SPEECH OR AUDIO CODING OR DECODING
    • G10L19/00Speech or audio signals analysis-synthesis techniques for redundancy reduction, e.g. in vocoders; Coding or decoding of speech or audio signals, using source filter models or psychoacoustic analysis
    • G10L19/04Speech or audio signals analysis-synthesis techniques for redundancy reduction, e.g. in vocoders; Coding or decoding of speech or audio signals, using source filter models or psychoacoustic analysis using predictive techniques
    • G10L19/06Determination or coding of the spectral characteristics, e.g. of the short-term prediction coefficients
    • GPHYSICS
    • G10MUSICAL INSTRUMENTS; ACOUSTICS
    • G10LSPEECH ANALYSIS OR SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING; SPEECH OR AUDIO CODING OR DECODING
    • G10L19/00Speech or audio signals analysis-synthesis techniques for redundancy reduction, e.g. in vocoders; Coding or decoding of speech or audio signals, using source filter models or psychoacoustic analysis
    • G10L19/008Multichannel audio signal coding or decoding using interchannel correlation to reduce redundancy, e.g. joint-stereo, intensity-coding or matrixing
    • GPHYSICS
    • G10MUSICAL INSTRUMENTS; ACOUSTICS
    • G10LSPEECH ANALYSIS OR SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING; SPEECH OR AUDIO CODING OR DECODING
    • G10L19/00Speech or audio signals analysis-synthesis techniques for redundancy reduction, e.g. in vocoders; Coding or decoding of speech or audio signals, using source filter models or psychoacoustic analysis
    • G10L19/005Correction of errors induced by the transmission channel, if related to the coding algorithm
    • GPHYSICS
    • G10MUSICAL INSTRUMENTS; ACOUSTICS
    • G10LSPEECH ANALYSIS OR SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING; SPEECH OR AUDIO CODING OR DECODING
    • G10L19/00Speech or audio signals analysis-synthesis techniques for redundancy reduction, e.g. in vocoders; Coding or decoding of speech or audio signals, using source filter models or psychoacoustic analysis
    • G10L19/018Audio watermarking, i.e. embedding inaudible data in the audio signal
    • GPHYSICS
    • G10MUSICAL INSTRUMENTS; ACOUSTICS
    • G10LSPEECH ANALYSIS OR SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING; SPEECH OR AUDIO CODING OR DECODING
    • G10L19/00Speech or audio signals analysis-synthesis techniques for redundancy reduction, e.g. in vocoders; Coding or decoding of speech or audio signals, using source filter models or psychoacoustic analysis
    • G10L19/02Speech or audio signals analysis-synthesis techniques for redundancy reduction, e.g. in vocoders; Coding or decoding of speech or audio signals, using source filter models or psychoacoustic analysis using spectral analysis, e.g. transform vocoders or subband vocoders
    • GPHYSICS
    • G10MUSICAL INSTRUMENTS; ACOUSTICS
    • G10LSPEECH ANALYSIS OR SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING; SPEECH OR AUDIO CODING OR DECODING
    • G10L19/00Speech or audio signals analysis-synthesis techniques for redundancy reduction, e.g. in vocoders; Coding or decoding of speech or audio signals, using source filter models or psychoacoustic analysis
    • G10L19/02Speech or audio signals analysis-synthesis techniques for redundancy reduction, e.g. in vocoders; Coding or decoding of speech or audio signals, using source filter models or psychoacoustic analysis using spectral analysis, e.g. transform vocoders or subband vocoders
    • G10L19/022Blocking, i.e. grouping of samples in time; Choice of analysis windows; Overlap factoring
    • G10L19/025Detection of transients or attacks for time/frequency resolution switching
    • GPHYSICS
    • G10MUSICAL INSTRUMENTS; ACOUSTICS
    • G10LSPEECH ANALYSIS OR SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING; SPEECH OR AUDIO CODING OR DECODING
    • G10L19/00Speech or audio signals analysis-synthesis techniques for redundancy reduction, e.g. in vocoders; Coding or decoding of speech or audio signals, using source filter models or psychoacoustic analysis
    • G10L19/04Speech or audio signals analysis-synthesis techniques for redundancy reduction, e.g. in vocoders; Coding or decoding of speech or audio signals, using source filter models or psychoacoustic analysis using predictive techniques
    • G10L19/26Pre-filtering or post-filtering
    • GPHYSICS
    • G10MUSICAL INSTRUMENTS; ACOUSTICS
    • G10LSPEECH ANALYSIS OR SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING; SPEECH OR AUDIO CODING OR DECODING
    • G10L19/00Speech or audio signals analysis-synthesis techniques for redundancy reduction, e.g. in vocoders; Coding or decoding of speech or audio signals, using source filter models or psychoacoustic analysis
    • G10L19/02Speech or audio signals analysis-synthesis techniques for redundancy reduction, e.g. in vocoders; Coding or decoding of speech or audio signals, using source filter models or psychoacoustic analysis using spectral analysis, e.g. transform vocoders or subband vocoders
    • G10L19/0204Speech or audio signals analysis-synthesis techniques for redundancy reduction, e.g. in vocoders; Coding or decoding of speech or audio signals, using source filter models or psychoacoustic analysis using spectral analysis, e.g. transform vocoders or subband vocoders using subband decomposition
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04SSTEREOPHONIC SYSTEMS 
    • H04S3/00Systems employing more than two channels, e.g. quadraphonic
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04SSTEREOPHONIC SYSTEMS 
    • H04S3/00Systems employing more than two channels, e.g. quadraphonic
    • H04S3/008Systems employing more than two channels, e.g. quadraphonic in which the audio signals are in digital form, i.e. employing more than two discrete digital channels
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04SSTEREOPHONIC SYSTEMS 
    • H04S3/00Systems employing more than two channels, e.g. quadraphonic
    • H04S3/02Systems employing more than two channels, e.g. quadraphonic of the matrix type, i.e. in which input signals are combined algebraically, e.g. after having been phase shifted with respect to each other
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04SSTEREOPHONIC SYSTEMS 
    • H04S5/00Pseudo-stereo systems, e.g. in which additional channel signals are derived from monophonic signals by means of phase shifting, time delay or reverberation 

Definitions

  • the invention relates generally to audio signal processing.
  • the invention is particularly useful in low bitrate and very low bitrate audio signal processing. More particularly, aspects of the invention relate to an encoder (or encoding process), a decoder (or decoding processes), and to an encode/decode system (or encoding/decoding process) for audio signals in which a plurality of audio channels is represented by a composite monophonic (“mono”) audio channel and auxiliary (“sidechain”) information. Alternatively, the plurality of audio channels is represented by a plurality of audio channels and sidechain information.
  • aspects of the invention also relate to a multichannel to composite monophonic channel downmixers (or downmix process), to a monophonic channel to multichannel upmixer (or upmixer process), and to a monophonic channel to multichannel decorrelator (or decorrelation process).
  • Other aspects of the invention relate to a multichannel-to-multichannel downmixers (or downmix process), to a multichannel-to-multichannel upmixer (or upmix process), and to a decorrelator (or decorrelation process).
  • channels may be selectively combined or “coupled” at high frequencies when the system becomes starved for bits.
  • Details of the AC-3 system are well known in the art—see, for example: ATSC Standard A 52 /A: Digital Audio Compression Standard ( AC -3), Revision A , Advanced Television Systems Committee, 20 Aug. 2001.
  • the A/52A document is available on the World Wide Web at http colon forward-slash forward-slash www dot atsc dot org forward-slash standards dot html.
  • the A/52A document is hereby incorporated by reference in its entirety.
  • the frequency above which the AC-3 system combines channels on demand is referred to as the “coupling” frequency.
  • the coupled channels Above the coupling frequency, the coupled channels are combined into a “coupling” or composite channel.
  • the encoder generates “coupling coordinates” (amplitude scale factors) for each subband above the coupling frequency in each channel.
  • the coupling coordinates indicate the ratio of the original energy of each coupled channel subband to the energy of the corresponding subband in the composite channel.
  • channels are encoded discretely. The phase polarity of a coupled channel's subband may be reversed before the channel is combined with one or more other coupled channels in order to reduce out-of-phase signal component cancellation.
  • the composite channel along with sidechain information that includes, on a per-subband basis, the coupling coordinates and whether the channel's phase is inverted, are sent to the decoder.
  • the coupling frequencies employed in commercial embodiments of the AC-3 system have ranged from about 10 kHz to about 3500 Hz.
  • U.S. Pat. Nos. 5,583,962; 5,633,981, 5,727,119, 5,909,664, and 6,021,386 include teachings that relate to the combining of multiple audio channels into a composite channel and auxiliary or sidechain information and the recovery therefrom of an approximation to the original multiple channels. Each of said patents is hereby incorporated by reference in its entirety.
  • aspects of the present invention may be viewed as improvements upon the “coupling” techniques of the AC-3 encoding and decoding system and also upon other techniques in which multiple channels of audio are combined either to a monophonic composite signal or to multiple channels of audio along with related auxiliary information and from which multiple channels of audio are reconstructed.
  • aspects of the present invention also may be viewed as improvements upon techniques for downmixing multiple audio channels to a monophonic audio signal or to multiple audio channels and for decorrelating multiple audio channels derived from a monophonic audio channel or from multiple audio channels.
  • aspects of the invention may be employed in an N:1:N spatial audio coding technique (where “N” is the number of audio channels) or an M:1:N spatial audio coding technique (where “M” is the number of encoded audio channels and “N” is the number of decoded audio channels) that improve on channel coupling, by providing, among other things, improved phase compensation, decorrelation mechanisms, and signal-dependent variable time-constants.
  • N:1:N spatial audio coding technique where “N” is the number of audio channels
  • M:1:N spatial audio coding technique where “M” is the number of encoded audio channels and “N” is the number of decoded audio channels
  • Goals include the reduction of coupling cancellation artifacts in the encode process by adjusting relative interchannel phase before downmixing, and improving the spatial dimensionality of the reproduced signal by restoring the phase angles and degrees of decorrelation in the decoder.
  • aspects of the invention when embodied in practical embodiments should allow for continuous rather than on-demand channel coupling and lower coupling frequencies than, for example in the AC-3 system, thereby reducing the required data rate.
  • FIG. 1 is an idealized block diagram showing the principal functions or devices of an N:1 encoding arrangement embodying aspects of the present invention.
  • FIG. 2 is an idealized block diagram showing the principal functions or devices of a 1:N decoding arrangement embodying aspects of the present invention.
  • FIG. 3 shows an example of a simplified conceptual organization of bins and subbands along a (vertical) frequency axis and blocks and a frame along a (horizontal) time axis. The figure is not to scale.
  • FIG. 4 is in the nature of a hybrid flowchart and functional block diagram showing encoding steps or devices performing functions of an encoding arrangement embodying aspects of the present invention.
  • FIG. 5 is in the nature of a hybrid flowchart and functional block diagram showing decoding steps or devices performing functions of a decoding arrangement embodying aspects of the present invention.
  • FIG. 6 is an idealized block diagram showing the principal functions or devices of a first N:x encoding arrangement embodying aspects of the present invention.
  • FIG. 7 is an idealized block diagram showing the principal functions or devices of an x:M decoding arrangement embodying aspects of the present invention.
  • FIG. 8 is an idealized block diagram showing the principal functions or devices of a first alternative x:M decoding arrangement embodying aspects of the present invention.
  • FIG. 9 is an idealized block diagram showing the principal functions or devices of a second alternative x:M decoding arrangement embodying aspects of the present invention.
  • FIG. 1 an N:1 encoder function or device embodying aspects of the present invention is shown.
  • the figure is an example of a function or structure that performs as a basic encoder embodying aspects of the invention.
  • Other functional or structural arrangements that practice aspects of the invention may be employed, including alternative and/or equivalent functional or structural arrangements described below.
  • the input signals may be time samples that may have been derived from analog audio signals.
  • the time samples may be encoded as linear pulse-code modulation (PCM) signals.
  • PCM linear pulse-code modulation
  • Each linear PCM audio input channel is processed by a filterbank function or device having both an in-phase and a quadrature output, such as a 512-point windowed forward discrete Fourier transform (DFT) (as implemented by a Fast Fourier Transform (FFT)).
  • DFT forward discrete Fourier transform
  • FFT Fast Fourier Transform
  • FIG. 1 shows a first PCM channel input (channel “1”) applied to a filterbank function or device, “Filterbank” 2 , and a second PCM channel input (channel “n”) applied, respectively, to another filterbank function or device, “Filterbank” 4 .
  • FIG. 1 shows only two input channels, “1” and “n”.
  • a Filterbank When a Filterbank is implemented by an FFT, input time-domain signals are segmented into consecutive blocks and are usually processed in overlapping blocks.
  • the FFT's discrete frequency outputs (transform coefficients) are referred to as bins, each having a complex value with real and imaginary parts corresponding, respectively, to in-phase and quadrature components.
  • Contiguous transform bins may be grouped into subbands approximating critical bandwidths of the human ear, and most sidechain information produced by the encoder, as will be described, may be calculated and transmitted on a per-subband basis in order to minimize processing resources and to reduce the bitrate.
  • Multiple successive time-domain blocks may be grouped into frames, with individual block values averaged or otherwise combined or accumulated across each frame, to minimize the sidechain data rate.
  • each filterbank is implemented by an FFT
  • contiguous transform bins are grouped into subbands
  • blocks are grouped into frames
  • sidechain data is sent on a once per-frame basis.
  • sidechain data may be sent on a more than once per frame basis (e.g., once per block). See, for example, FIG. 3 and its description, hereinafter.
  • a suitable practical implementation of aspects of the present invention may employ fixed length frames of about 32 milliseconds when a 48 kHz sampling rate is employed, each frame having six blocks at intervals of about 5.3 milliseconds each (employing, for example, blocks having a duration of about 10.6 milliseconds with a 50% overlap).
  • frames may be of arbitrary size and their size may vary dynamically. Variable block lengths may be employed as in the AC-3 system cited above. It is with that understanding that reference is made herein to “frames” and “blocks.”
  • the composite mono or multichannel signal(s), or the composite mono or multichannel signal(s) and discrete low-frequency channels are encoded, as for example by a perceptual coder, as described below, it is convenient to employ the same frame and block configuration as employed in the perceptual coder.
  • the coder employs variable block lengths such that there is, from time to time, a switching from one block length to another, it would be desirable if one or more of the sidechain information as described herein is updated when such a block switch occurs. In order to minimize the increase in data overhead upon the updating of sidechain information upon the occurrence of such a switch, the frequency resolution of the updated sidechain information may be reduced.
  • FIG. 3 shows an example of a simplified conceptual organization of bins and subbands along a (vertical) frequency axis and blocks and a frame along a (horizontal) time axis.
  • bins are divided into subbands that approximate critical bands, the lowest frequency subbands have the fewest bins (e.g., one) and the number of bins per subband increase with increasing frequency.
  • a frequency-domain version of each of the n time-domain input channels, produced by the each channel's respective Filterbank (Filterbanks 2 and 4 in this example) are summed together (“downmixed”) to a monophonic (“mono”) composite audio signal by an additive combining function or device “Additive Combiner” 6 .
  • the downmixing may be applied to the entire frequency bandwidth of the input audio signals or, optionally, it may be limited to frequencies above a given “coupling” frequency, inasmuch as artifacts of the downmixing process may become more audible at middle to low frequencies. In such cases, the channels may be conveyed discretely below the coupling frequency.
  • This strategy may be desirable even if processing artifacts are not an issue, in that mid/low frequency subbands constructed by grouping transform bins into critical-band-like subbands (size roughly proportional to frequency) tend to have a small number of transform bins at low frequencies (one bin at very low frequencies) and may be directly coded with as few or fewer bits than is required to send a downmixed mono audio signal with sidechain information.
  • a coupling or transition frequency as low as 4 kHz, 2300 Hz, 1000 Hz, or even the bottom of the frequency band of the audio signals applied to the encoder, may be acceptable for some applications, particularly those in which a very low bitrate is important. Other frequencies may provide a useful balance between bit savings and listener acceptance.
  • the choice of a particular coupling frequency is not critical to the invention.
  • the coupling frequency may be variable and, if variable, it may depend, for example, directly or indirectly on input signal characteristics.
  • This may be accomplished by controllably shifting over time the “absolute angle” of some or all of the transform bins in ones of the channels. For example, all of the transform bins representing audio above a coupling frequency, thus defining a frequency band of interest, may be controllably shifted over time, as necessary, in every channel or, when one channel is used as a reference, in all but the reference channel.
  • the “absolute angle” of a bin may be taken as the angle of the magnitude-and-angle representation of each complex valued transform bin produced by a filterbank.
  • Controllable shifting of the absolute angles of bins in a channel is performed by an angle rotation function or device (“Rotate Angle”).
  • Rotate Angle 8 processes the output of Filterbank 2 prior to its application to the downmix summation provided by Additive Combiner 6
  • Rotate Angle 10 processes the output of Filterbank 4 prior to its application to the Additive Combiner 6 . It will be appreciated that, under some signal conditions, no angle rotation may be required for a particular transform bin over a time period (the time period of a frame, in examples described herein). Below the coupling frequency, the channel information may be encoded discretely (not shown in FIG. 1 ).
  • an improvement in the channels' phase angle alignments with respect to each other may be accomplished by shifting the phase of every transform bin or subband by the negative of its absolute phase angle, in each block throughout the frequency band of interest. Although this substantially avoids cancellation of out-of-phase signal components, it tends to cause artifacts that may be audible, particularly if the resulting mono composite signal is listened to in isolation.
  • Energy normalization may also be performed on a per-bin basis in the encoder to reduce further any remaining out-of-phase cancellation of isolated bins, as described further below. Also as described further below, energy normalization may also be performed on a per-subband basis (in the decoder) to assure that the energy of the mono composite signal equals the sums of the energies of the contributing channels.
  • Each input channel has an audio analyzer function or device (“Audio Analyzer”) associated with it for generating the sidechain information for that channel and for controlling the amount or degree of angle rotation applied to the channel before it is applied to the downmix summation 6 .
  • the Filterbank outputs of channels 1 and n are applied to Audio Analyzer 12 and to Audio Analyzer 14 , respectively.
  • Audio Analyzer 12 generates the sidechain information for channel 1 and the amount of phase angle rotation for channel 1 .
  • Audio Analyzer 14 generates the sidechain information for channel n and the amount of angle rotation for channel n. It will be understood that such references herein to “angle” refer to phase angle.
  • the sidechain information for each channel generated by an audio analyzer for each channel may include:
  • a reference channel may not require an Audio Analyzer or, alternatively, may require an Audio Analyzer that generates only Amplitude Scale Factor sidechain information. It is not necessary to send an Amplitude Scale Factor if that scale factor can be deduced with sufficient accuracy by a decoder from the Amplitude Scale Factors of the other, non-reference, channels. It is possible to deduce in the decoder the approximate value of the reference channel's Amplitude Scale Factor if the energy normalization in the encoder assures that the scale factors across channels within any subband substantially sum square to 1, as described below.
  • the deduced approximate reference channel Amplitude Scale Factor value may have errors as a result of the relatively coarse quantization of amplitude scale factors resulting in image shifts in the reproduced multi-channel audio.
  • such artifacts may be more acceptable than using the bits to send the reference channel's Amplitude Scale Factor.
  • FIG. 1 shows in a dashed line an optional input to each audio analyzer from the PCM time domain input to the audio analyzer in the channel.
  • This input may be used by the Audio Analyzer to detect a transient over a time period (the period of a block or frame, in the examples described herein) and to generate a transient indicator (e.g., a one-bit “Transient Flag”) in response to a transient.
  • a transient may be detected in the frequency domain, in which case the Audio Analyzer need not receive a time-domain input.
  • the mono composite audio signal and the sidechain information for all the channels may be stored, transmitted, or stored and transmitted to a decoding process or device (“Decoder”).
  • Decoder a decoding process or device
  • the various audio signals and various sidechain information may be multiplexed and packed into one or more bitstreams suitable for the storage, transmission or storage and transmission medium or media.
  • the mono composite audio may be applied to a data-rate reducing encoding process or device such as, for example, a perceptual encoder or to a perceptual encoder and an entropy coder (e.g., arithmetic or Huffman coder) (sometimes referred to as a “lossless” coder) prior to storage, transmission, or storage and transmission.
  • a data-rate reducing encoding process or device such as, for example, a perceptual encoder or to a perceptual encoder and an entropy coder (e.g., arithmetic or Huffman coder) (sometimes referred to as a “lossless” coder) prior to storage, transmission, or storage and transmission.
  • the mono composite audio and related sidechain information may be derived from multiple input channels only for audio frequencies above a certain frequency (a “coupling” frequency). In that case, the audio frequencies below the coupling frequency in each of the multiple input channels may be stored, transmitted or stored and transmitted as discrete channels
  • Such discrete or otherwise-combined channels may also be applied to a data reducing encoding process or device such as, for example, a perceptual encoder or a perceptual encoder and an entropy encoder.
  • a data reducing encoding process or device such as, for example, a perceptual encoder or a perceptual encoder and an entropy encoder.
  • the mono composite audio and the discrete multichannel audio may all be applied to an integrated perceptual encoding or perceptual and entropy encoding process or device.
  • sidechain information is carried in the encoder bitstream.
  • the sidechain information may be carried in such as way that the bitstream is compatible with legacy decoders (i.e., the bitstream is backwards-compatible).
  • legacy decoders i.e., the bitstream is backwards-compatible.
  • Many suitable techniques for doing so are known.
  • many encoders generate a bitstream having unused or null bits that are ignored by the decoder.
  • An example of such an arrangement is set forth in U.S. Pat. No. 6,807,528 B1 of Truman et al, entitled “Adding Data to a Compressed Data Frame,” Oct. 19, 2004, which patent is hereby incorporated by reference in its entirety. Such bits may be replaced with the sidechain information.
  • the sidechain information may be steganographically encoded in the encoder's bitstream.
  • the sidechain information may be stored or transmitted separately from the backwards-compatible bitstream by any technique that permits the transmission or storage of such information along with a mono/stereo bitstream compatible with legacy decoders.
  • Decoder a decoder function or device (“Decoder”) embodying aspects of the present invention is shown.
  • the figure is an example of a function or structure that performs as a basic decoder embodying aspects of the invention.
  • Other functional or structural arrangements that practice aspects of the invention may be employed, including alternative and/or equivalent functional or structural arrangements described below.
  • the Decoder receives the mono composite audio signal and the sidechain information for all the channels or all the channels except the reference channel. If necessary, the composite audio signal and related sidechain information is demultiplexed, unpacked and/or decoded. Decoding may employ a table lookup. The goal is to derive from the mono composite audio channels a plurality of individual audio channels approximating respective ones of the audio channels applied to the Encoder of FIG. 1 , subject to bitrate-reducing techniques of the present invention that are described herein.
  • channels in addition to the ones applied to the Encoder may be derived from the output of a Decoder according to aspects of the present invention by employing aspects of the inventions described in International Application PCT/US 02/03619, filed Feb. 7, 2002, published Aug. 15, 2002, designating the United States, and its resulting U.S. national application Ser. No. 10/467,213, filed Aug. 5, 2003, and in International Application PCT/US03/24570, filed Aug. 6, 2003, published Mar. 4, 2001 as WO 2004/019656, designating the United States, and its resulting U.S. national application Ser. No. 10/522,515, filed Jan.
  • Channels recovered by a Decoder practicing aspects of the present invention are particularly useful in connection with the channel multiplication techniques of the cited and incorporated applications in that the recovered channels not only have useful interchannel amplitude relationships but also have useful interchannel phase relationships.
  • Another alternative for channel multiplication is to employ a matrix decoder to derive additional channels.
  • the interchannel amplitude- and phase-preservation aspects of the present invention make the output channels of a decoder embodying aspects of the present invention particularly suitable for application to an amplitude- and phase-sensitive matrix decoder.
  • Many such matrix decoders employ wideband control circuits that operate properly only when the signals applied to them are stereo throughout the signals' bandwidth.
  • the two channels recovered by the decoder may be applied to a 2:M active matrix decoder.
  • Such channels may have been discrete channels below a coupling frequency, as mentioned above.
  • active matrix decoders are well known in the art, including, for example, matrix decoders known as “Pro Logic” and “Pro Logic II” decoders (“Pro Logic” is a trademark of Dolby Laboratories Licensing Corporation). Aspects of Pro Logic decoders are disclosed in U.S. Pat. Nos. 4,799,260 and 4,941,177, each of which is incorporated by reference herein in its entirety.
  • Dolby Pro Logic and Pro Logic II decoders are explained, for example, in papers available on the Dolby Laboratories' website (www.dolby.com): “Dolby Surround Pro Logic Decoder Principles of Operation,” by Roger Dressler, and “Mixing with Dolby Pro Logic II Technology, by Jim Hilson.
  • Other suitable active matrix decoders may include those described in one or more of the following U.S. Patents and published International Applications (each designating the United States), each of which is hereby incorporated by reference in its entirety: U.S. Pat. Nos. 5,046,098; 5,274,740; 5,400,433; 5,625,696; 5,644,640; 5,504,819; 5,428,687; 5,172,415; and WO 02/19768.
  • each channel-deriving path includes, in either order, an amplitude adjusting function or device (“Adjust Amplitude”) and an angle rotation function or device (“Rotate Angle”).
  • the Adjust Amplitudes apply gains or losses to the mono composite signal so that, under certain signal conditions, the relative output magnitudes (or energies) of the output channels derived from it are similar to those of the channels at the input of the encoder.
  • a controllable amount of “randomized” amplitude variations may also be imposed on the amplitude of a recovered channel in order to improve its decorrelation with respect to other ones of the recovered channels.
  • the Rotate Angles apply phase rotations so that, under certain signal conditions, the relative phase angles of the output channels derived from the mono composite signal are similar to those of the channels at the input of the encoder.
  • a controllable amount of “randomized” angle variations is also imposed on the angle of a recovered channel in order to improve its decorrelation with respect to other ones of the recovered channels.
  • randomized angle amplitude variations may include not only pseudo-random and truly random variations, but also deterministically-generated variations that have the effect of reducing cross-correlation between channels. This is discussed further below in the Comments to Step 505 of FIG. 5A .
  • the Adjust Amplitude and Rotate Angle for a particular channel scale the mono composite audio DFT coefficients to yield reconstructed transform bin values for the channel.
  • the Adjust Amplitude for each channel may be controlled at least by the recovered sidechain Amplitude Scale Factor for the particular channel or, in the case of the reference channel, either from the recovered sidechain Amplitude Scale Factor for the reference channel or from an Amplitude Scale Factor deduced from the recovered sidechain Amplitude Scale Factors of the other, non-reference, channels.
  • the Adjust Amplitude may also be controlled by a Randomized Amplitude Scale Factor Parameter derived from the recovered sidechain Decorrelation Scale Factor for a particular channel and the recovered sidechain Transient Flag for the particular channel.
  • the Rotate Angle for each channel may be controlled at least by the recovered sidechain Angle Control Parameter (in which case, the Rotate Angle in the decoder may substantially undo the angle rotation provided by the Rotate Angle in the encoder).
  • a Rotate Angle may also be controlled by a Randomized Angle Control Parameter derived from the recovered sidechain Decorrelation Scale Factor for a particular channel and the recovered sidechain Transient Flag for the particular channel.
  • the Randomized Angle Control Parameter for a channel may be derived from the recovered Decorrelation Scale Factor for the channel and the recovered Transient Flag for the channel by a controllable decorrelator function or device (“Controllable Decorrelator”).
  • the recovered mono composite audio is applied to a first channel audio recovery path 22 , which derives the channel 1 audio, and to a second channel audio recovery path 24 , which derives the channel n audio.
  • Audio path 22 includes an Adjust Amplitude 26 , a Rotate Angle 28 , and, if a PCM output is desired, an inverse filterbank function or device (“Inverse Filterbank”) 30 .
  • Audio path 24 includes an Adjust Amplitude 32 , a Rotate Angle 34 , and, if a PCM output is desired, an inverse filterbank function or device (“Inverse Filterbank”) 36 .
  • Inverse Filterbank inverse filterbank function or device
  • the recovered sidechain information for the first channel, channel 1 may include an Amplitude Scale Factor, an Angle Control Parameter, a Decorrelation Scale Factor, a Transient Flag, and, optionally, an Interpolation Flag, as stated above in connection with the description of a basic Encoder.
  • the Amplitude Scale Factor is applied to Adjust Amplitude 26 .
  • an optional frequency interpolator or interpolator function (“Interpolator”) 27 may be employed in order to interpolate the Angle Control Parameter across frequency (e.g., across the bins in each subband of a channel). Such interpolation may be, for example, a linear interpolation of the bin angles between the centers of each subband.
  • the state of the one-bit Interpolation Flag selects whether or not interpolation across frequency is employed, as is explained further below.
  • the Transient Flag and Decorrelation Scale Factor are applied to a Controllable Decorrelator 38 that generates a Randomized Angle Control Parameter in response thereto.
  • the state of the one-bit Transient Flag selects one of two multiple modes of randomized angle decorrelation, as is explained further below.
  • the Angle Control Parameter which may be interpolated across frequency if the Interpolation Flag and the Interpolator are employed, and the Randomized Angle Control Parameter are summed together by an additive combiner or combining function 40 in order to provide a control signal for Rotate Angle 28 .
  • Controllable Decorrelator 38 may also generate a Randomized Amplitude Scale Factor in response to the Transient Flag and Decorrelation Scale Factor, in addition to generating a Randomized Angle Control Parameter.
  • the Amplitude Scale Factor may be summed together with such a Randomized Amplitude Scale Factor by an additive combiner or combining function (not shown) in order to provide the control signal for the Adjust Amplitude 26 .
  • recovered sidechain information for the second channel, channel n may also include an Amplitude Scale Factor, an Angle Control Parameter, a Decorrelation Scale Factor, a Transient Flag, and, optionally, an Interpolate Flag, as described above in connection with the description of a basic encoder.
  • the Amplitude Scale Factor is applied to Adjust Amplitude 32 .
  • a frequency interpolator or interpolator function (“Interpolator”) 33 may be employed in order to interpolate the Angle Control Parameter across frequency. As with channel 1 , the state of the one-bit Interpolation Flag selects whether or not interpolation across frequency is employed.
  • the Transient Flag and Decorrelation Scale Factor are applied to a Controllable Decorrelator 42 that generates a Randomized Angle Control Parameter in response thereto.
  • the state of the one-bit Transient Flag selects one of two multiple modes of randomized angle decorrelation, as is explained further below.
  • the Angle Control Parameter and the Randomized Angle Control Parameter are summed together by an additive combiner or combining function 44 in order to provide a control signal for Rotate Angle 34 .
  • the Controllable Decorrelator 42 may also generate a Randomized Amplitude Scale Factor in response to the Transient Flag and Decorrelation Scale Factor, in addition to generating a Randomized Angle Control Parameter.
  • the Amplitude Scale Factor and Randomized Amplitude Scale Factor may be summed together by an additive combiner or combining function (not shown) in order to provide the control signal for the Adjust Amplitude 32 .
  • Adjust Amplitude 26 ( 32 ) and Rotate Angle 28 ( 34 ) may be reversed and/or there may be more than one Rotate Angle—one that responds to the Angle Control Parameter and another that responds to the Randomized Angle Control Parameter.
  • the Rotate Angle may also be considered to be three rather than one or two functions or devices, as in the example of FIG. 5 described below. If a Randomized Amplitude Scale Factor is employed, there may be more than one Adjust Amplitude—one that responds to the Amplitude Scale Factor and one that responds to the Randomized Amplitude Scale Factor.
  • Randomized Amplitude Scale Factor Because of the human ear's greater sensitivity to amplitude relative to phase, if a Randomized Amplitude Scale Factor is employed, it may be desirable to scale its effect relative to the effect of the Randomized Angle Control Parameter so that its effect on amplitude is less than the effect that the Randomized Angle Control Parameter has on phase angle.
  • the Decorrelation Scale Factor may be used to control the ratio of randomized phase angle versus basic phase angle (rather than adding a parameter representing a randomized phase angle to a parameter representing the basic phase angle), and if also employed, the ratio of randomized amplitude shift versus basic amplitude shift (rather than adding a scale factor representing a randomized amplitude to a scale factor representing the basic amplitude) (i.e., a variable crossfade in each case).
  • the Rotate Angle, Controllable Decorrelator and Additive Combiner for that channel may be omitted inasmuch as the sidechain information for the reference channel may include only the Amplitude Scale Factor (or, alternatively, if the sidechain information does not contain an Amplitude Scale Factor for the reference channel, it may be deduced from Amplitude Scale Factors of the other channels when the energy normalization in the encoder assures that the scale factors across channels within a subband sum square to 1).
  • An Amplitude Adjust is provided for the reference channel and it is controlled by a received or derived Amplitude Scale Factor for the reference channel.
  • the recovered reference channel is an amplitude-scaled version of the mono composite channel. It does not require angle rotation because it is the reference for the other channels' rotations.
  • adjusting the relative amplitude of recovered channels may provide a modest degree of decorrelation, if used alone amplitude adjustment is likely to result in a reproduced soundfield substantially lacking in spatialization or imaging for many signal conditions (e.g., a “collapsed” soundfield).
  • Amplitude adjustment may affect interaural level differences at the ear, which is only one of the psychoacoustic directional cues employed by the ear.
  • certain angle-adjusting techniques may be employed, depending on signal conditions, to provide additional decorrelation.
  • Table 1 provides abbreviated comments useful in understanding the multiple angle-adjusting decorrelation techniques or modes of operation that may be employed in accordance with aspects of the invention.
  • Other decorrelation techniques as described below in connection with the examples of FIGS. 8 and 9 may be employed instead of or in addition to the techniques of Table 1.
  • circular convolution also known as cyclic or periodic convolution
  • circular convolution may be avoided or minimized by any suitable technique, including, for example, an appropriate use of zero padding.
  • One way to use zero padding is to transform the proposed frequency domain variation (representing angle rotations and amplitude scaling) to the time domain, window it (with an arbitrary window), pad it with zeros, then transform back to the frequency domain and multiply by the frequency domain version of the audio to be processed (the audio need not be windowed).
  • a first technique restores the angle of the received mono composite signal relative to the angle of each of the other recovered channels to an angle similar (subject to frequency and time granularity and to quantization) to the original angle of the channel relative to the other channels at the input of the encoder.
  • Phase angle differences are useful, particularly, for providing decorrelation of low-frequency signal components below about 1500 Hz where the ear follows individual cycles of the audio signal.
  • Technique 1 operates under all signal conditions to provide a basic angle shift.
  • Randomized changes in phase angle are a desirable way to cause randomized changes in the envelopes of signals.
  • a particular envelope results from the interaction of a particular combination of amplitudes and phases of spectral components within a subband.
  • changing the amplitudes of spectral components within a subband changes the envelope, large amplitude changes are required to obtain a significant change in the envelope, which is undesirable because the human ear is sensitive to variations in spectral amplitude.
  • changing the spectral component's phase angles has a greater effect on the envelope than changing the spectral component's amplitudes—spectral components no longer line up the same way, so the reinforcements and subtractions that define the envelope occur at different times, thereby changing the envelope.
  • the human ear has some envelope sensitivity, the ear is relatively phase deaf, so the overall sound quality remains substantially similar. Nevertheless, for some signal conditions, some randomization of the amplitudes of spectral components along with randomization of the phases of spectral components may provide an enhanced randomization of signal envelopes provided that such amplitude randomization does not cause undesirable audible artifacts.
  • a controllable amount or degree of Technique 2 or Technique 3 operates along with Technique 1 under certain signal conditions.
  • the Transient Flag selects Technique 2 (no transient present in the frame or block, depending on whether the Transient Flag is sent at the frame or block rate) or Technique 3 (transient present in the frame or block).
  • Technique 2 no transient present in the frame or block, depending on whether the Transient Flag is sent at the frame or block rate
  • Technique 3 transient present in the frame or block.
  • a controllable amount or degree of amplitude randomization also operates along with the amplitude scaling that seeks to restore the original channel amplitude.
  • Technique 2 is suitable for complex continuous signals that are rich in harmonics, such as massed orchestral violins.
  • Technique 3 is suitable for complex impulsive or transient signals, such as applause, castanets, etc. (Technique 2 time smears claps in applause, making it unsuitable for such signals).
  • Technique 2 and Technique 3 have different time and frequency resolutions for applying randomized angle variations—Technique 2 is selected when a transient is not present, whereas Technique 3 is selected when a transient is present.
  • Technique 1 slowly shifts (frame by frame) the bin angle in a channel.
  • the amount or degree of this basic shift is controlled by the Angle Control Parameter (no shift if the parameter is zero).
  • either the same or an interpolated parameter is applied to all bins in each subband and the parameter is updated every frame. Consequently, each subband of each channel may have a phase shift with respect to other channels, providing a degree of decorrelation at low frequencies (below about 1500 Hz).
  • Technique 1, by itself is unsuitable for a transient signal such as applause. For such signal conditions, the reproduced channels may exhibit an annoying unstable comb-filter effect. In the case of applause, essentially no decorrelation is provided by adjusting only the relative amplitude of recovered channels because all channels tend to have the same amplitude over the period of a frame.
  • Technique 2 operates when a transient is not present.
  • Technique 2 adds to the angle shift of Technique 1 a randomized angle shift that does not change with time, on a bin-by-bin basis (each bin has a different randomized shift) in a channel, causing the envelopes of the channels to be different from one another, thus providing decorrelation of complex signals among the channels. Maintaining the randomized phase angle values constant over time avoids block or frame artifacts that may result from block-to-block or frame-to-frame alteration of bin phase angles.
  • Technique 3 operates in the presence of a transient in the frame or block, depending on the rate at which the Transient Flag is sent. It shifts all the bins in each subband in a channel from block to block with a unique randomized angle value, common to all bins in the subband, causing not only the envelopes, but also the amplitudes and phases, of the signals in a channel to change with respect to other channels from block to block. These changes in time and frequency resolution of the angle randomizing reduce steady-state signal similarities among the channels and provide decorrelation of the channels substantially without causing “pre-noise” artifacts.
  • Technique 3 adds to the phase shift of Technique 1 a rapidly changing (block-by-block) randomized angle shift on a subband-by-subband basis in a channel.
  • the amount or degree of additional shift is scaled indirectly, as described below, by the Decorrelation Scale Factor (there is no additional shift if the scale factor is zero).
  • the same scaling is applied across a subband and the scaling is updated every frame.
  • angle-adjusting techniques have been characterized as three techniques, this is a matter of semantics and they may also be characterized as two techniques: (1) a combination of Technique 1 and a variable degree of Technique 2, which may be zero, and (2) a combination of Technique 1 and a variable degree Technique 3, which may be zero.
  • the techniques are treated as being three techniques.
  • aspects of the multiple mode decorrelation techniques and modifications of them may be employed in providing decorrelation of audio signals derived, as by upmixing, from one or more audio channels even when such audio channels are not derived from an encoder according to aspects of the present invention.
  • Such arrangements when applied to a mono audio channel, are sometimes referred to as “pseudo-stereo” devices and functions.
  • Any suitable device or function (an “upmixer”) may be employed to derive multiple signals from a mono audio channel or from multiple audio channels. Once such multiple audio channels are derived by an upmixer, one or more of them may be decorrelated with respect to one or more of the other derived audio signals by applying the multiple mode decorrelation techniques described herein.
  • each derived audio channel to which the decorrelation techniques are applied may be switched from one mode of operation to another by detecting transients in the derived audio channel itself.
  • the operation of the transient-present technique (Technique 3) may be simplified to provide no shifting of the phase angles of spectral components when a transient is present.
  • the sidechain information may include: an Amplitude Scale Factor, an Angle Control Parameter, a Decorrelation Scale Factor, a Transient Flag, and, optionally, an Interpolation Flag.
  • an Amplitude Scale Factor for a practical embodiment of aspects of the present invention may be summarized in the following Table 2.
  • the sidechain information may be updated once per frame.
  • Sidechain Information Characteristics for a Channel Represents Sidechain (is “a measure Quantization Primary Information Value Range of”) Levels Purpose Subband Angle 0 ⁇ +2 ⁇ Smoothed time 6 bit (64 levels) Provides Control average in each basic angle Parameter subband of rotation for difference each bin in between angle of channel each bin in subband for a channel and that of the corresponding bin in subband of a reference channel Subband 0 ⁇ 1 Spectral- 3 bit (8 levels) Scales Decorrelation The Subband steadiness of randomized Scale Factor Decorrelation signal angle shifts Scale Factor is characteristics added to high only if over time in a basic angle both the subband of a rotation, and, Spectral- channel (the if employed, Steadiness Spectral- also scales Factor and the Steadiness randomized Interchannel Factor) and the Amplitude Angle consistency in the Scale Factor Consistency same subband of added to Factor are low.
  • Subband 0 to 31 whole Energy or 5 bit (32 levels) Scales
  • Transient Flag 1 0 Presence of a 1 bit (2 levels) Determines (True/False) transient in the which (polarity is frame or in the technique for arbitrary) block adding randomized angle shifts, or both angle shifts and amplitude shifts, is employed Interpolation 1, 0 A spectral peak 1 bit (2 levels) Determines Flag (True/False) near a subband if the basic (polarity is boundary or angle arbitrary) phase angles rotation is within a channel interpolated have a linear across progression frequency
  • the sidechain information of a channel applies to a single subband (except for the Transient Flag and the Interpolation Flag, each of which apply to all subbands in a channel) and may be updated once per frame.
  • time resolution once per frame
  • frequency resolution subband
  • value ranges and quantization levels indicated have been found to provide useful performance and a useful compromise between a low bitrate and performance
  • these time and frequency resolutions, value ranges and quantization levels are not critical and that other resolutions, ranges and levels may employed in practicing aspects of the invention.
  • the Transient Flag and/or the Interpolation Flag if employed, may be updated once per block with only a minimal increase in sidechain data overhead. In the case of the Transient Flag, doing so has the advantage that the switching from Technique 2 to Technique 3 and vice-versa is more accurate.
  • sidechain information may be updated upon the occurrence of a block switch of a related coder.
  • Technique 2 described above (see also Table 1), provides a bin frequency resolution rather than a subband frequency resolution (i.e., a different pseudo random phase angle shift is applied to each bin rather than to each subband) even though the same Subband Decorrelation Scale Factor applies to all bins in a subband.
  • Technique 3, described above provides a block frequency resolution (i.e., a different randomized phase angle shift is applied to each block rather than to each frame) even though the same Subband Decorrelation Scale Factor applies to all bins in a subband.
  • Such resolutions greater than the resolution of the sidechain information, are possible because the randomized phase angle shifts may be generated in a decoder and need not be known in the encoder (this is the case even if the encoder also applies a randomized phase angle shift to the encoded mono composite signal, an alternative that is described below). In other words, it is not necessary to send sidechain information having bin or block granularity even though the decorrelation techniques employ such granularity.
  • the decoder may employ, for example, one or more lookup tables of randomized bin phase angles. The obtaining of time and/or frequency resolutions for decorrelation greater than the sidechain information rates is among the aspects of the present invention.
  • decorrelation by way of randomized phases is performed either with a fine frequency resolution (bin-by-bin) that does not change with time (Technique 2), or with a coarse frequency resolution (band-by-band) ((or a fine frequency resolution (bin-by-bin) when frequency interpolation is employed, as described further below)) and a fine time resolution (block rate) (Technique 3).
  • the absolute phase angle of the recovered channel differs more and more from the original absolute phase angle of that channel.
  • An aspect of the present invention is the appreciation that the resulting absolute phase angle of the recovered channel need not match that of the original channel when signal conditions are such that the randomized phase shifts are added in accordance with aspects of the present invention.
  • the phase shift caused by Technique 2 or Technique 3 overwhelms the basic phase shift caused by Technique 1. Nevertheless, this is of no concern in that a randomized phase shift is audibly the same as the different random phases in the original signal that give rise to a Decorrelation Scale Factor that causes the addition of some degree of randomized phase shifts.
  • randomized amplitude shifts may by employed in addition to randomized phase shifts.
  • the Adjust Amplitude may also be controlled by a Randomized Amplitude Scale Factor Parameter derived from the recovered sidechain Decorrelation Scale Factor for a particular channel and the recovered sidechain Transient Flag for the particular channel.
  • Such randomized amplitude shifts may operate in two modes in a manner analogous to the application of randomized phase shifts.
  • a randomized amplitude shift that does not change with time may be added on a bin-by-bin basis (different from bin to bin), and, in the presence of a transient (in the frame or block), a randomized amplitude shift that changes on a block-by-block basis (different from block to block) and changes from subband to subband (the same shift for all bins in a subband; different from subband to subband).
  • a particular scale factor value should cause less amplitude shift than the corresponding randomized phase shift resulting from the same scale factor value in order to avoid audible artifacts.
  • the time resolution with which the Transient Flag selects Technique 2 or Technique 3 may be enhanced by providing a supplemental transient detector in the decoder in order to provide a temporal resolution finer than the frame rate or even the block rate.
  • a supplemental transient detector may detect the occurrence of a transient in the mono or multichannel composite audio signal received by the decoder and such detection information is then sent to each Controllable Decorrelator (as 38 , 42 of FIG. 2 ). Then, upon the receipt of a Transient Flag for its channel, the Controllable Decorrelator switches from Technique 2 to Technique 3 upon receipt of the decoder's local transient detection indication.
  • sidechain information may be updated every block, at least for highly dynamic signals.
  • updating the Transient Flag and/or the Interpolation Flag every block results in only a small increase in sidechain data overhead.
  • a block-floating-point differential coding arrangement may be used. For example, consecutive transform blocks may be collected in groups of six over a frame. The full sidechain information may be sent for each subband-channel in the first block. In the five subsequent blocks, only differential values may be sent, each the difference between the current-block amplitude and angle, and the equivalent values from the previous-block.
  • One suitable implementation of aspects of the present invention employs processing steps or devices that implement the respective processing steps and are functionally related as next set forth.
  • the encoding and decoding steps listed below may each be carried out by computer software instruction sequences operating in the order of the below listed steps, it will be understood that equivalent or similar results may be obtained by steps ordered in other ways, taking into account that certain quantities are derived from earlier ones.
  • multi-threaded computer software instruction sequences may be employed so that certain sequences of steps are carried out in parallel.
  • the described steps may be implemented as devices that perform the described functions, the various devices having functions and functional interrelationships as described hereinafter.
  • the encoder or encoding function may collect a frame's worth of data before it derives sidechain information and downmixes the frame's audio channels to a single monophonic (mono) audio channel (in the manner of the example of FIG. 1 , described above), or to multiple audio channels (in the manner of the example of FIG. 6 , described below).
  • sidechain information may be sent first to a decoder, allowing the decoder to begin decoding immediately upon receipt of the mono or multiple channel audio information.
  • Steps of an encoding process (“encoding steps”) may be described as follows. With respect to encoding steps, reference is made to FIG. 4 , which is in the nature of a hybrid flowchart and functional block diagram. Through Step 419 , FIG. 4 shows encoding steps for one channel. Steps 420 and 421 apply to all of the multiple channels that are combined to provide a composite mono signal output or are matrixed together to provide multiple channels, as described below in connection with the example of FIG. 6 .
  • Step 401 Detect Transients
  • Step 401
  • the Transient Flag forms a portion of the sidechain information and is also used in Step 411 , as described below. Transient resolution finer than block rate in the decoder may improve decoder performance. Although, as discussed above, a block-rate rather than a frame-rate Transient Flag may form a portion of the sidechain information with a modest increase in bitrate, a similar result, albeit with decreased spatial accuracy, may be accomplished without increasing the sidechain bitrate by detecting the occurrence of transients in the mono composite signal received in the decoder.
  • transient flag there is one transient flag per channel per frame, which, because it is derived in the time domain, necessarily applies to all subbands within that channel.
  • the transient detection may be performed in the manner similar to that employed in an AC-3 encoder for controlling the decision of when to switch between long and short length audio blocks, but with a higher sensitivity and with the Transient Flag True for any frame in which the Transient Flag for a block is True (an AC-3 encoder detects transients on a block basis).
  • the sensitivity of the transient detection described in Section 8.2.2 may be increased by adding a sensitivity factor F to an equation set forth therein.
  • Section 8.2.2 of the A/52A document is set forth below, with the sensitivity factor added (Section 8.2.2 as reproduced below is corrected to indicate that the low pass filter is a cascaded biquad direct form II IIR filter rather than “form I” as in the published A/52A document; Section 8.2.2 was correct in the earlier A/52 document).
  • a sensitivity factor of 0.2 has been found to be a suitable value in a practical embodiment of aspects of the present invention.
  • transients may be detected in the frequency domain rather than in the time domain (see the Comments to Step 408 ).
  • Step 401 may be omitted and an alternative step employed in the frequency domain as described below.
  • Step 402 Window and DFT.
  • Step 403 Convert Complex Values to Magnitude and Angle.
  • Step 404 Calculate Subband Energy.
  • the coupling frequency of the encoder is below about 1000 Hz, apply the subband frame-averaged or frame-accumulated energy to a time smoother that operates on all subbands below that frequency and above the coupling frequency.
  • Step 404 c
  • Time smoothing to provide inter-frame smoothing in low frequency subbands may be useful.
  • a suitable time constant for the lowest frequency range subband (where the subband is a single bin if subbands are critical bands) may be in the range of 50 to 100 milliseconds, for example.
  • Progressively-decreasing time smoothing may continue up through a subband encompassing about 1000 Hz where the time constant may be about 10 milliseconds, for example.
  • the smoother may be a two-stage smoother that has a variable time constant that shortens its attack and decay time in response to a transient (such a two-stage smoother may be a digital equivalent of the analog two-stage smoothers described in U.S. Pat. Nos. 3,846,719 and 4,922,535, each of which is hereby incorporated by reference in its entirety).
  • the steady-state time constant may be scaled according to frequency and may also be variable in response to transients.
  • smoothing may be applied in Step 412 .
  • Step 405 Calculate Sum of Bin Magnitudes.
  • Step 403 Calculate the sum per block of the bin magnitudes (Step 403 ) of each subband (a summation across frequency).
  • Step 410 Calculate the sum per frame of the bin magnitudes of each subband by averaging or accumulating the magnitudes of Step 405 a across the blocks in a frame (an averaging/accumulation across time). These sums are used to calculate an Interchannel Angle Consistency Factor in Step 410 below.
  • the coupling frequency of the encoder is below about 1000 Hz, apply the subband frame-averaged or frame-accumulated magnitudes to a time smoother that operates on all subbands below that frequency and above the coupling frequency.
  • Step 405 c See comments regarding step 404 c except that in the case of Step 405 c , the time smoothing may alternatively be performed as part of Step 410 .
  • Step 406 Calculate Relative Interchannel Bin Phase Angle.
  • Step 407 Calculate Interchannel Subband Phase Angle.
  • Step 408 Calculate Bin Spectral-Steadiness Factor
  • Bin Spectral-Steadiness Factor in the range of 0 to 1 as follows:
  • Spectral steadiness is a measure of the extent to which spectral components (e.g., spectral coefficients or bin values) change over time.
  • a Bin Spectral-Steadiness Factor of 1 indicates no change over a given time period.
  • Spectral Steadiness may also be taken as an indicator of whether a transient is present.
  • a transient may cause a sudden rise and fall in spectral (bin) amplitude over a time period of one or more blocks, depending on its position with regard to blocks and their boundaries. Consequently, a change in the Bin Spectral-Steadiness Factor from a high value to a low value over a small number of blocks may be taken as an indication of the presence of a transient in the block or blocks having the lower value.
  • a further confirmation of the presence of a transient, or an alternative to employing the Bin Spectral-Steadiness factor is to observe the phase angles of bins within the block (for example, at the phase angle output of Step 403 ).
  • a transient is likely to occupy a single temporal position within a block and have the dominant energy in the block
  • the existence and position of a transient may be indicated by a substantially uniform delay in phase from bin to bin in the block—namely, a substantially linear ramp of phase angles as a function of frequency.
  • a further confirmation or alternative is to observe the bin amplitudes over a small number of blocks (for example, at the magnitude output of Step 403 ), namely by looking directly for a sudden rise and fall of spectral level.
  • Step 408 may look at three consecutive blocks instead of one block. If the coupling frequency of the encoder is below about 1000 Hz, Step 408 may look at more than three consecutive blocks. The number of consecutive blocks may taken into consideration vary with frequency such that the number gradually increases as the subband frequency range decreases. If the Bin Spectral-Steadiness Factor is obtained from more than one block, the detection of a transient, as just described, may be determined by separate steps that respond only to the number of blocks useful for detecting transients.
  • bin energies may be used instead of bin magnitudes.
  • Step 408 may employ an “event decision” detecting technique as described below in the comments following Step 409 .
  • Step 409 Compute Subband Spectral-Steadiness Factor.
  • Steps 408 and 409 The goal of Steps 408 and 409 is to measure spectral steadiness changes in spectral composition over time in a subband of a channel.
  • aspects of an “event decision” sensing such as described in International Publication Number WO 02/097792 A1 (designating the United States) may be employed to measure spectral steadiness instead of the approach just described in connection with Steps 408 and 409 .
  • U.S. patent application Ser. No. 10/478,538, filed Nov. 20, 2003 is the United States national application of the published PCT Application WO 02/097792 A1. Both the published PCT application and the U.S. application are hereby incorporated by reference in their entirety.
  • the magnitudes of the complex FFT coefficient of each bin are calculated and normalized (largest magnitude is set to a value of one, for example). Then the magnitudes of corresponding bins (in dB) in consecutive blocks are subtracted (ignoring signs), the differences between bins are summed, and, if the sum exceeds a threshold, the block boundary is considered to be an auditory event boundary. Alternatively, changes in amplitude from block to block may also be considered along with spectral magnitude changes (by looking at the amount of normalization required).
  • Step 408 the decibel differences in spectral magnitude between corresponding bins in each subband may be summed in accordance with the teachings of said applications. Then, each of those sums, representing the degree of spectral change from block to block may be scaled so that the result is a spectral steadiness factor having a range from 0 to 1, wherein a value of 1 indicates the highest steadiness, a change of 0 dB from block to block for a given bin.
  • a value of 0, indicating the lowest steadiness, may be assigned to decibel changes equal to or greater than a suitable amount, such as 12 dB, for example.
  • a Bin Spectral-Steadiness Factor may be used by Step 409 in the same manner that Step 409 uses the results of Step 408 as described above.
  • Step 409 receives a Bin Spectral-Steadiness Factor obtained by employing the just-described alternative event decision sensing technique, the Subband Spectral-Steadiness Factor of Step 409 may also be used as an indicator of a transient.
  • a transient may be considered to be present when the Subband Spectral-Steadiness Factor is a small value, such as, for example, 0.1, indicating substantial spectral unsteadiness.
  • the Bin Spectral-Steadiness Factor produced by Step 408 and by the just-described alternative to Step 408 each inherently provide a variable threshold to a certain degree in that they are based on relative changes from block to block.
  • it may be useful to supplement such inherency by specifically providing a shift in the threshold in response to, for example, multiple transients in a frame or a large transient among smaller transients (e.g., a loud transient coming atop mid- to low-level applause).
  • an event detector may initially identify each clap as an event, but a loud transient (e.g., a drum hit) may make it desirable to shift the threshold so that only the drum hit is identified as an event.
  • a randomness metric may be employed (for example, as described in U.S. Pat. No. Re 36,714, which is hereby incorporated by reference in its entirety) instead of a measure of spectral-steadiness over time.
  • Step 410 Calculate Interchannel Angle Consistency Factor.
  • Step 410
  • Interchannel Angle Consistency is a measure of how similar the interchannel phase angles are within a subband over a frame period. If all bin interchannel angles of the subband are the same, the Interchannel Angle Consistency Factor is 1.0; whereas, if the interchannel angles are randomly scattered, the value approaches zero.
  • the Subband Angle Consistency Factor indicates if there is a phantom image between the channels. If the consistency is low, then it is desirable to decorrelate the channels. A high value indicates a fused image. Image fusion is independent of other signal characteristics.
  • Subband Angle Consistency Factor although an angle parameter, is determined indirectly from two magnitudes. If the interchannel angles are all the same, adding the complex values and then taking the magnitude yields the same result as taking all the magnitudes and adding them, so the quotient is 1. If the interchannel angles are scattered, adding the complex values (such as adding vectors having different angles) results in at least partial cancellation, so the magnitude of the sum is less than the sum of the magnitudes, and the quotient is less than 1.
  • an alternative derivation of the Subband Angle Consistency Factor may use energy (the squares of the magnitudes) instead of magnitude. This may be accomplished by squaring the magnitude from Step 403 before it is applied to Steps 405 and 407 .
  • Step 411 Derive Subband Decorrelation Scale Factor.
  • the Subband Decorrelation Scale Factor is a function of the spectral-steadiness of signal characteristics over time in a subband of a channel (the Spectral-Steadiness Factor) and the consistency in the same subband of a channel of bin angles with respect to corresponding bins of a reference channel (the Interchannel Angle Consistency Factor).
  • the Subband Decorrelation Scale Factor is high only if both the Spectral-Steadiness Factor and the Interchannel Angle Consistency Factor are low.
  • the Decorrelation Scale Factor controls the degree of envelope decorrelation provided in the decoder. Signals that exhibit spectral steadiness over time preferably should not be decorrelated by altering their envelopes, regardless of what is happening in other channels, as it may result in audible artifacts, namely wavering or warbling of the signal.
  • Step 412 Derive Subband Amplitude Scale Factors.
  • Step 404 From the subband frame energy values of Step 404 and from the subband frame energy values of all other channels (as may be obtained by a step corresponding to Step 404 or an equivalent thereof), derive frame-rate Subband Amplitude Scale Factors as follows:
  • Step 412 e See comments regarding step 404 c except that in the case of Step 412 e , there is no suitable subsequent step in which the time smoothing may alternatively be performed.
  • Step 413 Signal-Dependently Time Smooth Interchannel Subband Phase Angles.
  • the subband angle update time constant is set to 0, allowing a rapid subband angle change. This is desirable because it allows the normal angle update mechanism to use a range of relatively slow time constants, minimizing image wandering during static or quasi-static signals, yet fast-changing signals are treated with fast time constants.
  • Step 413 a first-order smoother implementing Step 413 has been found to be suitable. If implemented as a first-order smoother/lowpass filter, the variable “z” corresponds to the feed-forward coefficient (sometimes denoted “ff0”), while “(1-z)” corresponds to the feedback coefficient (sometimes denoted “fb1”).
  • Step 414 Quantize Smoothed Interchannel Subband Phase Angles.
  • the quantized value is treated as a non-negative integer, so an easy way to quantize the angle is to map it to a non-negative floating point number ((add 2 ⁇ if less than 0, making the range 0 to (less than) 2 ⁇ )), scale by the granularity (resolution), and round to an integer.
  • dequantizing that integer can be accomplished by scaling by the inverse of the angle granularity factor, converting a non-negative integer to a non-negative floating point angle (again, range 0 to 2 ⁇ ), after which it can be renormalized to the range ⁇ for further use.
  • Step 415 Quantize Subband Decorrelation Scale Factors.
  • Step 416 Dequantize Subband Angle Control Parameters.
  • Step 414 Dequantize the Subband Angle Control Parameters (see Step 414 ), to use prior to downmixing.
  • Step 417 Distribute Frame-Rate Dequantized Subband Angle Control Parameters Across Blocks.
  • Step 416 In preparation for downmixing, distribute the once-per-frame dequantized Subband Angle Control Parameters of Step 416 across time to the subbands of each block within the frame.
  • the same frame value may be assigned to each block in the frame.
  • Step 418 Interpolate block Subband Angle Control Parameters to Bins
  • Step 417 Distribute the block Subband Angle Control Parameters of Step 417 for each channel across frequency to bins, preferably using linear interpolation as described below.
  • Step 418 minimizes phase angle changes from bin to bin across a subband boundary, thereby minimizing aliasing artifacts.
  • Such linear interpolation may be enabled, for example, as described below following the description of Step 422 .
  • Subband angles are calculated independently of one another, each representing an average across a subband. Thus, there may be a large change from one subband to the next. If the net angle value for a subband is applied to all bins in the subband (a “rectangular” subband distribution), the entire phase change from one subband to a neighboring subband occurs between two bins. If there is a strong signal component there, there may be severe, possibly audible, aliasing.
  • Linear interpolation between the centers of each subband, for example, spreads the phase angle change over all the bins in the subband, minimizing the change between any pair of bins, so that, for example, the angle at the low end of a subband mates with the angle at the high end of the subband below it, while maintaining the overall average the same as the given calculated subband angle.
  • the subband angle distribution may be trapezoidally shaped.
  • the lowest coupled subband has one bin and a subband angle of 20 degrees
  • the next subband has three bins and a subband angle of 40 degrees
  • the third subband has five bins and a subband angle of 100 degrees.
  • the first bin one subband
  • the next three bins are shifted by an angle of 40 degrees
  • the next five bins a farther subband are shifted by an angle of 100 degrees.
  • the first bin still is shifted by an angle of 20 degrees, the next 3 bins are shifted by about 30, 40, and 50 degrees; and the next five bins are shifted by about 67, 83, 100, 117, and 133 degrees.
  • the average subband angle shift is the same, but the maximum bin-to-bin change is reduced to 17 degrees.
  • changes in amplitude from subband to subband, in connection with this and other steps described herein, such as Step 417 may also be treated in a similar interpolative fashion. However, it may not be necessary to do so because there tends to be more natural continuity in amplitude from one subband to the next.
  • Step 419 Apply Phase Angle Rotation to Bin Transform Values for Channel.
  • phase angle rotation applied in the encoder is the inverse of the angle derived from the Subband Angle Control Parameter.
  • Phase angle adjustments, as described herein, in an encoder or encoding process prior to downmixing have several advantages: (1) they minimize cancellations of the channels that are summed to a mono composite signal or matrixed to multiple channels, (2) they minimize reliance on energy normalization (Step 421 ), and (3) they precompensate the decoder inverse phase angle rotation, thereby reducing aliasing.
  • the phase shift is circular, resulting in circular convolution (as mentioned above). While circular convolution may be benign for some continuous signals, it may create spurious spectral components for certain continuous complex signals (such as a pitch pipe) or may cause blurring of transients if different phase angles are used for different subbands. Consequently, a suitable technique to avoid circular convolution may be employed or the Transient Flag may be employed such that, for example, when the Transient Flag is True, the angle calculation results may be overridden, and all subbands in a channel may use the same phase correction factor such as zero or a randomized value.
  • Step 420 Downmix.
  • Step 420
  • the channels are summed, bin-by-bin, to create the mono composite audio signal.
  • the channels may be applied to a passive or active matrix that provides either a simple summation to one channel, as in the N:1 encoding of FIG. 1 , or to multiple channels.
  • the matrix coefficients may be real or complex (real and imaginary).
  • Step 421 Normalize.
  • phase shifting of step 419 is performed on a subband rather than a bin basis.
  • a different phase factor for isolated bins in the encoder may be used if it is detected that the sum energy of such bins is much less than the energy sum of the individual channel bins at that frequency. It is generally not necessary to apply such an isolated correction factor to the decoder, inasmuch as isolated bins usually have little effect on overall image quality.
  • a similar normalization may be applied if multiple channels rather than a mono channel are employed.
  • Step 422 Assemble and Pack into Bitstream(s).
  • the Amplitude Scale Factors, Angle Control Parameters, Decorrelation Scale Factors, and Transient Flags side channel information for each channel, along with the common mono composite audio or the matrixed multiple channels are multiplexed as may be desired and packed into one or more bitstreams suitable for the storage, transmission or storage and transmission medium or media.
  • the mono composite audio or the multiple channel audio may be applied to a data-rate reducing encoding process or device such as, for example, a perceptual encoder or to a perceptual encoder and an entropy coder (e.g., arithmetic or Huffman coder) (sometimes referred to as a “lossless” coder) prior to packing.
  • a data-rate reducing encoding process or device such as, for example, a perceptual encoder or to a perceptual encoder and an entropy coder (e.g., arithmetic or Huffman coder) (sometimes referred to as a “lossless” coder) prior to packing.
  • the mono composite audio (or the multiple channel audio) and related sidechain information may be derived from multiple input channels only for audio frequencies above a certain frequency (a “coupling” frequency). In that case, the audio frequencies below the coupling frequency in each of the multiple input channels may be stored, transmitted or stored and transmitted as discrete channels or may
  • Discrete or otherwise-combined channels may also be applied to a data reducing encoding process or device such as, for example, a perceptual encoder or a perceptual encoder and an entropy encoder.
  • the mono composite audio (or the multiple channel audio) and the discrete multichannel audio may all be applied to an integrated perceptual encoding or perceptual and entropy encoding process or device prior to packing.
  • Interpolation across frequency of the basic phase angle shifts provided by the Subband Angle Control Parameters may be enabled in the Encoder (Step 418 ) and/or in the Decoder (Step 505 , below).
  • the optional Interpolation Flag sidechain parameter may be employed for enabling interpolation in the Decoder. Either the Interpolation Flag or an enabling flag similar to the Interpolation Flag may be used in the Encoder. Note that because the Encoder has access to data at the bin level, it may use different interpolation values than the Decoder, which interpolates the Subband Angle Control Parameters in the sidechain information.
  • decoding steps may be described as follows. With respect to decoding steps, reference is made to FIG. 5 , which is in the nature of a hybrid flowchart and functional block diagram. For simplicity, the figure shows the derivation of sidechain information components for one channel, it being understood that sidechain information components must be obtained for each channel unless the channel is a reference channel for such components, as explained elsewhere.
  • Step 501 Unpack and Decode Sidechain Information.
  • Unpack and decode including dequantization, as necessary, the sidechain data components (Amplitude Scale Factors, Angle Control Parameters, Decorrelation Scale Factors, and Transient Flag) for each frame of each channel (one channel shown in FIG. 5 ).
  • Table lookups may be used to decode the Amplitude Scale Factors, Angle Control Parameter, and Decorrelation Scale Factors.
  • the sidechain data for the reference channel may not include the Angle Control Parameters, Decorrelation Scale Factors, and Transient Flag.
  • Step 502 Unpack and Decode Mono Composite or Multichannel Audio Signal.
  • Step 501 and Step 502 may be considered to be part of a single unpacking and decoding step.
  • Step 502 may include a passive or active matrix.
  • Step 503 Distribute Angle Parameter Values Across Blocks.
  • Block Subband Angle Control Parameter values are derived from the dequantized frame Subband Angle Control Parameter values.
  • Step 503 may be implemented by distributing the same parameter value to every block in the frame.
  • Step 504 Distribute Subband Decorrelation Scale Factor Across Blocks.
  • Block Subband Decorrelation Scale Factor values are derived from the dequantized frame Subband Decorrelation Scale Factor values.
  • Step 504 may be implemented by distributing the same scale factor value to every block in the frame.
  • Step 505 Linearly Interpolate Across Frequency.
  • Step 505 derive bin angles from the block subband angles of decoder Step 503 by linear interpolation across frequency as described above in connection with encoder Step 418 .
  • Linear interpolation in Step 505 may be enabled when the Interpolation Flag is used and is true.
  • Step 506 Add Randomized Phase Angle Offset (Technique 3).
  • “randomized” angles for scaling by the Decorrelation Scale Factor may include not only pseudo-random and truly random variations, but also deterministically-generated variations that, when applied to phase angles or to phase angles and to amplitudes, have the effect of reducing cross-correlation between channels.
  • Such “randomized” variations may be obtained in many ways. For example, a pseudo-random number generator with various seed values may be employed. Alternatively, truly random numbers may be generated using a hardware random number generator. Inasmuch as a randomized angle resolution of only about 1 degree may be sufficient, tables of randomized numbers having two or three decimal places (e.g. 0.84 or 0.844) may be employed.
  • the randomized values (between ⁇ 1.0 and +1.0 with reference to Step 505 c , above) are uniformly distributed statistically across each channel.
  • Step 506 Although the non-linear indirect scaling of Step 506 has been found to be useful, it is not critical and other suitable scalings may be employed—in particular other values for the exponent may be employed to obtain similar results.
  • Step 503 When the Subband Decorrelation Scale Factor value is 1, a full range of random angles from ⁇ to + ⁇ are added (in which case the block Subband Angle Control Parameter values produced by Step 503 are rendered irrelevant). As the Subband Decorrelation Scale Factor value decreases toward zero, the randomized angle offset also decreases toward zero, causing the output of Step 506 to move toward the Subband Angle Control Parameter values produced by Step 503 .
  • the encoder described above may also add a scaled randomized offset in accordance with Technique 3 to the angle shift applied to a channel before downmixing. Doing so may improve alias cancellation in the decoder. It may also be beneficial for improving the synchronicity of the encoder and decoder.
  • Step 507 Add Randomized Phase Angle Offset (Technique 2).
  • Step 505 when the Transient Flag does not indicate a transient, for each bin, add to all the block Subband Angle Control Parameters in a frame provided by Step 503 (Step 505 operates only when the Transient Flag indicates a transient) a different randomized offset value scaled by the Decorrelation Scale Factor (the scaling may be direct as set forth herein in this step):
  • Step 507 Although the direct scaling of Step 507 has been found to be useful, it is not critical and other suitable scalings may be employed.
  • the unique randomized angle value for each bin of each channel preferably does not change with time.
  • the randomized angle values of all the bins in a subband are scaled by the same Subband Decorrelation Scale Factor value, which is updated at the frame rate.
  • the Subband Decorrelation Scale Factor value is 1, a full range of random angles from ⁇ to + ⁇ are added (in which case block subband angle values derived from the dequantized frame subband angle values are rendered irrelevant).
  • the randomized angle offset also diminishes toward zero.
  • the scaling in this Step 507 may be a direct function of the Subband Decorrelation Scale Factor value. For example, a Subband Decorrelation Scale Factor value of 0.5 proportionally reduces every random angle variation by 0.5.
  • the scaled randomized angle value may then be added to the bin angle from decoder Step 506 .
  • the Decorrelation Scale Factor value is updated once per frame. In the presence of a Transient Flag for the frame, this step is skipped, to avoid transient prenoise artifacts.
  • the encoder described above may also add a scaled randomized offset in accordance with Technique 2 to the angle shift applied before downmixing. Doing so may improve alias cancellation in the decoder. It may also be beneficial for improving the synchronicity of the encoder and decoder.
  • Step 508 Normalize Amplitude Scale Factors.
  • Step 509 Boost Subband Scale Factor Levels (Optional).
  • the Transient Flag indicates no transient, apply a slight additional boost to Subband Scale Factor levels, dependent on Subband Decorrelation Scale Factor levels: multiply each normalized Subband Amplitude Scale Factor by a small factor (e.g., 1+0.2*Subband Decorrelation Scale Factor).
  • a small factor e.g. 1+0.2*Subband Decorrelation Scale Factor
  • This step may be useful because the decoder decorrelation Step 507 may result in slightly reduced levels in the final inverse filterbank process.
  • Step 510 Distribute Subband Amplitude Values Across Bins.
  • Step 510 may be implemented by distributing the same subband amplitude scale factor value to every bin in the subband.
  • Step 510 a Add Randomized Amplitude Offset (Optional)
  • Step 510 a is not shown in the drawings.
  • Step 510 a Comment Regarding Step 510 a:
  • the degree to which randomized amplitude shifts are added may be controlled by the Decorrelation Scale Factor, it is believed that a particular scale factor value should cause less amplitude shift than the corresponding randomized phase shift resulting from the same scale factor value in order to avoid audible artifacts.
  • Step 511 Upmix.
  • Step 512 Perform Inverse DFT (Optional).
  • an inverse DFT transform on the bins of each output channel to yield multichannel output PCM values.
  • the individual blocks of time samples are windowed, and adjacent blocks are overlapped and added together in order to reconstruct the final continuous time output PCM audio signal.
  • Step 512
  • a decoder according to the present invention may not provide PCM outputs.
  • the decoder process is employed only above a given coupling frequency, and discrete MDCT coefficients are sent for each channel below that frequency, it may be desirable to convert the DFT coefficients derived by the decoder upmixing Steps 511 a and 511 b to MDCT coefficients, so that they can be combined with the lower frequency discrete MDCT coefficients and requantized in order to provide, for example, a bitstream compatible with an encoding system that has a large number of installed users, such as a standard AC-3 SP/DIF bitstream for application to an external device where an inverse transform may be performed.
  • An inverse DFT transform may be applied to ones of the output channels to provide PCM outputs.
  • Transients are detected in the full-bandwidth channels in order to decide when to switch to short length audio blocks to improve pre-echo performance.
  • High-pass filtered versions of the signals are examined for an increase in energy from one sub-block time-segment to the next.
  • Sub-blocks are examined at different time scales. If a transient is detected in the second half of an audio block in a channel that channel switches to a short block.
  • a channel that is block-switched uses the D45 exponent strategy [i.e., the data has a coarser frequency resolution in order to reduce the data overhead resulting from the increase in temporal resolution].
  • the transient detector is used to determine when to switch from a long transform block (length 512), to the short block (length 256). It operates on 512 samples for every audio block. This is done in two passes, with each pass processing 256 samples. Transient detection is broken down into four steps: 1) high-pass filtering, 2) segmentation of the block into submultiples, 3) peak amplitude detection within each sub-block segment, and 4) threshold comparison.
  • the transient detector outputs a flag blksw[n] for each full-bandwidth channel, which when set to “one” indicates the presence of a transient in the second half of the 512 length input block for the corresponding channel.
  • aspects of the present invention are not limited to N:1 encoding as described in connection with FIG. 1 . More generally, aspects of the invention are applicable to the transformation of any number of input channels (n input channels) to any number of output channels (m output channels) in the manner of FIG. 6 (i.e., N:M encoding). Because in many common applications the number of input channels n is greater than the number of output channels m, the N:M encoding arrangement of FIG. 6 will be referred to as “downmixing” for convenience in description.
  • Downmix Matrix 6 ′ may be a passive or active matrix that provides either a simple summation to one channel, as in the N:1 encoding of FIG. 1 , or to multiple channels.
  • the matrix coefficients may be real or complex (real and imaginary).
  • Other devices and functions in FIG. 6 may be the same as in the FIG. 1 arrangement and they bear the same reference numerals.
  • Downmix Matrix 6 ′ may provide a hybrid frequency-dependent function such that it provides, for example, m f1-f2 channels in a frequency range f 1 to f 2 and m f2-f3 channels in a frequency range f 2 to f 3 .
  • a coupling frequency of, for example, 1000 Hz
  • the Downmix Matrix 6 ′ may provide two channels and above the coupling frequency the Downmix Matrix 6 ′ may provide one channel.
  • By employing two channels below the coupling frequency better spatial fidelity may be obtained, especially if the two channels represent horizontal directions (to match the horizontally of the human ears).
  • FIG. 6 shows the generation of the same sidechain information for each channel as in the FIG. 1 arrangement, it may be possible to omit certain ones of the sidechain information when more than one channel is provided by the output of the Downmix Matrix 6 ′. In some cases, acceptable results may be obtained when only the amplitude scale factor sidechain information is provided by the FIG. 6 arrangement. Further details regarding sidechain options are discussed below in connection with the descriptions of FIGS. 7 , 8 and 9 .
  • the multiple channels generated by the Downmix Matrix 6 ′ need not be fewer than the number of input channels n.
  • the purpose of an encoder such as in FIG. 6 is to reduce the number of bits for transmission or storage, it is likely that the number of channels produced by downmix matrix 6 ′ will be fewer than the number of input channels n.
  • the arrangement of FIG. 6 may also be used as an “upmixer.” In that case, there may be applications in which the number of channels m produced by the Downmix Matrix 6 ′ is more than the number of input channels n.
  • Encoders as described in connection with the examples of FIGS. 2 , 5 and 6 may also include their own local decoder or decoding function in order to determine if the audio information and the sidechain information, when decoded by such a decoder, would provide suitable results. The results of such a determination could be used to improve the parameters by employing, for example, a recursive process. In a block encoding and decoding system, recursion calculations could be performed, for example, on every block before the next block ends in order to minimize the delay in transmitting a block of audio information and its associated spatial parameters.
  • the encoder also includes its own decoder or decoding function could also be employed advantageously when spatial parameters are not stored or sent only for certain blocks. If unsuitable decoding would result from not sending spatial-parameter sidechain information, such sidechain information would be sent for the particular block.
  • the decoder may be a modification of the decoder or decoding function of FIG. 2 , 5 or 6 in that the decoder would have both the ability to recover spatial-parameter sidechain information for frequencies above the coupling frequency from the incoming bitstream but also to generate simulated spatial-parameter sidechain information from the stereo information below the coupling frequency.
  • the encoder could simply check to determine if there were any signal content below the coupling frequency (determined in any suitable way, for example, a sum of the energy in frequency bins through the frequency range), and, if not, it would send or store spatial-parameter sidechain information rather than not doing so if the energy were above the threshold.
  • the coupling frequency may also result in more bits being available for sending sidechain information.
  • FIG. 7 A more generalized form of the arrangement of FIG. 2 is shown in FIG. 7 , wherein an upmix matrix function or device (“Upmix Matrix”) 20 receives the 1 to m channels generated by the arrangement of FIG. 6 .
  • the Upmix Matrix 20 may be a passive matrix. It may be, but need not be, the conjugate transposition (i.e., the complement) of the Downmix Matrix 6 ′ of the FIG. 6 arrangement.
  • the Upmix Matrix 20 may be an active matrix—a variable matrix or a passive matrix in combination with a variable matrix. If an active matrix decoder is employed, in its relaxed or quiescent state it may be the complex conjugate of the Downmix Matrix or it may be independent of the Downmix Matrix.
  • the sidechain information may be applied as shown in FIG. 7 so as to control the Adjust Amplitude, Rotate Angle, and (optional) Interpolator functions or devices.
  • the Upmix Matrix if an active matrix, operates independently of the sidechain information and responds only to the channels applied to it.
  • some or all of the sidechain information may be applied to the active matrix to assist its operation.
  • some or all of the Adjust Amplitude, Rotate Angle, and Interpolator functions or devices may be omitted.
  • the Decoder example of FIG. 7 may also employ the alternative of applying a degree of randomized amplitude variations under certain signal conditions, as described above in connection with FIGS. 2 and 5 .
  • the arrangement of FIG. 7 may be characterized as a “hybrid matrix decoder” for operating in a “hybrid matrix encoder/decoder system.”
  • “Hybrid” in this context refers to the fact that the decoder may derive some measure of control information from its input audio signal (i.e., the active matrix responds to spatial information encoded in the channels applied to it) and a further measure of control information from spatial-parameter sidechain information.
  • Other elements of FIG. 7 are as in the arrangement of FIG. 2 and bear the same reference numerals.
  • Suitable active matrix decoders for use in a hybrid matrix decoder may include active matrix decoders such as those mentioned above and incorporated by reference, including, for example, matrix decoders known as “Pro Logic” and “Pro Logic II” decoders (“Pro Logic” is a trademark of Dolby Laboratories Licensing Corporation).
  • FIGS. 8 and 9 show variations on the generalized Decoder of FIG. 7 .
  • both the arrangement of FIG. 8 and the arrangement of FIG. 9 show alternatives to the decorrelation technique of FIGS. 2 and 7 .
  • respective decorrelator functions or devices (“Decorrelators”) 46 and 48 are in the time domain, each following the respective Inverse Filterbank 30 and 36 in their channel.
  • respective decorrelator functions or devices (“Decorrelators”) 50 and 52 are in the frequency domain, each preceding the respective Inverse Filterbank 30 and 36 in their channel.
  • each of the Decorrelators ( 46 , 48 , 50 , 52 ) has a unique characteristic so that their outputs are mutually decorrelated with respect to each other.
  • the Decorrelation Scale Factor may be used to control, for example, the ratio of decorrelated to uncorrelated signal provided in each channel.
  • the Transient Flag may also be used to shift the mode of operation of the Decorrelator, as is explained below. In both the FIG. 8 and FIG.
  • each Decorrelator may be a Schroeder-type reverberator having its own unique filter characteristic, in which the amount or degree of reverberation is controlled by the decorrelation scale factor (implemented, for example, by controlling the degree to which the Decorrelator output forms a part of a linear combination of the Decorrelator input and output).
  • the decorrelation scale factor implemented, for example, by controlling the degree to which the Decorrelator output forms a part of a linear combination of the Decorrelator input and output.
  • other controllable decorrelation techniques may be employed either alone or in combination with each other or with a Schroeder-type reverberator.
  • Schroeder-type reverberators are well known and may trace their origin to two journal papers: “‘Colorless’ Artificial Reverberation” by M. R. Schroeder and B. F. Logan, IRE Transactions on Audio , vol. AU-9, pp. 209-214, 1961 and “Natural Sounding Artificial Re
  • a single (i.e., wideband) Decorrelation Scale Factor is required. This may be obtained by any of several ways. For example, only a single Decorrelation Scale Factor may be generated in the encoder of FIG. 1 or FIG. 7 . Alternatively, if the encoder of FIG. 1 or FIG. 7 generates Decorrelation Scale Factors on a subband basis, the Subband Decorrelation Scale Factors may be amplitude or power summed in the encoder of FIG. 1 or FIG. 7 or in the decoder of FIG. 8 .
  • the Decorrelators 50 and 52 When the Decorrelators 50 and 52 operate in the frequency domain, as in the FIG. 9 arrangement, they may receive a decorrelation scale factor for each subband or groups of subbands and, concomitantly, provide a commensurate degree of decorrelation for such subbands or groups of subbands.
  • the Decorrelators 46 and 48 of FIG. 8 and the Decorrelators 50 and 52 of FIG. 9 may optionally receive the Transient Flag.
  • the Transient Flag may be employed to shift the mode of operation of the respective Decorrelator.
  • the Decorrelator may operate as a Schroeder-type reverberator in the absence of the transient flag but upon its receipt and for a short subsequent time period, say 1 to 10 milliseconds, operate as a fixed delay. Each channel may have a predetermined fixed delay or the delay may be varied in response to a plurality of transients within a short time period.
  • the transient flag may also be employed to shift the mode of operation of the respective Decorrelator.
  • the receipt of a transient flag may, for example, trigger a short (several milliseconds) increase in amplitude in the channel in which the flag occurred.
  • an Interpolator 27 ( 33 ), controlled by the optional Transient Flag, may provide interpolation across frequency of the phase angles output of Rotate Angle 28 ( 33 ) in a manner as described above.
  • the amplitude scale factor, the Decorrelation Scale Factor, and, optionally, the Transient Flag may be sent.
  • any of the FIG. 7 , 8 or 9 arrangements may be employed (omitting the Rotate Angle 28 and 34 in each of them).
  • any of the FIG. 7 , 8 or 9 arrangements may be employed (omitting the Decorrelator 38 and 42 of FIGS. 7 and 46 , 48 , 50 , 52 of FIGS. 8 and 9 ).
  • FIGS. 6-9 are intended to show any number of input and output channels although, for simplicity in presentation, only two channels are shown.

Abstract

Multiple channels of audio are combined either to a monophonic composite signal or to multiple channels of audio along with related auxiliary information from which multiple channels of audio are reconstructed, including improved downmixing of multiple audio channels to a monophonic audio signal or to multiple audio channels and improved decorrelation of multiple audio channels derived from a monophonic audio channel or from multiple audio channels. Aspects of the disclosed invention are usable in audio encoders, decoders, encode/decode systems, downmixers, upmixers, and decorrelators.

Description

TECHNICAL FIELD
The invention relates generally to audio signal processing. The invention is particularly useful in low bitrate and very low bitrate audio signal processing. More particularly, aspects of the invention relate to an encoder (or encoding process), a decoder (or decoding processes), and to an encode/decode system (or encoding/decoding process) for audio signals in which a plurality of audio channels is represented by a composite monophonic (“mono”) audio channel and auxiliary (“sidechain”) information. Alternatively, the plurality of audio channels is represented by a plurality of audio channels and sidechain information. Aspects of the invention also relate to a multichannel to composite monophonic channel downmixers (or downmix process), to a monophonic channel to multichannel upmixer (or upmixer process), and to a monophonic channel to multichannel decorrelator (or decorrelation process). Other aspects of the invention relate to a multichannel-to-multichannel downmixers (or downmix process), to a multichannel-to-multichannel upmixer (or upmix process), and to a decorrelator (or decorrelation process).
BACKGROUND ART
In the AC-3 digital audio encoding and decoding system, channels may be selectively combined or “coupled” at high frequencies when the system becomes starved for bits. Details of the AC-3 system are well known in the art—see, for example: ATSC Standard A52/A: Digital Audio Compression Standard (AC-3), Revision A, Advanced Television Systems Committee, 20 Aug. 2001. The A/52A document is available on the World Wide Web at http colon forward-slash forward-slash www dot atsc dot org forward-slash standards dot html. The A/52A document is hereby incorporated by reference in its entirety.
The frequency above which the AC-3 system combines channels on demand is referred to as the “coupling” frequency. Above the coupling frequency, the coupled channels are combined into a “coupling” or composite channel. The encoder generates “coupling coordinates” (amplitude scale factors) for each subband above the coupling frequency in each channel. The coupling coordinates indicate the ratio of the original energy of each coupled channel subband to the energy of the corresponding subband in the composite channel. Below the coupling frequency, channels are encoded discretely. The phase polarity of a coupled channel's subband may be reversed before the channel is combined with one or more other coupled channels in order to reduce out-of-phase signal component cancellation. The composite channel along with sidechain information that includes, on a per-subband basis, the coupling coordinates and whether the channel's phase is inverted, are sent to the decoder. In practice, the coupling frequencies employed in commercial embodiments of the AC-3 system have ranged from about 10 kHz to about 3500 Hz. U.S. Pat. Nos. 5,583,962; 5,633,981, 5,727,119, 5,909,664, and 6,021,386 include teachings that relate to the combining of multiple audio channels into a composite channel and auxiliary or sidechain information and the recovery therefrom of an approximation to the original multiple channels. Each of said patents is hereby incorporated by reference in its entirety.
DISCLOSURE OF THE INVENTION
Aspects of the present invention may be viewed as improvements upon the “coupling” techniques of the AC-3 encoding and decoding system and also upon other techniques in which multiple channels of audio are combined either to a monophonic composite signal or to multiple channels of audio along with related auxiliary information and from which multiple channels of audio are reconstructed. Aspects of the present invention also may be viewed as improvements upon techniques for downmixing multiple audio channels to a monophonic audio signal or to multiple audio channels and for decorrelating multiple audio channels derived from a monophonic audio channel or from multiple audio channels.
Aspects of the invention may be employed in an N:1:N spatial audio coding technique (where “N” is the number of audio channels) or an M:1:N spatial audio coding technique (where “M” is the number of encoded audio channels and “N” is the number of decoded audio channels) that improve on channel coupling, by providing, among other things, improved phase compensation, decorrelation mechanisms, and signal-dependent variable time-constants. Aspects of the present invention may also be employed in N:x:N and M:x:N spatial audio coding techniques wherein “x” may be 1 or greater than 1. Goals include the reduction of coupling cancellation artifacts in the encode process by adjusting relative interchannel phase before downmixing, and improving the spatial dimensionality of the reproduced signal by restoring the phase angles and degrees of decorrelation in the decoder. Aspects of the invention when embodied in practical embodiments should allow for continuous rather than on-demand channel coupling and lower coupling frequencies than, for example in the AC-3 system, thereby reducing the required data rate.
DESCRIPTION OF THE DRAWINGS
FIG. 1 is an idealized block diagram showing the principal functions or devices of an N:1 encoding arrangement embodying aspects of the present invention.
FIG. 2 is an idealized block diagram showing the principal functions or devices of a 1:N decoding arrangement embodying aspects of the present invention.
FIG. 3 shows an example of a simplified conceptual organization of bins and subbands along a (vertical) frequency axis and blocks and a frame along a (horizontal) time axis. The figure is not to scale.
FIG. 4 is in the nature of a hybrid flowchart and functional block diagram showing encoding steps or devices performing functions of an encoding arrangement embodying aspects of the present invention.
FIG. 5 is in the nature of a hybrid flowchart and functional block diagram showing decoding steps or devices performing functions of a decoding arrangement embodying aspects of the present invention.
FIG. 6 is an idealized block diagram showing the principal functions or devices of a first N:x encoding arrangement embodying aspects of the present invention.
FIG. 7 is an idealized block diagram showing the principal functions or devices of an x:M decoding arrangement embodying aspects of the present invention.
FIG. 8 is an idealized block diagram showing the principal functions or devices of a first alternative x:M decoding arrangement embodying aspects of the present invention.
FIG. 9 is an idealized block diagram showing the principal functions or devices of a second alternative x:M decoding arrangement embodying aspects of the present invention.
BEST MODE FOR CARRYING OUT THE INVENTION Basic N:1 Encoder
Referring to FIG. 1, an N:1 encoder function or device embodying aspects of the present invention is shown. The figure is an example of a function or structure that performs as a basic encoder embodying aspects of the invention. Other functional or structural arrangements that practice aspects of the invention may be employed, including alternative and/or equivalent functional or structural arrangements described below.
Two or more audio input channels are applied to the encoder. Although, in principle, aspects of the invention may be practiced by analog, digital or hybrid analog/digital embodiments, examples disclosed herein are digital embodiments. Thus, the input signals may be time samples that may have been derived from analog audio signals. The time samples may be encoded as linear pulse-code modulation (PCM) signals. Each linear PCM audio input channel is processed by a filterbank function or device having both an in-phase and a quadrature output, such as a 512-point windowed forward discrete Fourier transform (DFT) (as implemented by a Fast Fourier Transform (FFT)). The filterbank may be considered to be a time-domain to frequency-domain transform.
FIG. 1 shows a first PCM channel input (channel “1”) applied to a filterbank function or device, “Filterbank” 2, and a second PCM channel input (channel “n”) applied, respectively, to another filterbank function or device, “Filterbank” 4. There may be “n” input channels, where “n” is a whole positive integer equal to two or more. Thus, there also are “n” Filterbanks, each receiving a unique one of the “n” input channels. For simplicity in presentation, FIG. 1 shows only two input channels, “1” and “n”.
When a Filterbank is implemented by an FFT, input time-domain signals are segmented into consecutive blocks and are usually processed in overlapping blocks. The FFT's discrete frequency outputs (transform coefficients) are referred to as bins, each having a complex value with real and imaginary parts corresponding, respectively, to in-phase and quadrature components. Contiguous transform bins may be grouped into subbands approximating critical bandwidths of the human ear, and most sidechain information produced by the encoder, as will be described, may be calculated and transmitted on a per-subband basis in order to minimize processing resources and to reduce the bitrate. Multiple successive time-domain blocks may be grouped into frames, with individual block values averaged or otherwise combined or accumulated across each frame, to minimize the sidechain data rate. In examples described herein, each filterbank is implemented by an FFT, contiguous transform bins are grouped into subbands, blocks are grouped into frames and sidechain data is sent on a once per-frame basis. Alternatively, sidechain data may be sent on a more than once per frame basis (e.g., once per block). See, for example, FIG. 3 and its description, hereinafter. As is well known, there is a tradeoff between the frequency at which sidechain information is sent and the required bitrate.
A suitable practical implementation of aspects of the present invention may employ fixed length frames of about 32 milliseconds when a 48 kHz sampling rate is employed, each frame having six blocks at intervals of about 5.3 milliseconds each (employing, for example, blocks having a duration of about 10.6 milliseconds with a 50% overlap). However, neither such timings nor the employment of fixed length frames nor their division into a fixed number of blocks is critical to practicing aspects of the invention provided that information described herein as being sent on a per-frame basis is sent no less frequently than about every 40 milliseconds. Frames may be of arbitrary size and their size may vary dynamically. Variable block lengths may be employed as in the AC-3 system cited above. It is with that understanding that reference is made herein to “frames” and “blocks.”
In practice, if the composite mono or multichannel signal(s), or the composite mono or multichannel signal(s) and discrete low-frequency channels, are encoded, as for example by a perceptual coder, as described below, it is convenient to employ the same frame and block configuration as employed in the perceptual coder. Moreover, if the coder employs variable block lengths such that there is, from time to time, a switching from one block length to another, it would be desirable if one or more of the sidechain information as described herein is updated when such a block switch occurs. In order to minimize the increase in data overhead upon the updating of sidechain information upon the occurrence of such a switch, the frequency resolution of the updated sidechain information may be reduced.
FIG. 3 shows an example of a simplified conceptual organization of bins and subbands along a (vertical) frequency axis and blocks and a frame along a (horizontal) time axis. When bins are divided into subbands that approximate critical bands, the lowest frequency subbands have the fewest bins (e.g., one) and the number of bins per subband increase with increasing frequency.
Returning to FIG. 1, a frequency-domain version of each of the n time-domain input channels, produced by the each channel's respective Filterbank ( Filterbanks 2 and 4 in this example) are summed together (“downmixed”) to a monophonic (“mono”) composite audio signal by an additive combining function or device “Additive Combiner” 6.
The downmixing may be applied to the entire frequency bandwidth of the input audio signals or, optionally, it may be limited to frequencies above a given “coupling” frequency, inasmuch as artifacts of the downmixing process may become more audible at middle to low frequencies. In such cases, the channels may be conveyed discretely below the coupling frequency. This strategy may be desirable even if processing artifacts are not an issue, in that mid/low frequency subbands constructed by grouping transform bins into critical-band-like subbands (size roughly proportional to frequency) tend to have a small number of transform bins at low frequencies (one bin at very low frequencies) and may be directly coded with as few or fewer bits than is required to send a downmixed mono audio signal with sidechain information. A coupling or transition frequency as low as 4 kHz, 2300 Hz, 1000 Hz, or even the bottom of the frequency band of the audio signals applied to the encoder, may be acceptable for some applications, particularly those in which a very low bitrate is important. Other frequencies may provide a useful balance between bit savings and listener acceptance. The choice of a particular coupling frequency is not critical to the invention. The coupling frequency may be variable and, if variable, it may depend, for example, directly or indirectly on input signal characteristics.
Before downmixing, it is an aspect of the present invention to improve the channels' phase angle alignments vis-à-vis each other, in order to reduce the cancellation of out-of-phase signal components when the channels are combined and to provide an improved mono composite channel. This may be accomplished by controllably shifting over time the “absolute angle” of some or all of the transform bins in ones of the channels. For example, all of the transform bins representing audio above a coupling frequency, thus defining a frequency band of interest, may be controllably shifted over time, as necessary, in every channel or, when one channel is used as a reference, in all but the reference channel.
The “absolute angle” of a bin may be taken as the angle of the magnitude-and-angle representation of each complex valued transform bin produced by a filterbank. Controllable shifting of the absolute angles of bins in a channel is performed by an angle rotation function or device (“Rotate Angle”). Rotate Angle 8 processes the output of Filterbank 2 prior to its application to the downmix summation provided by Additive Combiner 6, while Rotate Angle 10 processes the output of Filterbank 4 prior to its application to the Additive Combiner 6. It will be appreciated that, under some signal conditions, no angle rotation may be required for a particular transform bin over a time period (the time period of a frame, in examples described herein). Below the coupling frequency, the channel information may be encoded discretely (not shown in FIG. 1).
In principle, an improvement in the channels' phase angle alignments with respect to each other may be accomplished by shifting the phase of every transform bin or subband by the negative of its absolute phase angle, in each block throughout the frequency band of interest. Although this substantially avoids cancellation of out-of-phase signal components, it tends to cause artifacts that may be audible, particularly if the resulting mono composite signal is listened to in isolation. Thus, it is desirable to employ the principle of “least treatment” by shifting the absolute angles of bins in a channel only as much as necessary to minimize out-of-phase cancellation in the downmix process and minimize spatial image collapse of the multichannel signals reconstituted by the decoder. Techniques for determining such angle shifts are described below. Such techniques include time and frequency smoothing and the manner in which the signal processing responds to the presence of a transient.
Energy normalization may also be performed on a per-bin basis in the encoder to reduce further any remaining out-of-phase cancellation of isolated bins, as described further below. Also as described further below, energy normalization may also be performed on a per-subband basis (in the decoder) to assure that the energy of the mono composite signal equals the sums of the energies of the contributing channels.
Each input channel has an audio analyzer function or device (“Audio Analyzer”) associated with it for generating the sidechain information for that channel and for controlling the amount or degree of angle rotation applied to the channel before it is applied to the downmix summation 6. The Filterbank outputs of channels 1 and n are applied to Audio Analyzer 12 and to Audio Analyzer 14, respectively. Audio Analyzer 12 generates the sidechain information for channel 1 and the amount of phase angle rotation for channel 1. Audio Analyzer 14 generates the sidechain information for channel n and the amount of angle rotation for channel n. It will be understood that such references herein to “angle” refer to phase angle.
The sidechain information for each channel generated by an audio analyzer for each channel may include:
    • an Amplitude Scale Factor (“Amplitude SF”),
    • an Angle Control Parameter,
    • a Decorrelation Scale Factor (“Decorrelation SF”),
    • a Transient Flag, and
    • optionally, an Interpolation Flag.
      Such sidechain information may be characterized as “spatial parameters,” indicative of spatial properties of the channels and/or indicative of signal characteristics that may be relevant to spatial processing, such as transients. In each case, the sidechain information applies to a single subband (except for the Transient Flag and the Interpolation Flag, each of which apply to all subbands within a channel) and may be updated once per frame, as in the examples described below, or upon the occurrence of a block switch in a related coder. Further details of the various spatial parameters are set forth below. The angle rotation for a particular channel in the encoder may be taken as the polarity-reversed Angle Control Parameter that forms part of the sidechain information.
If a reference channel is employed, that channel may not require an Audio Analyzer or, alternatively, may require an Audio Analyzer that generates only Amplitude Scale Factor sidechain information. It is not necessary to send an Amplitude Scale Factor if that scale factor can be deduced with sufficient accuracy by a decoder from the Amplitude Scale Factors of the other, non-reference, channels. It is possible to deduce in the decoder the approximate value of the reference channel's Amplitude Scale Factor if the energy normalization in the encoder assures that the scale factors across channels within any subband substantially sum square to 1, as described below. The deduced approximate reference channel Amplitude Scale Factor value may have errors as a result of the relatively coarse quantization of amplitude scale factors resulting in image shifts in the reproduced multi-channel audio. However, in a low data rate environment, such artifacts may be more acceptable than using the bits to send the reference channel's Amplitude Scale Factor. Nevertheless, in some cases it may be desirable to employ an audio analyzer for the reference channel that generates, at least, Amplitude Scale Factor sidechain information.
FIG. 1 shows in a dashed line an optional input to each audio analyzer from the PCM time domain input to the audio analyzer in the channel. This input may be used by the Audio Analyzer to detect a transient over a time period (the period of a block or frame, in the examples described herein) and to generate a transient indicator (e.g., a one-bit “Transient Flag”) in response to a transient. Alternatively, as described below in the comments to Step 408 of FIG. 4, a transient may be detected in the frequency domain, in which case the Audio Analyzer need not receive a time-domain input.
The mono composite audio signal and the sidechain information for all the channels (or all the channels except the reference channel) may be stored, transmitted, or stored and transmitted to a decoding process or device (“Decoder”). Preliminary to the storage, transmission, or storage and transmission, the various audio signals and various sidechain information may be multiplexed and packed into one or more bitstreams suitable for the storage, transmission or storage and transmission medium or media. The mono composite audio may be applied to a data-rate reducing encoding process or device such as, for example, a perceptual encoder or to a perceptual encoder and an entropy coder (e.g., arithmetic or Huffman coder) (sometimes referred to as a “lossless” coder) prior to storage, transmission, or storage and transmission. Also, as mentioned above, the mono composite audio and related sidechain information may be derived from multiple input channels only for audio frequencies above a certain frequency (a “coupling” frequency). In that case, the audio frequencies below the coupling frequency in each of the multiple input channels may be stored, transmitted or stored and transmitted as discrete channels or may be combined or processed in some manner other than as described herein. Such discrete or otherwise-combined channels may also be applied to a data reducing encoding process or device such as, for example, a perceptual encoder or a perceptual encoder and an entropy encoder. The mono composite audio and the discrete multichannel audio may all be applied to an integrated perceptual encoding or perceptual and entropy encoding process or device.
The particular manner in which sidechain information is carried in the encoder bitstream is not critical to the invention. If desired, the sidechain information may be carried in such as way that the bitstream is compatible with legacy decoders (i.e., the bitstream is backwards-compatible). Many suitable techniques for doing so are known. For example, many encoders generate a bitstream having unused or null bits that are ignored by the decoder. An example of such an arrangement is set forth in U.S. Pat. No. 6,807,528 B1 of Truman et al, entitled “Adding Data to a Compressed Data Frame,” Oct. 19, 2004, which patent is hereby incorporated by reference in its entirety. Such bits may be replaced with the sidechain information. Another example is that the sidechain information may be steganographically encoded in the encoder's bitstream. Alternatively, the sidechain information may be stored or transmitted separately from the backwards-compatible bitstream by any technique that permits the transmission or storage of such information along with a mono/stereo bitstream compatible with legacy decoders.
Basic 1:N and 1:M Decoder
Referring to FIG. 2, a decoder function or device (“Decoder”) embodying aspects of the present invention is shown. The figure is an example of a function or structure that performs as a basic decoder embodying aspects of the invention. Other functional or structural arrangements that practice aspects of the invention may be employed, including alternative and/or equivalent functional or structural arrangements described below.
The Decoder receives the mono composite audio signal and the sidechain information for all the channels or all the channels except the reference channel. If necessary, the composite audio signal and related sidechain information is demultiplexed, unpacked and/or decoded. Decoding may employ a table lookup. The goal is to derive from the mono composite audio channels a plurality of individual audio channels approximating respective ones of the audio channels applied to the Encoder of FIG. 1, subject to bitrate-reducing techniques of the present invention that are described herein.
Of course, one may choose not to recover all of the channels applied to the encoder or to use only the monophonic composite signal. Alternatively, channels in addition to the ones applied to the Encoder may be derived from the output of a Decoder according to aspects of the present invention by employing aspects of the inventions described in International Application PCT/US 02/03619, filed Feb. 7, 2002, published Aug. 15, 2002, designating the United States, and its resulting U.S. national application Ser. No. 10/467,213, filed Aug. 5, 2003, and in International Application PCT/US03/24570, filed Aug. 6, 2003, published Mar. 4, 2001 as WO 2004/019656, designating the United States, and its resulting U.S. national application Ser. No. 10/522,515, filed Jan. 27, 2005. Said applications are hereby incorporated by reference in their entirety. Channels recovered by a Decoder practicing aspects of the present invention are particularly useful in connection with the channel multiplication techniques of the cited and incorporated applications in that the recovered channels not only have useful interchannel amplitude relationships but also have useful interchannel phase relationships. Another alternative for channel multiplication is to employ a matrix decoder to derive additional channels. The interchannel amplitude- and phase-preservation aspects of the present invention make the output channels of a decoder embodying aspects of the present invention particularly suitable for application to an amplitude- and phase-sensitive matrix decoder. Many such matrix decoders employ wideband control circuits that operate properly only when the signals applied to them are stereo throughout the signals' bandwidth. Thus, if the aspects of the present invention are embodied in an N:1:N system in which N is 2, the two channels recovered by the decoder may be applied to a 2:M active matrix decoder. Such channels may have been discrete channels below a coupling frequency, as mentioned above. Many suitable active matrix decoders are well known in the art, including, for example, matrix decoders known as “Pro Logic” and “Pro Logic II” decoders (“Pro Logic” is a trademark of Dolby Laboratories Licensing Corporation). Aspects of Pro Logic decoders are disclosed in U.S. Pat. Nos. 4,799,260 and 4,941,177, each of which is incorporated by reference herein in its entirety. Aspects of Pro Logic II decoders are disclosed in pending U.S. patent application Ser. No. 09/532,711 of Fosgate, entitled “Method for Deriving at Least Three Audio Signals from Two Input Audio Signals,” filed Mar. 22, 2000 and published as WO 01/41504 on Jun. 7, 2001, and in pending U.S. patent application Ser. No. 10/362,786 of Fosgate et al, entitled “Method for Apparatus for Audio Matrix Decoding,” filed Feb. 25, 2003 and published as US 2004/0125960 A1 on Jul. 1, 2004. Each of said applications is incorporated by reference herein in its entirety. Some aspects of the operation of Dolby Pro Logic and Pro Logic II decoders are explained, for example, in papers available on the Dolby Laboratories' website (www.dolby.com): “Dolby Surround Pro Logic Decoder Principles of Operation,” by Roger Dressler, and “Mixing with Dolby Pro Logic II Technology, by Jim Hilson. Other suitable active matrix decoders may include those described in one or more of the following U.S. Patents and published International Applications (each designating the United States), each of which is hereby incorporated by reference in its entirety: U.S. Pat. Nos. 5,046,098; 5,274,740; 5,400,433; 5,625,696; 5,644,640; 5,504,819; 5,428,687; 5,172,415; and WO 02/19768.
Referring again to FIG. 2, the received mono composite audio channel is applied to a plurality of signal paths from which a respective one of each of the recovered multiple audio channels is derived. Each channel-deriving path includes, in either order, an amplitude adjusting function or device (“Adjust Amplitude”) and an angle rotation function or device (“Rotate Angle”).
The Adjust Amplitudes apply gains or losses to the mono composite signal so that, under certain signal conditions, the relative output magnitudes (or energies) of the output channels derived from it are similar to those of the channels at the input of the encoder. Alternatively, under certain signal conditions when “randomized” angle variations are imposed, as next described, a controllable amount of “randomized” amplitude variations may also be imposed on the amplitude of a recovered channel in order to improve its decorrelation with respect to other ones of the recovered channels.
The Rotate Angles apply phase rotations so that, under certain signal conditions, the relative phase angles of the output channels derived from the mono composite signal are similar to those of the channels at the input of the encoder. Preferably, under certain signal conditions, a controllable amount of “randomized” angle variations is also imposed on the angle of a recovered channel in order to improve its decorrelation with respect to other ones of the recovered channels.
As discussed further below, “randomized” angle amplitude variations may include not only pseudo-random and truly random variations, but also deterministically-generated variations that have the effect of reducing cross-correlation between channels. This is discussed further below in the Comments to Step 505 of FIG. 5A.
Conceptually, the Adjust Amplitude and Rotate Angle for a particular channel scale the mono composite audio DFT coefficients to yield reconstructed transform bin values for the channel.
The Adjust Amplitude for each channel may be controlled at least by the recovered sidechain Amplitude Scale Factor for the particular channel or, in the case of the reference channel, either from the recovered sidechain Amplitude Scale Factor for the reference channel or from an Amplitude Scale Factor deduced from the recovered sidechain Amplitude Scale Factors of the other, non-reference, channels. Alternatively, to enhance decorrelation of the recovered channels, the Adjust Amplitude may also be controlled by a Randomized Amplitude Scale Factor Parameter derived from the recovered sidechain Decorrelation Scale Factor for a particular channel and the recovered sidechain Transient Flag for the particular channel.
The Rotate Angle for each channel may be controlled at least by the recovered sidechain Angle Control Parameter (in which case, the Rotate Angle in the decoder may substantially undo the angle rotation provided by the Rotate Angle in the encoder). To enhance decorrelation of the recovered channels, a Rotate Angle may also be controlled by a Randomized Angle Control Parameter derived from the recovered sidechain Decorrelation Scale Factor for a particular channel and the recovered sidechain Transient Flag for the particular channel. The Randomized Angle Control Parameter for a channel, and, if employed, the Randomized Amplitude Scale Factor for a channel, may be derived from the recovered Decorrelation Scale Factor for the channel and the recovered Transient Flag for the channel by a controllable decorrelator function or device (“Controllable Decorrelator”).
Referring to the example of FIG. 2, the recovered mono composite audio is applied to a first channel audio recovery path 22, which derives the channel 1 audio, and to a second channel audio recovery path 24, which derives the channel n audio. Audio path 22 includes an Adjust Amplitude 26, a Rotate Angle 28, and, if a PCM output is desired, an inverse filterbank function or device (“Inverse Filterbank”) 30. Similarly, audio path 24 includes an Adjust Amplitude 32, a Rotate Angle 34, and, if a PCM output is desired, an inverse filterbank function or device (“Inverse Filterbank”) 36. As with the case of FIG. 1, only two channels are shown for simplicity in presentation, it being understood that there may be more than two channels.
The recovered sidechain information for the first channel, channel 1, may include an Amplitude Scale Factor, an Angle Control Parameter, a Decorrelation Scale Factor, a Transient Flag, and, optionally, an Interpolation Flag, as stated above in connection with the description of a basic Encoder. The Amplitude Scale Factor is applied to Adjust Amplitude 26. If the optional Interpolation Flag is employed, an optional frequency interpolator or interpolator function (“Interpolator”) 27 may be employed in order to interpolate the Angle Control Parameter across frequency (e.g., across the bins in each subband of a channel). Such interpolation may be, for example, a linear interpolation of the bin angles between the centers of each subband. The state of the one-bit Interpolation Flag selects whether or not interpolation across frequency is employed, as is explained further below. The Transient Flag and Decorrelation Scale Factor are applied to a Controllable Decorrelator 38 that generates a Randomized Angle Control Parameter in response thereto. The state of the one-bit Transient Flag selects one of two multiple modes of randomized angle decorrelation, as is explained further below. The Angle Control Parameter, which may be interpolated across frequency if the Interpolation Flag and the Interpolator are employed, and the Randomized Angle Control Parameter are summed together by an additive combiner or combining function 40 in order to provide a control signal for Rotate Angle 28. Alternatively, the Controllable Decorrelator 38 may also generate a Randomized Amplitude Scale Factor in response to the Transient Flag and Decorrelation Scale Factor, in addition to generating a Randomized Angle Control Parameter. The Amplitude Scale Factor may be summed together with such a Randomized Amplitude Scale Factor by an additive combiner or combining function (not shown) in order to provide the control signal for the Adjust Amplitude 26.
Similarly, recovered sidechain information for the second channel, channel n, may also include an Amplitude Scale Factor, an Angle Control Parameter, a Decorrelation Scale Factor, a Transient Flag, and, optionally, an Interpolate Flag, as described above in connection with the description of a basic encoder. The Amplitude Scale Factor is applied to Adjust Amplitude 32. A frequency interpolator or interpolator function (“Interpolator”) 33 may be employed in order to interpolate the Angle Control Parameter across frequency. As with channel 1, the state of the one-bit Interpolation Flag selects whether or not interpolation across frequency is employed. The Transient Flag and Decorrelation Scale Factor are applied to a Controllable Decorrelator 42 that generates a Randomized Angle Control Parameter in response thereto. As with channel 1, the state of the one-bit Transient Flag selects one of two multiple modes of randomized angle decorrelation, as is explained further below. The Angle Control Parameter and the Randomized Angle Control Parameter are summed together by an additive combiner or combining function 44 in order to provide a control signal for Rotate Angle 34. Alternatively, as described above in connection with channel 1, the Controllable Decorrelator 42 may also generate a Randomized Amplitude Scale Factor in response to the Transient Flag and Decorrelation Scale Factor, in addition to generating a Randomized Angle Control Parameter. The Amplitude Scale Factor and Randomized Amplitude Scale Factor may be summed together by an additive combiner or combining function (not shown) in order to provide the control signal for the Adjust Amplitude 32.
Although a process or topology as just described is useful for understanding, essentially the same results may be obtained with alternative processes or topologies that achieve the same or similar results. For example, the order of Adjust Amplitude 26 (32) and Rotate Angle 28 (34) may be reversed and/or there may be more than one Rotate Angle—one that responds to the Angle Control Parameter and another that responds to the Randomized Angle Control Parameter. The Rotate Angle may also be considered to be three rather than one or two functions or devices, as in the example of FIG. 5 described below. If a Randomized Amplitude Scale Factor is employed, there may be more than one Adjust Amplitude—one that responds to the Amplitude Scale Factor and one that responds to the Randomized Amplitude Scale Factor. Because of the human ear's greater sensitivity to amplitude relative to phase, if a Randomized Amplitude Scale Factor is employed, it may be desirable to scale its effect relative to the effect of the Randomized Angle Control Parameter so that its effect on amplitude is less than the effect that the Randomized Angle Control Parameter has on phase angle. As another alternative process or topology, the Decorrelation Scale Factor may be used to control the ratio of randomized phase angle versus basic phase angle (rather than adding a parameter representing a randomized phase angle to a parameter representing the basic phase angle), and if also employed, the ratio of randomized amplitude shift versus basic amplitude shift (rather than adding a scale factor representing a randomized amplitude to a scale factor representing the basic amplitude) (i.e., a variable crossfade in each case).
If a reference channel is employed, as discussed above in connection with the basic encoder, the Rotate Angle, Controllable Decorrelator and Additive Combiner for that channel may be omitted inasmuch as the sidechain information for the reference channel may include only the Amplitude Scale Factor (or, alternatively, if the sidechain information does not contain an Amplitude Scale Factor for the reference channel, it may be deduced from Amplitude Scale Factors of the other channels when the energy normalization in the encoder assures that the scale factors across channels within a subband sum square to 1). An Amplitude Adjust is provided for the reference channel and it is controlled by a received or derived Amplitude Scale Factor for the reference channel. Whether the reference channel's Amplitude Scale Factor is derived from the sidechain or is deduced in the decoder, the recovered reference channel is an amplitude-scaled version of the mono composite channel. It does not require angle rotation because it is the reference for the other channels' rotations.
Although adjusting the relative amplitude of recovered channels may provide a modest degree of decorrelation, if used alone amplitude adjustment is likely to result in a reproduced soundfield substantially lacking in spatialization or imaging for many signal conditions (e.g., a “collapsed” soundfield). Amplitude adjustment may affect interaural level differences at the ear, which is only one of the psychoacoustic directional cues employed by the ear. Thus, according to aspects of the invention, certain angle-adjusting techniques may be employed, depending on signal conditions, to provide additional decorrelation. Reference may be made to Table 1 that provides abbreviated comments useful in understanding the multiple angle-adjusting decorrelation techniques or modes of operation that may be employed in accordance with aspects of the invention. Other decorrelation techniques as described below in connection with the examples of FIGS. 8 and 9 may be employed instead of or in addition to the techniques of Table 1.
In practice, applying angle rotations and magnitude alterations may result in circular convolution (also known as cyclic or periodic convolution). Although, generally, it is desirable to avoid circular convolution, undesirable audible artifacts resulting from circular convolution are somewhat reduced by complementary angle shifting in an encoder and decoder. In addition, the effects of circular convolution may be tolerated in low cost implementations of aspects of the present invention, particularly those in which the downmixing to mono or multiple channels occurs only in part of the audio frequency band, such as, for example above 1500 Hz (in which case the audible effects of circular convolution are minimal). Alternatively, circular convolution may be avoided or minimized by any suitable technique, including, for example, an appropriate use of zero padding. One way to use zero padding is to transform the proposed frequency domain variation (representing angle rotations and amplitude scaling) to the time domain, window it (with an arbitrary window), pad it with zeros, then transform back to the frequency domain and multiply by the frequency domain version of the audio to be processed (the audio need not be windowed).
TABLE 1
Angle-Adjusting Decorrelation Techniques
Technique 1 Technique 2 Technique 3
Type of Signal Spectrally Complex Complex impulsive
(typical static continuous signals (transients)
example) source signals Decorrelates
Effect on Decorrelates Decorrelates non- impulsive high
Decorrelation low impulsive frequency signal
frequency complex components
and signal
steady-state components
signal
components
Effect of Operates Does not operate Operates
transient with
present in shortened
frame time
constant
What is done Slowly Adds to the angle Adds to the angle of
shifts of Technique 1 Technique 1 a
(frame-by- a time-invariant rapidly-changing
frame) randomized angle (block by block)
bin angle on a bin-by-bin randomized angle
in a basis in a channel on a subband-by-
channel subband basis in a
channel
Controlled Basic phase Amount of Amount of
by or Scaled angle is randomized angle randomized angle is
by controlled by is scaled directly scaled indirectly by
Angle by Decorrelation Decorrelation SF;
Control SF; same scaling same scaling across
Parameter across subband, subband, scaling
scaling updated updated every frame
every frame
Frequency Subband Bin (different Subband (same
Resolution (same or randomized shift randomized shift
of angle interpolated value applied to value applied to all
shift shift each bin) bins in each
value applied subband; different
to all randomized shift
bins in each value applied to
subband) each subband in
channel)
Time Frame (shift Randomized shift Block (randomized
Resolution values values remain the shift values updated
updated every same and do not every block)
frame) change
For signals that are substantially static spectrally, such as, for example, a pitch pipe note, a first technique (“Technique 1”) restores the angle of the received mono composite signal relative to the angle of each of the other recovered channels to an angle similar (subject to frequency and time granularity and to quantization) to the original angle of the channel relative to the other channels at the input of the encoder. Phase angle differences are useful, particularly, for providing decorrelation of low-frequency signal components below about 1500 Hz where the ear follows individual cycles of the audio signal. Preferably, Technique 1 operates under all signal conditions to provide a basic angle shift.
For high-frequency signal components above about 1500 Hz, the ear does not follow individual cycles of sound but instead responds to waveform envelopes (on a critical band basis). Hence, above about 1500 Hz decorrelation is better provided by differences in signal envelopes rather than phase angle differences. Applying phase angle shifts only in accordance with Technique 1 does not alter the envelopes of signals sufficiently to decorrelate high frequency signals. The second and third techniques (“Technique 2” and “Technique 3”, respectively) add a controllable amount of randomized angle variations to the angle determined by Technique 1 under certain signal conditions, thereby causing a controllable amount of randomized envelope variations, which enhances decorrelation.
Randomized changes in phase angle are a desirable way to cause randomized changes in the envelopes of signals. A particular envelope results from the interaction of a particular combination of amplitudes and phases of spectral components within a subband. Although changing the amplitudes of spectral components within a subband changes the envelope, large amplitude changes are required to obtain a significant change in the envelope, which is undesirable because the human ear is sensitive to variations in spectral amplitude. In contrast, changing the spectral component's phase angles has a greater effect on the envelope than changing the spectral component's amplitudes—spectral components no longer line up the same way, so the reinforcements and subtractions that define the envelope occur at different times, thereby changing the envelope. Although the human ear has some envelope sensitivity, the ear is relatively phase deaf, so the overall sound quality remains substantially similar. Nevertheless, for some signal conditions, some randomization of the amplitudes of spectral components along with randomization of the phases of spectral components may provide an enhanced randomization of signal envelopes provided that such amplitude randomization does not cause undesirable audible artifacts.
Preferably, a controllable amount or degree of Technique 2 or Technique 3 operates along with Technique 1 under certain signal conditions. The Transient Flag selects Technique 2 (no transient present in the frame or block, depending on whether the Transient Flag is sent at the frame or block rate) or Technique 3 (transient present in the frame or block). Thus, there are multiple modes of operation, depending on whether or not a transient is present. Alternatively, in addition, under certain signal conditions, a controllable amount or degree of amplitude randomization also operates along with the amplitude scaling that seeks to restore the original channel amplitude.
Technique 2 is suitable for complex continuous signals that are rich in harmonics, such as massed orchestral violins. Technique 3 is suitable for complex impulsive or transient signals, such as applause, castanets, etc. (Technique 2 time smears claps in applause, making it unsuitable for such signals). As explained further below, in order to minimize audible artifacts, Technique 2 and Technique 3 have different time and frequency resolutions for applying randomized angle variations—Technique 2 is selected when a transient is not present, whereas Technique 3 is selected when a transient is present.
Technique 1 slowly shifts (frame by frame) the bin angle in a channel. The amount or degree of this basic shift is controlled by the Angle Control Parameter (no shift if the parameter is zero). As explained further below, either the same or an interpolated parameter is applied to all bins in each subband and the parameter is updated every frame. Consequently, each subband of each channel may have a phase shift with respect to other channels, providing a degree of decorrelation at low frequencies (below about 1500 Hz). However, Technique 1, by itself, is unsuitable for a transient signal such as applause. For such signal conditions, the reproduced channels may exhibit an annoying unstable comb-filter effect. In the case of applause, essentially no decorrelation is provided by adjusting only the relative amplitude of recovered channels because all channels tend to have the same amplitude over the period of a frame.
Technique 2 operates when a transient is not present. Technique 2 adds to the angle shift of Technique 1 a randomized angle shift that does not change with time, on a bin-by-bin basis (each bin has a different randomized shift) in a channel, causing the envelopes of the channels to be different from one another, thus providing decorrelation of complex signals among the channels. Maintaining the randomized phase angle values constant over time avoids block or frame artifacts that may result from block-to-block or frame-to-frame alteration of bin phase angles. While this technique is a very useful decorrelation tool when a transient is not present, it may temporally smear a transient (resulting in what is often referred to as “pre-noise”—the post-transient smearing is masked by the transient). The amount or degree of additional shift provided by Technique 2 is scaled directly by the Decorrelation Scale Factor (there is no additional shift if the scale factor is zero). Ideally, the amount of randomized phase angle added to the base angle shift (of Technique 1) according to Technique 2 is controlled by the Decorrelation Scale Factor in a manner that minimizes audible signal warbling artifacts. Such minimization of signal warbling artifacts results from the manner in which the Decorrelation Scale Factor is derived and the application of appropriate time smoothing, as described below. Although a different additional randomized angle shift value is applied to each bin and that shift value does not change, the same scaling is applied across a subband and the scaling is updated every frame.
Technique 3 operates in the presence of a transient in the frame or block, depending on the rate at which the Transient Flag is sent. It shifts all the bins in each subband in a channel from block to block with a unique randomized angle value, common to all bins in the subband, causing not only the envelopes, but also the amplitudes and phases, of the signals in a channel to change with respect to other channels from block to block. These changes in time and frequency resolution of the angle randomizing reduce steady-state signal similarities among the channels and provide decorrelation of the channels substantially without causing “pre-noise” artifacts. The change in frequency resolution of the angle randomizing, from very fine (all bins different in a channel) in Technique 2 to coarse (all bins within a subband the same, but each subband different) in Technique 3 is particularly useful in minimizing “pre-noise” artifacts. Although the ear does not respond to pure angle changes directly at high frequencies, when two or more channels mix acoustically on their way from loudspeakers to a listener, phase differences may cause amplitude changes (comb-filter effects) that may be audible and objectionable, and these are broken up by Technique 3. The impulsive characteristics of the signal minimize block-rate artifacts that might otherwise occur. Thus, Technique 3 adds to the phase shift of Technique 1 a rapidly changing (block-by-block) randomized angle shift on a subband-by-subband basis in a channel. The amount or degree of additional shift is scaled indirectly, as described below, by the Decorrelation Scale Factor (there is no additional shift if the scale factor is zero). The same scaling is applied across a subband and the scaling is updated every frame.
Although the angle-adjusting techniques have been characterized as three techniques, this is a matter of semantics and they may also be characterized as two techniques: (1) a combination of Technique 1 and a variable degree of Technique 2, which may be zero, and (2) a combination of Technique 1 and a variable degree Technique 3, which may be zero. For convenience in presentation, the techniques are treated as being three techniques.
Aspects of the multiple mode decorrelation techniques and modifications of them may be employed in providing decorrelation of audio signals derived, as by upmixing, from one or more audio channels even when such audio channels are not derived from an encoder according to aspects of the present invention. Such arrangements, when applied to a mono audio channel, are sometimes referred to as “pseudo-stereo” devices and functions. Any suitable device or function (an “upmixer”) may be employed to derive multiple signals from a mono audio channel or from multiple audio channels. Once such multiple audio channels are derived by an upmixer, one or more of them may be decorrelated with respect to one or more of the other derived audio signals by applying the multiple mode decorrelation techniques described herein. In such an application, each derived audio channel to which the decorrelation techniques are applied may be switched from one mode of operation to another by detecting transients in the derived audio channel itself. Alternatively, the operation of the transient-present technique (Technique 3) may be simplified to provide no shifting of the phase angles of spectral components when a transient is present.
Sidechain Information
As mentioned above, the sidechain information may include: an Amplitude Scale Factor, an Angle Control Parameter, a Decorrelation Scale Factor, a Transient Flag, and, optionally, an Interpolation Flag. Such sidechain information for a practical embodiment of aspects of the present invention may be summarized in the following Table 2. Typically, the sidechain information may be updated once per frame.
TABLE 2
Sidechain Information Characteristics for a Channel
Represents
Sidechain (is “a measure Quantization Primary
Information Value Range of”) Levels Purpose
Subband Angle
0 → + Smoothed time 6 bit (64 levels) Provides
Control average in each basic angle
Parameter subband of rotation for
difference each bin in
between angle of channel
each bin in
subband for a
channel and that
of the
corresponding bin
in subband of a
reference channel
Subband
0 → 1 Spectral- 3 bit (8 levels) Scales
Decorrelation The Subband steadiness of randomized
Scale Factor Decorrelation signal angle shifts
Scale Factor is characteristics added to
high only if over time in a basic angle
both the subband of a rotation, and,
Spectral- channel (the if employed,
Steadiness Spectral- also scales
Factor and the Steadiness randomized
Interchannel Factor) and the Amplitude
Angle consistency in the Scale Factor
Consistency same subband of added to
Factor are low. a channel of bin basic
angles with Amplitude
respect to Scale Factor,
corresponding and,
bins of a optionally,
reference channel scales degree
(the Interchannel of
Angle reverberation
Consistency
Factor)
Subband 0 to 31 (whole Energy or 5 bit (32 levels) Scales
Amplitude integer) amplitude in Granularity is amplitude of
Scale Factor 0 is highest subband of a 1.5 dB, so the bins in a
amplitude channel with range is subband in a
31 is lowest respect to energy 31 * 1.5 = channel
amplitude or amplitude for 46.5 dB plus
same subband final value = off.
across all
channels
Transient Flag 1, 0 Presence of a 1 bit (2 levels) Determines
(True/False) transient in the which
(polarity is frame or in the technique for
arbitrary) block adding
randomized
angle shifts,
or both angle
shifts and
amplitude
shifts, is
employed
Interpolation 1, 0 A spectral peak 1 bit (2 levels) Determines
Flag (True/False) near a subband if the basic
(polarity is boundary or angle
arbitrary) phase angles rotation is
within a channel interpolated
have a linear across
progression frequency
In each case, the sidechain information of a channel applies to a single subband (except for the Transient Flag and the Interpolation Flag, each of which apply to all subbands in a channel) and may be updated once per frame. Although the time resolution (once per frame), frequency resolution (subband), value ranges and quantization levels indicated have been found to provide useful performance and a useful compromise between a low bitrate and performance, it will be appreciated that these time and frequency resolutions, value ranges and quantization levels are not critical and that other resolutions, ranges and levels may employed in practicing aspects of the invention. For example, the Transient Flag and/or the Interpolation Flag, if employed, may be updated once per block with only a minimal increase in sidechain data overhead. In the case of the Transient Flag, doing so has the advantage that the switching from Technique 2 to Technique 3 and vice-versa is more accurate. In addition, as mentioned above, sidechain information may be updated upon the occurrence of a block switch of a related coder.
It will be noted that Technique 2, described above (see also Table 1), provides a bin frequency resolution rather than a subband frequency resolution (i.e., a different pseudo random phase angle shift is applied to each bin rather than to each subband) even though the same Subband Decorrelation Scale Factor applies to all bins in a subband. It will also be noted that Technique 3, described above (see also Table 1), provides a block frequency resolution (i.e., a different randomized phase angle shift is applied to each block rather than to each frame) even though the same Subband Decorrelation Scale Factor applies to all bins in a subband. Such resolutions, greater than the resolution of the sidechain information, are possible because the randomized phase angle shifts may be generated in a decoder and need not be known in the encoder (this is the case even if the encoder also applies a randomized phase angle shift to the encoded mono composite signal, an alternative that is described below). In other words, it is not necessary to send sidechain information having bin or block granularity even though the decorrelation techniques employ such granularity. The decoder may employ, for example, one or more lookup tables of randomized bin phase angles. The obtaining of time and/or frequency resolutions for decorrelation greater than the sidechain information rates is among the aspects of the present invention. Thus, decorrelation by way of randomized phases is performed either with a fine frequency resolution (bin-by-bin) that does not change with time (Technique 2), or with a coarse frequency resolution (band-by-band) ((or a fine frequency resolution (bin-by-bin) when frequency interpolation is employed, as described further below)) and a fine time resolution (block rate) (Technique 3).
It will also be appreciated that as increasing degrees of randomized phase shifts are added to the phase angle of a recovered channel, the absolute phase angle of the recovered channel differs more and more from the original absolute phase angle of that channel. An aspect of the present invention is the appreciation that the resulting absolute phase angle of the recovered channel need not match that of the original channel when signal conditions are such that the randomized phase shifts are added in accordance with aspects of the present invention. For example, in extreme cases when the Decorrelation Scale Factor causes the highest degree of randomized phase shift, the phase shift caused by Technique 2 or Technique 3 overwhelms the basic phase shift caused by Technique 1. Nevertheless, this is of no concern in that a randomized phase shift is audibly the same as the different random phases in the original signal that give rise to a Decorrelation Scale Factor that causes the addition of some degree of randomized phase shifts.
As mentioned above, randomized amplitude shifts may by employed in addition to randomized phase shifts. For example, the Adjust Amplitude may also be controlled by a Randomized Amplitude Scale Factor Parameter derived from the recovered sidechain Decorrelation Scale Factor for a particular channel and the recovered sidechain Transient Flag for the particular channel. Such randomized amplitude shifts may operate in two modes in a manner analogous to the application of randomized phase shifts. For example, in the absence of a transient, a randomized amplitude shift that does not change with time may be added on a bin-by-bin basis (different from bin to bin), and, in the presence of a transient (in the frame or block), a randomized amplitude shift that changes on a block-by-block basis (different from block to block) and changes from subband to subband (the same shift for all bins in a subband; different from subband to subband). Although the amount or degree to which randomized amplitude shifts are added may be controlled by the Decorrelation Scale Factor, it is believed that a particular scale factor value should cause less amplitude shift than the corresponding randomized phase shift resulting from the same scale factor value in order to avoid audible artifacts.
When the Transient Flag applies to a frame, the time resolution with which the Transient Flag selects Technique 2 or Technique 3 may be enhanced by providing a supplemental transient detector in the decoder in order to provide a temporal resolution finer than the frame rate or even the block rate. Such a supplemental transient detector may detect the occurrence of a transient in the mono or multichannel composite audio signal received by the decoder and such detection information is then sent to each Controllable Decorrelator (as 38, 42 of FIG. 2). Then, upon the receipt of a Transient Flag for its channel, the Controllable Decorrelator switches from Technique 2 to Technique 3 upon receipt of the decoder's local transient detection indication. Thus, a substantial improvement in temporal resolution is possible without increasing the sidechain bitrate, albeit with decreased spatial accuracy (the encoder detects transients in each input channel prior to their downmixing, whereas, detection in the decoder is done after downmixing).
As an alternative to sending sidechain information on a frame-by-frame basis, sidechain information may be updated every block, at least for highly dynamic signals. As mentioned above, updating the Transient Flag and/or the Interpolation Flag every block results in only a small increase in sidechain data overhead. In order to accomplish such an increase in temporal resolution for other sidechain information without substantially increasing the sidechain data rate, a block-floating-point differential coding arrangement may be used. For example, consecutive transform blocks may be collected in groups of six over a frame. The full sidechain information may be sent for each subband-channel in the first block. In the five subsequent blocks, only differential values may be sent, each the difference between the current-block amplitude and angle, and the equivalent values from the previous-block. This results in very low data rate for static signals, such as a pitch pipe note. For more dynamic signals, a greater range of difference values is required, but at less precision. So, for each group of five differential values, an exponent may be sent first, using, for example, 3 bits, then differential values are quantized to, for example, 2-bit accuracy. This arrangement reduces the average worst-case sidechain data rate by about a factor of two. Further reduction may be obtained by omitting the sidechain data for a reference channel (since it can be derived from the other channels), as discussed above, and by using, for example, arithmetic coding. Alternatively or in addition, differential coding across frequency may be employed by sending, for example, differences in subband angle or amplitude.
Whether sidechain information is sent on a frame-by-frame basis or more frequently, it may be useful to interpolate sidechain values across the blocks in a frame. Linear interpolation over time may be employed in the manner of the linear interpolation across frequency, as described below.
One suitable implementation of aspects of the present invention employs processing steps or devices that implement the respective processing steps and are functionally related as next set forth. Although the encoding and decoding steps listed below may each be carried out by computer software instruction sequences operating in the order of the below listed steps, it will be understood that equivalent or similar results may be obtained by steps ordered in other ways, taking into account that certain quantities are derived from earlier ones. For example, multi-threaded computer software instruction sequences may be employed so that certain sequences of steps are carried out in parallel. Alternatively, the described steps may be implemented as devices that perform the described functions, the various devices having functions and functional interrelationships as described hereinafter.
Encoding
The encoder or encoding function may collect a frame's worth of data before it derives sidechain information and downmixes the frame's audio channels to a single monophonic (mono) audio channel (in the manner of the example of FIG. 1, described above), or to multiple audio channels (in the manner of the example of FIG. 6, described below). By doing so, sidechain information may be sent first to a decoder, allowing the decoder to begin decoding immediately upon receipt of the mono or multiple channel audio information. Steps of an encoding process (“encoding steps”) may be described as follows. With respect to encoding steps, reference is made to FIG. 4, which is in the nature of a hybrid flowchart and functional block diagram. Through Step 419, FIG. 4 shows encoding steps for one channel. Steps 420 and 421 apply to all of the multiple channels that are combined to provide a composite mono signal output or are matrixed together to provide multiple channels, as described below in connection with the example of FIG. 6.
Step 401. Detect Transients
a. Perform transient detection of the PCM values in an input audio channel.
b. Set a one-bit Transient Flag True if a transient is present in any block of a frame for the channel.
Comments Regarding Step 401:
The Transient Flag forms a portion of the sidechain information and is also used in Step 411, as described below. Transient resolution finer than block rate in the decoder may improve decoder performance. Although, as discussed above, a block-rate rather than a frame-rate Transient Flag may form a portion of the sidechain information with a modest increase in bitrate, a similar result, albeit with decreased spatial accuracy, may be accomplished without increasing the sidechain bitrate by detecting the occurrence of transients in the mono composite signal received in the decoder.
There is one transient flag per channel per frame, which, because it is derived in the time domain, necessarily applies to all subbands within that channel. The transient detection may be performed in the manner similar to that employed in an AC-3 encoder for controlling the decision of when to switch between long and short length audio blocks, but with a higher sensitivity and with the Transient Flag True for any frame in which the Transient Flag for a block is True (an AC-3 encoder detects transients on a block basis). In particular, see Section 8.2.2 of the above-cited A/52A document. The sensitivity of the transient detection described in Section 8.2.2 may be increased by adding a sensitivity factor F to an equation set forth therein. Section 8.2.2 of the A/52A document is set forth below, with the sensitivity factor added (Section 8.2.2 as reproduced below is corrected to indicate that the low pass filter is a cascaded biquad direct form II IIR filter rather than “form I” as in the published A/52A document; Section 8.2.2 was correct in the earlier A/52 document). Although it is not critical, a sensitivity factor of 0.2 has been found to be a suitable value in a practical embodiment of aspects of the present invention.
Alternatively, a similar transient detection technique described in U.S. Pat. No. 5,394,473 may be employed. The '473 patent describes aspects of the A/52A document transient detector in greater detail. Both said A/52A document and said '473 patent are hereby incorporated by reference in their entirety.
As another alternative, transients may be detected in the frequency domain rather than in the time domain (see the Comments to Step 408). In that case, Step 401 may be omitted and an alternative step employed in the frequency domain as described below.
Step 402. Window and DFT.
Multiply overlapping blocks of PCM time samples by a time window and convert them to complex frequency values via a DFT as implemented by an FFT.
Step 403. Convert Complex Values to Magnitude and Angle.
Convert each frequency-domain complex transform bin value (a+jb) to a magnitude and angle representation using standard complex manipulations:
    • a. Magnitude=square_root (a2+b2)
    • b. Angle=arctan(b/a)
Comments Regarding Step 403:
Some of the following Steps use or may use, as an alternative, the energy of a bin, defined as the above magnitude squared (i.e., energy=(a2+b2).
Step 404. Calculate Subband Energy.
a. Calculate the subband energy per block by adding bin energy values within each subband (a summation across frequency).
b. Calculate the subband energy per frame by averaging or accumulating the energy in all the blocks in a frame (an averaging/accumulation across time).
c. If the coupling frequency of the encoder is below about 1000 Hz, apply the subband frame-averaged or frame-accumulated energy to a time smoother that operates on all subbands below that frequency and above the coupling frequency.
Comments Regarding Step 404 c:
Time smoothing to provide inter-frame smoothing in low frequency subbands may be useful. In order to avoid artifact-causing discontinuities between bin values at subband boundaries, it may be useful to apply a progressively-decreasing time smoothing from the lowest frequency subband encompassing and above the coupling frequency (where the smoothing may have a significant effect) up through a higher frequency subband in which the time smoothing effect is measurable, but inaudible, although nearly audible. A suitable time constant for the lowest frequency range subband (where the subband is a single bin if subbands are critical bands) may be in the range of 50 to 100 milliseconds, for example. Progressively-decreasing time smoothing may continue up through a subband encompassing about 1000 Hz where the time constant may be about 10 milliseconds, for example.
Although a first-order smoother is suitable, the smoother may be a two-stage smoother that has a variable time constant that shortens its attack and decay time in response to a transient (such a two-stage smoother may be a digital equivalent of the analog two-stage smoothers described in U.S. Pat. Nos. 3,846,719 and 4,922,535, each of which is hereby incorporated by reference in its entirety). In other words, the steady-state time constant may be scaled according to frequency and may also be variable in response to transients. Alternatively, such smoothing may be applied in Step 412.
Step 405. Calculate Sum of Bin Magnitudes.
a. Calculate the sum per block of the bin magnitudes (Step 403) of each subband (a summation across frequency).
b. Calculate the sum per frame of the bin magnitudes of each subband by averaging or accumulating the magnitudes of Step 405 a across the blocks in a frame (an averaging/accumulation across time). These sums are used to calculate an Interchannel Angle Consistency Factor in Step 410 below.
c. If the coupling frequency of the encoder is below about 1000 Hz, apply the subband frame-averaged or frame-accumulated magnitudes to a time smoother that operates on all subbands below that frequency and above the coupling frequency.
Comments regarding Step 405 c: See comments regarding step 404 c except that in the case of Step 405 c, the time smoothing may alternatively be performed as part of Step 410.
Step 406. Calculate Relative Interchannel Bin Phase Angle.
Calculate the relative interchannel phase angle of each transform bin of each block by subtracting from the bin angle of Step 403 the corresponding bin angle of a reference channel (for example, the first channel). The result, as with other angle additions or subtractions herein, is taken modulo (π, −π) radians by adding or subtracting 27 until the result is within the desired range of −π to +π.
Step 407. Calculate Interchannel Subband Phase Angle.
For each channel, calculate a frame-rate amplitude-weighted average interchannel phase angle for each subband as follows:
    • a. For each bin, construct a complex number from the magnitude of Step 403 and the relative interchannel bin phase angle of Step 406.
    • b. Add the constructed complex numbers of Step 407 a across each subband (a summation across frequency).
    • Comment regarding Step 407 b: For example, if a subband has two bins and one of the bins has a complex value of 1+j1 and the other bin has a complex value of 2+j2, their complex sum is 3+j3.
    • c. Average or accumulate the per block complex number sum for each subband of Step 407 b across the blocks of each frame (an averaging or accumulation across time).
    • d. If the coupling frequency of the encoder is below about 1000 Hz, apply the subband frame-averaged or frame-accumulated complex value to a time smoother that operates on all subbands below that frequency and above the coupling frequency.
    • Comments regarding Step 407 d: See comments regarding Step 404 c except that in the case of Step 407 d, the time smoothing may alternatively be performed as part of Steps 407 e or 410.
    • e. Compute the magnitude of the complex result of Step 407 d as per Step 403.
    • Comment regarding Step 407 e: This magnitude is used in Step 410 a below. In the simple example given in Step 407 b, the magnitude of 3+j3 is square_root (9+9)=4.24.
    • f. Compute the angle of the complex result as per Step 403.
    • Comments regarding Step 407 f: In the simple example given in Step 407 b, the angle of 3+j3 is arctan (3/3)=45 degrees=π/4 radians. This subband angle is signal-dependently time-smoothed (see Step 413) and quantized (see Step 414) to generate the Subband Angle Control Parameter sidechain information, as described below.
Step 408. Calculate Bin Spectral-Steadiness Factor
For each bin, calculate a Bin Spectral-Steadiness Factor in the range of 0 to 1 as follows:
    • a. Let xm=bin magnitude of present block calculated in Step 403.
    • b. Let ym=corresponding bin magnitude of previous block.
    • c. If xm>ym, then Bin Dynamic Amplitude Factor=(ym/xm)2;
    • d. Else if ym>xm, then Bin Dynamic Amplitude Factor=(xm/ym)2,
    • e. Else if ym=xm, then Bin Spectral-Steadiness Factor=1.
Comment Regarding Step 408:
“Spectral steadiness” is a measure of the extent to which spectral components (e.g., spectral coefficients or bin values) change over time. A Bin Spectral-Steadiness Factor of 1 indicates no change over a given time period.
Spectral Steadiness may also be taken as an indicator of whether a transient is present. A transient may cause a sudden rise and fall in spectral (bin) amplitude over a time period of one or more blocks, depending on its position with regard to blocks and their boundaries. Consequently, a change in the Bin Spectral-Steadiness Factor from a high value to a low value over a small number of blocks may be taken as an indication of the presence of a transient in the block or blocks having the lower value. A further confirmation of the presence of a transient, or an alternative to employing the Bin Spectral-Steadiness factor, is to observe the phase angles of bins within the block (for example, at the phase angle output of Step 403). Because a transient is likely to occupy a single temporal position within a block and have the dominant energy in the block, the existence and position of a transient may be indicated by a substantially uniform delay in phase from bin to bin in the block—namely, a substantially linear ramp of phase angles as a function of frequency. Yet a further confirmation or alternative is to observe the bin amplitudes over a small number of blocks (for example, at the magnitude output of Step 403), namely by looking directly for a sudden rise and fall of spectral level.
Alternatively, Step 408 may look at three consecutive blocks instead of one block. If the coupling frequency of the encoder is below about 1000 Hz, Step 408 may look at more than three consecutive blocks. The number of consecutive blocks may taken into consideration vary with frequency such that the number gradually increases as the subband frequency range decreases. If the Bin Spectral-Steadiness Factor is obtained from more than one block, the detection of a transient, as just described, may be determined by separate steps that respond only to the number of blocks useful for detecting transients.
As a further alternative, bin energies may be used instead of bin magnitudes.
As yet a further alternative, Step 408 may employ an “event decision” detecting technique as described below in the comments following Step 409.
Step 409. Compute Subband Spectral-Steadiness Factor.
Compute a frame-rate Subband Spectral-Steadiness Factor on a scale of 0 to 1 by forming an amplitude-weighted average of the Bin Spectral-Steadiness Factor within each subband across the blocks in a frame as follows:
    • a. For each bin, calculate the product of the Bin Spectral-Steadiness Factor of Step 408 and the bin magnitude of Step 403.
    • b. Sum the products within each subband (a summation across frequency).
    • c. Average or accumulate the summation of Step 409 b in all the blocks in a frame (an averaging/accumulation across time).
    • d. If the coupling frequency of the encoder is below about 1000 Hz, apply the subband frame-averaged or frame-accumulated summation to a time smoother that operates on all subbands below that frequency and above the coupling frequency.
    • Comments regarding Step 409 d: See comments regarding Step 404 c except that in the case of Step 409 d, there is no suitable subsequent step in which the time smoothing may alternatively be performed.
    • e. Divide the results of Step 409 c or Step 409 d, as appropriate, by the sum of the bin magnitudes (Step 403) within the subband.
    • Comment regarding Step 409 e: The multiplication by the magnitude in Step 409 a and the division by the sum of the magnitudes in Step 409 e provide amplitude weighting. The output of Step 408 is independent of absolute amplitude and, if not amplitude weighted, may cause the output or Step 409 to be controlled by very small amplitudes, which is undesirable.
    • f. Scale the result to obtain the Subband Spectral-Steadiness Factor by mapping the range from {0.5 . . . 1} to {0 . . . 1}. This may be done by multiplying the result by 2, subtracting 1, and limiting results less than 0 to a value of 0.
    • Comment regarding Step 409 f: Step 409 f may be useful in assuring that a channel of noise results in a Subband Spectral-Steadiness Factor of zero.
Comments Regarding Steps 408 and 409:
The goal of Steps 408 and 409 is to measure spectral steadiness changes in spectral composition over time in a subband of a channel. Alternatively, aspects of an “event decision” sensing such as described in International Publication Number WO 02/097792 A1 (designating the United States) may be employed to measure spectral steadiness instead of the approach just described in connection with Steps 408 and 409. U.S. patent application Ser. No. 10/478,538, filed Nov. 20, 2003 is the United States national application of the published PCT Application WO 02/097792 A1. Both the published PCT application and the U.S. application are hereby incorporated by reference in their entirety. According to these incorporated applications, the magnitudes of the complex FFT coefficient of each bin are calculated and normalized (largest magnitude is set to a value of one, for example). Then the magnitudes of corresponding bins (in dB) in consecutive blocks are subtracted (ignoring signs), the differences between bins are summed, and, if the sum exceeds a threshold, the block boundary is considered to be an auditory event boundary. Alternatively, changes in amplitude from block to block may also be considered along with spectral magnitude changes (by looking at the amount of normalization required).
If aspects of the incorporated event-sensing applications are employed to measure spectral steadiness, normalization may not be required and the changes in spectral magnitude (changes in amplitude would not be measured if normalization is omitted) preferably are considered on a subband basis. Instead of performing Step 408 as indicated above, the decibel differences in spectral magnitude between corresponding bins in each subband may be summed in accordance with the teachings of said applications. Then, each of those sums, representing the degree of spectral change from block to block may be scaled so that the result is a spectral steadiness factor having a range from 0 to 1, wherein a value of 1 indicates the highest steadiness, a change of 0 dB from block to block for a given bin. A value of 0, indicating the lowest steadiness, may be assigned to decibel changes equal to or greater than a suitable amount, such as 12 dB, for example. These results, a Bin Spectral-Steadiness Factor, may be used by Step 409 in the same manner that Step 409 uses the results of Step 408 as described above. When Step 409 receives a Bin Spectral-Steadiness Factor obtained by employing the just-described alternative event decision sensing technique, the Subband Spectral-Steadiness Factor of Step 409 may also be used as an indicator of a transient. For example, if the range of values produced by Step 409 is 0 to 1, a transient may be considered to be present when the Subband Spectral-Steadiness Factor is a small value, such as, for example, 0.1, indicating substantial spectral unsteadiness.
It will be appreciated that the Bin Spectral-Steadiness Factor produced by Step 408 and by the just-described alternative to Step 408 each inherently provide a variable threshold to a certain degree in that they are based on relative changes from block to block. Optionally, it may be useful to supplement such inherency by specifically providing a shift in the threshold in response to, for example, multiple transients in a frame or a large transient among smaller transients (e.g., a loud transient coming atop mid- to low-level applause). In the case of the latter example, an event detector may initially identify each clap as an event, but a loud transient (e.g., a drum hit) may make it desirable to shift the threshold so that only the drum hit is identified as an event.
Alternatively, a randomness metric may be employed (for example, as described in U.S. Pat. No. Re 36,714, which is hereby incorporated by reference in its entirety) instead of a measure of spectral-steadiness over time.
Step 410. Calculate Interchannel Angle Consistency Factor.
For each subband having more than one bin, calculate a frame-rate Interchannel Angle Consistency Factor as follows:
    • a. Divide the magnitude of the complex sum of Step 407 e by the sum of the magnitudes of Step 405. The resulting “raw” Angle Consistency Factor is a number in the range of 0 to 1.
    • b. Calculate a correction factor: let n=the number of values across the subband contributing to the two quantities in the above step (in other words, “n” is the number of bins in the subband). If n is less than 2, let the Angle Consistency Factor be 1 and go to Steps 411 and 413.
    • c. Let r=Expected Random Variation=1/n. Subtract r from the result of the Step 410 b.
    • d. Normalize the result of Step 410 c by dividing by (1-r). The result has a maximum value of 1. Limit the minimum value to 0 as necessary.
Comments Regarding Step 410:
Interchannel Angle Consistency is a measure of how similar the interchannel phase angles are within a subband over a frame period. If all bin interchannel angles of the subband are the same, the Interchannel Angle Consistency Factor is 1.0; whereas, if the interchannel angles are randomly scattered, the value approaches zero.
The Subband Angle Consistency Factor indicates if there is a phantom image between the channels. If the consistency is low, then it is desirable to decorrelate the channels. A high value indicates a fused image. Image fusion is independent of other signal characteristics.
It will be noted that the Subband Angle Consistency Factor, although an angle parameter, is determined indirectly from two magnitudes. If the interchannel angles are all the same, adding the complex values and then taking the magnitude yields the same result as taking all the magnitudes and adding them, so the quotient is 1. If the interchannel angles are scattered, adding the complex values (such as adding vectors having different angles) results in at least partial cancellation, so the magnitude of the sum is less than the sum of the magnitudes, and the quotient is less than 1.
Following is a simple example of a subband having two bins:
Suppose that the two complex bin values are (3+j4) and (6+j8). (Same angle each case: angle=arctan (imag/real), so angle1=arctan (4/3) and angle2=arctan (8/6)=arctan (4/3)). Adding complex values, sum=(9+j12), magnitude of which is square_root (81+144)=15.
The sum of the magnitudes is magnitude of (3+j4)+magnitude of (6+j8)=5+10=15. The quotient is therefore 15/15=1=consistency (before 1/n normalization, would also be 1 after normalization) (Normalized consistency=(1−0.5)/(1−0.5)=1.0).
If one of the above bins has a different angle, say that the second one has complex value (6−j8), which has the same magnitude, 10. The complex sum is now (9−j4), which has magnitude of square_root (81+16)=9.85, so the quotient is 9.85/15=0.66=consistency (before normalization). To normalize, subtract 1/n=½, and divide by (1−1/n) (normalized consistency=(0.66−0.5)/(1−0.5)=0.32.)
Although the above-described technique for determining a Subband Angle Consistency Factor has been found useful, its use is not critical. Other suitable techniques may be employed. For example, one could calculate a standard deviation of angles using standard formulae. In any case, it is desirable to employ amplitude weighting to minimize the effect of small signals on the calculated consistency value.
In addition, an alternative derivation of the Subband Angle Consistency Factor may use energy (the squares of the magnitudes) instead of magnitude. This may be accomplished by squaring the magnitude from Step 403 before it is applied to Steps 405 and 407.
Step 411. Derive Subband Decorrelation Scale Factor.
Derive a frame-rate Decorrelation Scale Factor for each subband as follows:
    • a. Let x=frame-rate Spectral-Steadiness Factor of Step 409 f.
    • b. Let y=frame-rate Angle Consistency Factor of Step 410 e.
    • c. Then the frame-rate Subband Decorrelation Scale Factor=(1−x)*(1−y),
a number between 0 and 1.
Comments regarding Step 411:
The Subband Decorrelation Scale Factor is a function of the spectral-steadiness of signal characteristics over time in a subband of a channel (the Spectral-Steadiness Factor) and the consistency in the same subband of a channel of bin angles with respect to corresponding bins of a reference channel (the Interchannel Angle Consistency Factor). The Subband Decorrelation Scale Factor is high only if both the Spectral-Steadiness Factor and the Interchannel Angle Consistency Factor are low.
As explained above, the Decorrelation Scale Factor controls the degree of envelope decorrelation provided in the decoder. Signals that exhibit spectral steadiness over time preferably should not be decorrelated by altering their envelopes, regardless of what is happening in other channels, as it may result in audible artifacts, namely wavering or warbling of the signal.
Step 412. Derive Subband Amplitude Scale Factors.
From the subband frame energy values of Step 404 and from the subband frame energy values of all other channels (as may be obtained by a step corresponding to Step 404 or an equivalent thereof), derive frame-rate Subband Amplitude Scale Factors as follows:
    • a. For each subband, sum the energy values per frame across all input channels.
    • b. Divide each subband energy value per frame, (from Step 404) by the sum of the energy values across all input channels (from Step 412 a) to create values in the range of 0 to 1.
    • c. Convert each ratio to dB, in the range of −∞ to 0.
    • d. Divide by the scale factor granularity, which may be set at 1.5 dB, for example, change sign to yield a non-negative value, limit to a maximum value which may be, for example, 31 (i.e. 5-bit precision) and round to the nearest integer to create the quantized value. These values are the frame-rate Subband Amplitude Scale Factors and are conveyed as part of the sidechain information.
    • e. If the coupling frequency of the encoder is below about 1000 Hz, apply the subband frame-averaged or frame-accumulated magnitudes to a time smoother that operates on all subbands below that frequency and above the coupling frequency.
Comments regarding Step 412 e: See comments regarding step 404 c except that in the case of Step 412 e, there is no suitable subsequent step in which the time smoothing may alternatively be performed.
Comments for Step 412:
Although the granularity (resolution) and quantization precision indicated here have been found to be useful, they are not critical and other values may provide acceptable results.
Alternatively, one may use amplitude instead of energy to generate the Subband Amplitude Scale Factors. If using amplitude, one would use dB=20*log(amplitude ratio), else if using energy, one converts to dB via dB=10*log(energy ratio), where amplitude ratio=square root (energy ratio).
Step 413. Signal-Dependently Time Smooth Interchannel Subband Phase Angles.
Apply signal-dependent temporal smoothing to subband frame-rate interchannel angles derived in Step 407 f:
    • a. Let v=Subband Spectral-Steadiness Factor of Step 409 d.
    • b. Let w=corresponding Angle Consistency Factor of Step 410 e.
    • c. Let x=(1−v)*w. This is a value between 0 and 1, which is high if the Spectral-Steadiness Factor is low and the Angle Consistency Factor is high.
    • d. Let y=1−x. y is high if Spectral-Steadiness Factor is high and Angle Consistency Factor is low.
    • e. Let z=yexp, where exp is a constant, which may be=0.1. z is also in the range of 0 to 1, but skewed toward 1, corresponding to a slow time constant.
    • f. If the Transient Flag (Step 401) for the channel is set, set z=0, corresponding to a fast time constant in the presence of a transient.
    • g. Compute lim, a maximum allowable value of z, lim=1−(0.1*w). This ranges from 0.9 if the Angle Consistency Factor is high to 1.0 if the Angle Consistency Factor is low (0).
    • h. Limit z by lim as necessary: if (z>lim) then z=lim.
    • i. Smooth the subband angle of Step 407 f using the value of z and a running smoothed value of angle maintained for each subband. If A=angle of Step 407 f and RSA=running smoothed angle value as of the previous block, and NewRSA is the new value of the running smoothed angle, then: NewRSA=RSA*z+A*(1−z). The value of RSA is subsequently set equal to NewRSA before processing the following block. New RSA is the signal-dependently time-smoothed angle output of Step 413.
Comments Regarding Step 413:
When a transient is detected, the subband angle update time constant is set to 0, allowing a rapid subband angle change. This is desirable because it allows the normal angle update mechanism to use a range of relatively slow time constants, minimizing image wandering during static or quasi-static signals, yet fast-changing signals are treated with fast time constants.
Although other smoothing techniques and parameters may be usable, a first-order smoother implementing Step 413 has been found to be suitable. If implemented as a first-order smoother/lowpass filter, the variable “z” corresponds to the feed-forward coefficient (sometimes denoted “ff0”), while “(1-z)” corresponds to the feedback coefficient (sometimes denoted “fb1”).
Step 414. Quantize Smoothed Interchannel Subband Phase Angles.
Quantize the time-smoothed subband interchannel angles derived in Step 413 i to obtain the Subband Angle Control Parameter:
    • a. If the value is less than 0, add 2π, so that all angle values to be quantized are in the range 0 to 2π.
    • b. Divide by the angle granularity (resolution), which may be 2π/64 radians, and round to an integer. The maximum value may be set at 63, corresponding to 6-bit quantization.
Comments Regarding Step 414:
The quantized value is treated as a non-negative integer, so an easy way to quantize the angle is to map it to a non-negative floating point number ((add 2π if less than 0, making the range 0 to (less than) 2π)), scale by the granularity (resolution), and round to an integer. Similarly, dequantizing that integer (which could otherwise be done with a simple table lookup), can be accomplished by scaling by the inverse of the angle granularity factor, converting a non-negative integer to a non-negative floating point angle (again, range 0 to 2π), after which it can be renormalized to the range ±π for further use. Although such quantization of the Subband Angle Control Parameter has been found to be useful, such a quantization is not critical and other quantizations may provide acceptable results.
Step 415. Quantize Subband Decorrelation Scale Factors.
Quantize the Subband Decorrelation Scale Factors produced by Step 411 to, for example, 8 levels (3 bits) by multiplying by 7.49 and rounding to the nearest integer. These quantized values are part of the sidechain information.
Comments Regarding Step 415:
Although such quantization of the Subband Decorrelation Scale Factors has been found to be useful, quantization using the example values is not critical and other quantizations may provide acceptable results.
Step 416. Dequantize Subband Angle Control Parameters.
Dequantize the Subband Angle Control Parameters (see Step 414), to use prior to downmixing.
Comment Regarding Step 416:
Use of quantized values in the encoder helps maintain synchrony between the encoder and the decoder.
Step 417. Distribute Frame-Rate Dequantized Subband Angle Control Parameters Across Blocks.
In preparation for downmixing, distribute the once-per-frame dequantized Subband Angle Control Parameters of Step 416 across time to the subbands of each block within the frame.
Comment Regarding Step 417:
The same frame value may be assigned to each block in the frame. Alternatively, it may be useful to interpolate the Subband Angle Control Parameter values across the blocks in a frame. Linear interpolation over time may be employed in the manner of the linear interpolation across frequency, as described below.
Step 418. Interpolate block Subband Angle Control Parameters to Bins
Distribute the block Subband Angle Control Parameters of Step 417 for each channel across frequency to bins, preferably using linear interpolation as described below.
Comment Regarding Step 418:
If linear interpolation across frequency is employed, Step 418 minimizes phase angle changes from bin to bin across a subband boundary, thereby minimizing aliasing artifacts. Such linear interpolation may be enabled, for example, as described below following the description of Step 422. Subband angles are calculated independently of one another, each representing an average across a subband. Thus, there may be a large change from one subband to the next. If the net angle value for a subband is applied to all bins in the subband (a “rectangular” subband distribution), the entire phase change from one subband to a neighboring subband occurs between two bins. If there is a strong signal component there, there may be severe, possibly audible, aliasing. Linear interpolation, between the centers of each subband, for example, spreads the phase angle change over all the bins in the subband, minimizing the change between any pair of bins, so that, for example, the angle at the low end of a subband mates with the angle at the high end of the subband below it, while maintaining the overall average the same as the given calculated subband angle. In other words, instead of rectangular subband distributions, the subband angle distribution may be trapezoidally shaped.
For example, suppose that the lowest coupled subband has one bin and a subband angle of 20 degrees, the next subband has three bins and a subband angle of 40 degrees, and the third subband has five bins and a subband angle of 100 degrees. With no interpolation, assume that the first bin (one subband) is shifted by an angle of 20 degrees, the next three bins (another subband) are shifted by an angle of 40 degrees and the next five bins (a farther subband) are shifted by an angle of 100 degrees. In that example, there is a 60-degree maximum change, from bin 4 to bin 5. With linear interpolation, the first bin still is shifted by an angle of 20 degrees, the next 3 bins are shifted by about 30, 40, and 50 degrees; and the next five bins are shifted by about 67, 83, 100, 117, and 133 degrees. The average subband angle shift is the same, but the maximum bin-to-bin change is reduced to 17 degrees.
Optionally, changes in amplitude from subband to subband, in connection with this and other steps described herein, such as Step 417 may also be treated in a similar interpolative fashion. However, it may not be necessary to do so because there tends to be more natural continuity in amplitude from one subband to the next.
Step 419. Apply Phase Angle Rotation to Bin Transform Values for Channel.
Apply phase angle rotation to each bin transform value as follows:
    • a. Let x=bin angle for this bin as calculated in Step 418.
    • b. Let y=−x;
    • c. Compute z, a unity-magnitude complex phase rotation scale factor with angle y, z=cos(y)+j sin(y).
    • d. Multiply the bin value (a+jb) by z.
Comments Regarding Step 419:
The phase angle rotation applied in the encoder is the inverse of the angle derived from the Subband Angle Control Parameter.
Phase angle adjustments, as described herein, in an encoder or encoding process prior to downmixing (Step 420) have several advantages: (1) they minimize cancellations of the channels that are summed to a mono composite signal or matrixed to multiple channels, (2) they minimize reliance on energy normalization (Step 421), and (3) they precompensate the decoder inverse phase angle rotation, thereby reducing aliasing.
The phase correction factors can be applied in the encoder by subtracting each subband phase correction value from the angles of each transform bin value in that subband. This is equivalent to multiplying each complex bin value by a complex number with a magnitude of 1.0 and an angle equal to the negative of the phase correction factor. Note that a complex number of magnitude 1, angle A is equal to cos(A)+j sin(A). This latter quantity is calculated once for each subband of each channel, with A=−phase correction for this subband, then multiplied by each bin complex signal value to realize the phase shifted bin value.
The phase shift is circular, resulting in circular convolution (as mentioned above). While circular convolution may be benign for some continuous signals, it may create spurious spectral components for certain continuous complex signals (such as a pitch pipe) or may cause blurring of transients if different phase angles are used for different subbands. Consequently, a suitable technique to avoid circular convolution may be employed or the Transient Flag may be employed such that, for example, when the Transient Flag is True, the angle calculation results may be overridden, and all subbands in a channel may use the same phase correction factor such as zero or a randomized value.
Step 420. Downmix.
Downmix to mono by adding the corresponding complex transform bins across channels to produce a mono composite channel or downmix to multiple channels by matrixing the input channels, as for example, in the manner of the example of FIG. 6, as described below.
Comments Regarding Step 420:
In the encoder, once the transform bins of all the channels have been phase shifted, the channels are summed, bin-by-bin, to create the mono composite audio signal. Alternatively, the channels may be applied to a passive or active matrix that provides either a simple summation to one channel, as in the N:1 encoding of FIG. 1, or to multiple channels. The matrix coefficients may be real or complex (real and imaginary).
Step 421. Normalize.
To avoid cancellation of isolated bins and over-emphasis of in-phase signals, normalize the amplitude of each bin of the mono composite channel to have substantially the same energy as the sum of the contributing energies, as follows:
    • a. Let x=the sum across channels of bin energies (i.e., the squares of the bin magnitudes computed in Step 403).
    • b. Let y=energy of corresponding bin of the mono composite channel, calculated as per Step 403.
    • c. Let z=scale factor=square_root (x/y). If x=0 then y is 0 and z is set to 1.
    • d. Limit z to a maximum value of, for example, 100. If z is initially greater than 100 (implying strong cancellation from downmixing), add an arbitrary value, for example, 0.01*square_root (x) to the real and imaginary parts of the mono composite bin, which will assure that it is large enough to be normalized by the following step.
    • e. Multiply the complex mono composite bin value by z.
Comments Regarding Step 421:
Although it is generally desirable to use the same phase factors for both encoding and decoding, even the optimal choice of a subband phase correction value may cause one or more audible spectral components within the subband to be cancelled during the encode downmix process because the phase shifting of step 419 is performed on a subband rather than a bin basis. In this case, a different phase factor for isolated bins in the encoder may be used if it is detected that the sum energy of such bins is much less than the energy sum of the individual channel bins at that frequency. It is generally not necessary to apply such an isolated correction factor to the decoder, inasmuch as isolated bins usually have little effect on overall image quality. A similar normalization may be applied if multiple channels rather than a mono channel are employed.
Step 422. Assemble and Pack into Bitstream(s).
The Amplitude Scale Factors, Angle Control Parameters, Decorrelation Scale Factors, and Transient Flags side channel information for each channel, along with the common mono composite audio or the matrixed multiple channels are multiplexed as may be desired and packed into one or more bitstreams suitable for the storage, transmission or storage and transmission medium or media.
Comment Regarding Step 422:
The mono composite audio or the multiple channel audio may be applied to a data-rate reducing encoding process or device such as, for example, a perceptual encoder or to a perceptual encoder and an entropy coder (e.g., arithmetic or Huffman coder) (sometimes referred to as a “lossless” coder) prior to packing. Also, as mentioned above, the mono composite audio (or the multiple channel audio) and related sidechain information may be derived from multiple input channels only for audio frequencies above a certain frequency (a “coupling” frequency). In that case, the audio frequencies below the coupling frequency in each of the multiple input channels may be stored, transmitted or stored and transmitted as discrete channels or may be combined or processed in some manner other than as described herein. Discrete or otherwise-combined channels may also be applied to a data reducing encoding process or device such as, for example, a perceptual encoder or a perceptual encoder and an entropy encoder. The mono composite audio (or the multiple channel audio) and the discrete multichannel audio may all be applied to an integrated perceptual encoding or perceptual and entropy encoding process or device prior to packing.
Optional Interpolation Flag (not Shown in FIG. 4)
Interpolation across frequency of the basic phase angle shifts provided by the Subband Angle Control Parameters may be enabled in the Encoder (Step 418) and/or in the Decoder (Step 505, below). The optional Interpolation Flag sidechain parameter may be employed for enabling interpolation in the Decoder. Either the Interpolation Flag or an enabling flag similar to the Interpolation Flag may be used in the Encoder. Note that because the Encoder has access to data at the bin level, it may use different interpolation values than the Decoder, which interpolates the Subband Angle Control Parameters in the sidechain information.
The use of such interpolation across frequency in the Encoder or the Decoder may be enabled if, for example, either of the following two conditions are true:
    • Condition 1. If a strong, isolated spectral peak is located at or near the boundary of two subbands that have substantially different phase rotation angle assignments.
    • Reason: without interpolation, a large phase change at the boundary may introduce a warble in the isolated spectral component. By using interpolation to spread the band-to-band phase change across the bin values within the band, the amount of change at the subband boundaries is reduced. Thresholds for spectral peak strength, closeness to a boundary and difference in phase rotation from subband to subband to satisfy this condition may be adjusted empirically.
    • Condition 2. If, depending on the presence of a transient, either the interchannel phase angles (no transient) or the absolute phase angles within a channel (transient), comprise a good fit to a linear progression.
    • Reason: Using interpolation to reconstruct the data tends to provide a better fit to the original data. Note that the slope of the linear progression need not be constant across all frequencies, only within each subband, since angle data will still be conveyed to the decoder on a subband basis; and that forms the input to the Interpolator Step 418. The degree to which the data provides a good fit to satisfy this condition may also be determined empirically.
Other conditions, such as those determined empirically, may benefit from interpolation across frequency. The existence of the two conditions just mentioned may be determined as follows:
    • Condition 1. If a strong, isolated spectral peak is located at or near the boundary of two subbands that have substantially different phase rotation angle assignments:
    • for the Interpolation Flag to be used by the Decoder, the Subband Angle Control Parameters (output of Step 414), and for enabling of Step 418 within the Encoder, the output of Step 413 before quantization may be used to determine the rotation angle from subband to subband.
    • for both the Interpolation Flag and for enabling within the Encoder, the magnitude output of Step 403, the current DFT magnitudes, may be used to find isolated peaks at subband boundaries.
    • Condition 2. If, depending on the presence of a transient, either the interchannel phase angles (no transient) or the absolute phase angles within a channel (transient), comprise a good fit to a linear progression:
    • if the Transient Flag is not true (no transient), use the relative interchannel bin phase angles from Step 406 for the fit to a linear progression determination, and
    • if the Transient Flag is true (transient), us the channel's absolute phase angles from Step 403.
Decoding
The steps of a decoding process (“decoding steps”) may be described as follows. With respect to decoding steps, reference is made to FIG. 5, which is in the nature of a hybrid flowchart and functional block diagram. For simplicity, the figure shows the derivation of sidechain information components for one channel, it being understood that sidechain information components must be obtained for each channel unless the channel is a reference channel for such components, as explained elsewhere.
Step 501. Unpack and Decode Sidechain Information.
Unpack and decode (including dequantization), as necessary, the sidechain data components (Amplitude Scale Factors, Angle Control Parameters, Decorrelation Scale Factors, and Transient Flag) for each frame of each channel (one channel shown in FIG. 5). Table lookups may be used to decode the Amplitude Scale Factors, Angle Control Parameter, and Decorrelation Scale Factors.
Comment regarding Step 501: As explained above, if a reference channel is employed, the sidechain data for the reference channel may not include the Angle Control Parameters, Decorrelation Scale Factors, and Transient Flag.
Step 502. Unpack and Decode Mono Composite or Multichannel Audio Signal.
Unpack and decode, as necessary, the mono composite or multichannel audio signal information to provide DFT coefficients for each transform bin of the mono composite or multichannel audio signal.
Comment Regarding Step 502:
Step 501 and Step 502 may be considered to be part of a single unpacking and decoding step. Step 502 may include a passive or active matrix.
Step 503. Distribute Angle Parameter Values Across Blocks.
Block Subband Angle Control Parameter values are derived from the dequantized frame Subband Angle Control Parameter values.
Comment Regarding Step 503:
Step 503 may be implemented by distributing the same parameter value to every block in the frame.
Step 504. Distribute Subband Decorrelation Scale Factor Across Blocks.
Block Subband Decorrelation Scale Factor values are derived from the dequantized frame Subband Decorrelation Scale Factor values.
Comment Regarding Step 504;
Step 504 may be implemented by distributing the same scale factor value to every block in the frame.
Step 505. Linearly Interpolate Across Frequency.
Optionally, derive bin angles from the block subband angles of decoder Step 503 by linear interpolation across frequency as described above in connection with encoder Step 418. Linear interpolation in Step 505 may be enabled when the Interpolation Flag is used and is true.
Step 506. Add Randomized Phase Angle Offset (Technique 3).
In accordance with Technique 3, described above, when the Transient Flag indicates a transient, add to the block Subband Angle Control Parameter provided by Step 503, which may have been linearly interpolated across frequency by Step 505, a randomized offset value scaled by the Decorrelation Scale Factor (the scaling may be indirect as set forth in this Step):
    • a. Let y=block Subband Decorrelation Scale Factor.
    • b. Let z=yexp, where exp is a constant, for example=5. z will also be in the range of 0 to 1, but skewed toward 0, reflecting a bias toward low levels of randomized variation unless the Decorrelation Scale Factor value is high.
    • c. Let x=a randomized number between +1.0 and 1.0, chosen separately for each subband of each block.
    • d. Then, the value added to the block Subband Angle Control Parameter to add a randomized angle offset value according to Technique 3 is x*pi*z.
Comments Regarding Step 506:
As will be appreciated by those of ordinary skill in the art, “randomized” angles (or “randomized amplitudes if amplitudes are also scaled) for scaling by the Decorrelation Scale Factor may include not only pseudo-random and truly random variations, but also deterministically-generated variations that, when applied to phase angles or to phase angles and to amplitudes, have the effect of reducing cross-correlation between channels. Such “randomized” variations may be obtained in many ways. For example, a pseudo-random number generator with various seed values may be employed. Alternatively, truly random numbers may be generated using a hardware random number generator. Inasmuch as a randomized angle resolution of only about 1 degree may be sufficient, tables of randomized numbers having two or three decimal places (e.g. 0.84 or 0.844) may be employed. Preferably, the randomized values (between −1.0 and +1.0 with reference to Step 505 c, above) are uniformly distributed statistically across each channel.
Although the non-linear indirect scaling of Step 506 has been found to be useful, it is not critical and other suitable scalings may be employed—in particular other values for the exponent may be employed to obtain similar results.
When the Subband Decorrelation Scale Factor value is 1, a full range of random angles from −π to +π are added (in which case the block Subband Angle Control Parameter values produced by Step 503 are rendered irrelevant). As the Subband Decorrelation Scale Factor value decreases toward zero, the randomized angle offset also decreases toward zero, causing the output of Step 506 to move toward the Subband Angle Control Parameter values produced by Step 503.
If desired, the encoder described above may also add a scaled randomized offset in accordance with Technique 3 to the angle shift applied to a channel before downmixing. Doing so may improve alias cancellation in the decoder. It may also be beneficial for improving the synchronicity of the encoder and decoder.
Step 507. Add Randomized Phase Angle Offset (Technique 2).
In accordance with Technique 2, described above, when the Transient Flag does not indicate a transient, for each bin, add to all the block Subband Angle Control Parameters in a frame provided by Step 503 (Step 505 operates only when the Transient Flag indicates a transient) a different randomized offset value scaled by the Decorrelation Scale Factor (the scaling may be direct as set forth herein in this step):
    • a. Let y=block Subband Decorrelation Scale Factor.
    • b. Let x=a randomized number between +1.0 and −1.0, chosen separately for each bin of each frame.
    • c. Then, the value added to the block bin Angle Control Parameter to add a randomized angle offset value according to Technique 3 is x*pi*y.
Comments Regarding Step 507:
See comments above regarding Step 505 regarding the randomized angle offset.
Although the direct scaling of Step 507 has been found to be useful, it is not critical and other suitable scalings may be employed.
To minimize temporal discontinuities, the unique randomized angle value for each bin of each channel preferably does not change with time. The randomized angle values of all the bins in a subband are scaled by the same Subband Decorrelation Scale Factor value, which is updated at the frame rate. Thus, when the Subband Decorrelation Scale Factor value is 1, a full range of random angles from −π to +π are added (in which case block subband angle values derived from the dequantized frame subband angle values are rendered irrelevant). As the Subband Decorrelation Scale Factor value diminishes toward zero, the randomized angle offset also diminishes toward zero. Unlike Step 504, the scaling in this Step 507 may be a direct function of the Subband Decorrelation Scale Factor value. For example, a Subband Decorrelation Scale Factor value of 0.5 proportionally reduces every random angle variation by 0.5.
The scaled randomized angle value may then be added to the bin angle from decoder Step 506. The Decorrelation Scale Factor value is updated once per frame. In the presence of a Transient Flag for the frame, this step is skipped, to avoid transient prenoise artifacts.
If desired, the encoder described above may also add a scaled randomized offset in accordance with Technique 2 to the angle shift applied before downmixing. Doing so may improve alias cancellation in the decoder. It may also be beneficial for improving the synchronicity of the encoder and decoder.
Step 508. Normalize Amplitude Scale Factors.
Normalize Amplitude Scale Factors across channels so that they sum-square to 1.
Comment Regarding Step 508:
For example, if two channels have dequantized scale factors of −3.0 dB (=2*granularity of 1.5 dB) (0.70795), the sum of the squares is 1.002. Dividing each by the square root of 1.002=1.001 yields two values of 0.7072 (−3.01 dB).
Step 509. Boost Subband Scale Factor Levels (Optional).
Optionally, when the Transient Flag indicates no transient, apply a slight additional boost to Subband Scale Factor levels, dependent on Subband Decorrelation Scale Factor levels: multiply each normalized Subband Amplitude Scale Factor by a small factor (e.g., 1+0.2*Subband Decorrelation Scale Factor). When the Transient Flag is True, skip this step.
Comment Regarding Step 509:
This step may be useful because the decoder decorrelation Step 507 may result in slightly reduced levels in the final inverse filterbank process.
Step 510. Distribute Subband Amplitude Values Across Bins.
Step 510 may be implemented by distributing the same subband amplitude scale factor value to every bin in the subband.
Step 510 a. Add Randomized Amplitude Offset (Optional)
Optionally, apply a randomized variation to the normalized Subband Amplitude Scale Factor dependent on Subband Decorrelation Scale Factor levels and the Transient Flag. In the absence of a transient, add a Randomized Amplitude Scale Factor that does not change with time on a bin-by-bin basis (different from bin to bin), and, in the presence of a transient (in the frame or block), add a Randomized Amplitude Scale Factor that changes on a block-by-block basis (different from block to block) and changes from subband to subband (the same shift for all bins in a subband; different from subband to subband). Step 510 a is not shown in the drawings.
Comment Regarding Step 510 a:
Although the degree to which randomized amplitude shifts are added may be controlled by the Decorrelation Scale Factor, it is believed that a particular scale factor value should cause less amplitude shift than the corresponding randomized phase shift resulting from the same scale factor value in order to avoid audible artifacts.
Step 511. Upmix.
    • a. For each bin of each output channel, construct a complex upmix scale factor from the amplitude of decoder Step 508 and the bin angle of decoder Step 507: (amplitude*(cos(angle)+j sin(angle)).
    • b. For each output channel, multiply the complex bin value and the complex upmix scale factor to produce the upmixed complex output bin value of each bin of the channel.
Step 512. Perform Inverse DFT (Optional).
Optionally, perform an inverse DFT transform on the bins of each output channel to yield multichannel output PCM values. As is well known, in connection with such an inverse DFT transformation, the individual blocks of time samples are windowed, and adjacent blocks are overlapped and added together in order to reconstruct the final continuous time output PCM audio signal.
Comments Regarding Step 512:
A decoder according to the present invention may not provide PCM outputs. In the case where the decoder process is employed only above a given coupling frequency, and discrete MDCT coefficients are sent for each channel below that frequency, it may be desirable to convert the DFT coefficients derived by the decoder upmixing Steps 511 a and 511 b to MDCT coefficients, so that they can be combined with the lower frequency discrete MDCT coefficients and requantized in order to provide, for example, a bitstream compatible with an encoding system that has a large number of installed users, such as a standard AC-3 SP/DIF bitstream for application to an external device where an inverse transform may be performed. An inverse DFT transform may be applied to ones of the output channels to provide PCM outputs.
Section 8.2.2 of the A/52A Document With Sensitivity Factor “F” Added 8.2.2. Transient Detection
Transients are detected in the full-bandwidth channels in order to decide when to switch to short length audio blocks to improve pre-echo performance. High-pass filtered versions of the signals are examined for an increase in energy from one sub-block time-segment to the next. Sub-blocks are examined at different time scales. If a transient is detected in the second half of an audio block in a channel that channel switches to a short block. A channel that is block-switched uses the D45 exponent strategy [i.e., the data has a coarser frequency resolution in order to reduce the data overhead resulting from the increase in temporal resolution].
The transient detector is used to determine when to switch from a long transform block (length 512), to the short block (length 256). It operates on 512 samples for every audio block. This is done in two passes, with each pass processing 256 samples. Transient detection is broken down into four steps: 1) high-pass filtering, 2) segmentation of the block into submultiples, 3) peak amplitude detection within each sub-block segment, and 4) threshold comparison. The transient detector outputs a flag blksw[n] for each full-bandwidth channel, which when set to “one” indicates the presence of a transient in the second half of the 512 length input block for the corresponding channel.
    • 1) High-pass filtering: The high-pass filter is implemented as a cascaded biquad direct form II IIR filter with a cutoff of 8 kHz.
    • 2) Block Segmentation: The block of 256 high-pass filtered samples are segmented into a hierarchical tree of levels in which level 1 represents the 256 length block, level 2 is two segments of length 128, and level 3 is four segments of length 64.
    • 3) Peak Detection: The sample with the largest magnitude is identified for each segment on every level of the hierarchical tree. The peaks for a single level are found as follows:
      P[j][k]=max(x(n))
      • for n=(512×(k−1)/2^j), (512×(k−1)/2^j)+1, . . . (512×k/2^j)−1
      • and k=1, . . . , 2^(j−1);
      • where: x(n)=the nth sample in the 256 length block
        • j=1, 2, 3 is the hierarchical level number
        • k=the segment number within level j
      • Note that P[j][0], (i.e., k=0) is defined to be the peak of the last segment on level j of the tree calculated immediately prior to the current tree. For example, P[3][4] in the preceding tree is P[3][0] in the current tree.
    • 4) Threshold Comparison: The first stage of the threshold comparator checks to see if there is significant signal level in the current block. This is done by comparing the overall peak value P[1][1] of the current block to a “silence threshold”. If P[1][4] is below this threshold then a long block is forced. The silence threshold value is 100/32768. The next stage of the comparator checks the relative peak levels of adjacent segments on each level of the hierarchical tree. If the peak ratio of any two adjacent segments on a particular level exceeds a pre-defined threshold for that level, then a flag is set to indicate the presence of a transient in the current 256-length block. The ratios are compared as follows:
      mag(P[j][k])×T[j]>(F*mag(P[j][(k−1)])) [Note the “F” sensitivity factor]
      • where: T[b] is the pre-defined threshold for level j, defined as:
        • T[1]=0.1
        • T[2]=0.075
        • T[3]=0.05
      • If this inequality is true for any two segment peaks on any level, then a transient is indicated for the first half of the 512 length input block. The second pass through this process determines the presence of transients in the second half of the 512 length input block.
N:M Encoding
Aspects of the present invention are not limited to N:1 encoding as described in connection with FIG. 1. More generally, aspects of the invention are applicable to the transformation of any number of input channels (n input channels) to any number of output channels (m output channels) in the manner of FIG. 6 (i.e., N:M encoding). Because in many common applications the number of input channels n is greater than the number of output channels m, the N:M encoding arrangement of FIG. 6 will be referred to as “downmixing” for convenience in description.
Referring to the details of FIG. 6, instead of summing the outputs of Rotate Angle 8 and Rotate Angle 10 in the Additive Combiner 6 as in the arrangement of FIG. 1, those outputs may be applied to a downmix matrix device or function 6′ (“Downmix Matrix”). Downmix Matrix 6′ may be a passive or active matrix that provides either a simple summation to one channel, as in the N:1 encoding of FIG. 1, or to multiple channels. The matrix coefficients may be real or complex (real and imaginary). Other devices and functions in FIG. 6 may be the same as in the FIG. 1 arrangement and they bear the same reference numerals.
Downmix Matrix 6′ may provide a hybrid frequency-dependent function such that it provides, for example, mf1-f2 channels in a frequency range f1 to f2 and mf2-f3 channels in a frequency range f2 to f3. For example, below a coupling frequency of, for example, 1000 Hz the Downmix Matrix 6′ may provide two channels and above the coupling frequency the Downmix Matrix 6′ may provide one channel. By employing two channels below the coupling frequency, better spatial fidelity may be obtained, especially if the two channels represent horizontal directions (to match the horizontally of the human ears).
Although FIG. 6 shows the generation of the same sidechain information for each channel as in the FIG. 1 arrangement, it may be possible to omit certain ones of the sidechain information when more than one channel is provided by the output of the Downmix Matrix 6′. In some cases, acceptable results may be obtained when only the amplitude scale factor sidechain information is provided by the FIG. 6 arrangement. Further details regarding sidechain options are discussed below in connection with the descriptions of FIGS. 7, 8 and 9.
As just mentioned above, the multiple channels generated by the Downmix Matrix 6′ need not be fewer than the number of input channels n. When the purpose of an encoder such as in FIG. 6 is to reduce the number of bits for transmission or storage, it is likely that the number of channels produced by downmix matrix 6′ will be fewer than the number of input channels n. However, the arrangement of FIG. 6 may also be used as an “upmixer.” In that case, there may be applications in which the number of channels m produced by the Downmix Matrix 6′ is more than the number of input channels n.
Encoders as described in connection with the examples of FIGS. 2, 5 and 6 may also include their own local decoder or decoding function in order to determine if the audio information and the sidechain information, when decoded by such a decoder, would provide suitable results. The results of such a determination could be used to improve the parameters by employing, for example, a recursive process. In a block encoding and decoding system, recursion calculations could be performed, for example, on every block before the next block ends in order to minimize the delay in transmitting a block of audio information and its associated spatial parameters.
An arrangement in which the encoder also includes its own decoder or decoding function could also be employed advantageously when spatial parameters are not stored or sent only for certain blocks. If unsuitable decoding would result from not sending spatial-parameter sidechain information, such sidechain information would be sent for the particular block. In this case, the decoder may be a modification of the decoder or decoding function of FIG. 2, 5 or 6 in that the decoder would have both the ability to recover spatial-parameter sidechain information for frequencies above the coupling frequency from the incoming bitstream but also to generate simulated spatial-parameter sidechain information from the stereo information below the coupling frequency.
In a simplified alternative to such local-decoder-incorporating encoder examples, rather than having a local decoder or decoder function, the encoder could simply check to determine if there were any signal content below the coupling frequency (determined in any suitable way, for example, a sum of the energy in frequency bins through the frequency range), and, if not, it would send or store spatial-parameter sidechain information rather than not doing so if the energy were above the threshold. Depending on the encoding scheme, low signal information below the coupling frequency may also result in more bits being available for sending sidechain information.
M:N Decoding
A more generalized form of the arrangement of FIG. 2 is shown in FIG. 7, wherein an upmix matrix function or device (“Upmix Matrix”) 20 receives the 1 to m channels generated by the arrangement of FIG. 6. The Upmix Matrix 20 may be a passive matrix. It may be, but need not be, the conjugate transposition (i.e., the complement) of the Downmix Matrix 6′ of the FIG. 6 arrangement. Alternatively, the Upmix Matrix 20 may be an active matrix—a variable matrix or a passive matrix in combination with a variable matrix. If an active matrix decoder is employed, in its relaxed or quiescent state it may be the complex conjugate of the Downmix Matrix or it may be independent of the Downmix Matrix. The sidechain information may be applied as shown in FIG. 7 so as to control the Adjust Amplitude, Rotate Angle, and (optional) Interpolator functions or devices. In that case, the Upmix Matrix, if an active matrix, operates independently of the sidechain information and responds only to the channels applied to it. Alternatively, some or all of the sidechain information may be applied to the active matrix to assist its operation. In that case, some or all of the Adjust Amplitude, Rotate Angle, and Interpolator functions or devices may be omitted. The Decoder example of FIG. 7 may also employ the alternative of applying a degree of randomized amplitude variations under certain signal conditions, as described above in connection with FIGS. 2 and 5.
When Upmix Matrix 20 is an active matrix, the arrangement of FIG. 7 may be characterized as a “hybrid matrix decoder” for operating in a “hybrid matrix encoder/decoder system.” “Hybrid” in this context refers to the fact that the decoder may derive some measure of control information from its input audio signal (i.e., the active matrix responds to spatial information encoded in the channels applied to it) and a further measure of control information from spatial-parameter sidechain information. Other elements of FIG. 7 are as in the arrangement of FIG. 2 and bear the same reference numerals.
Suitable active matrix decoders for use in a hybrid matrix decoder may include active matrix decoders such as those mentioned above and incorporated by reference, including, for example, matrix decoders known as “Pro Logic” and “Pro Logic II” decoders (“Pro Logic” is a trademark of Dolby Laboratories Licensing Corporation).
Alternative Decorrelation
FIGS. 8 and 9 show variations on the generalized Decoder of FIG. 7. In particular, both the arrangement of FIG. 8 and the arrangement of FIG. 9 show alternatives to the decorrelation technique of FIGS. 2 and 7. In FIG. 8, respective decorrelator functions or devices (“Decorrelators”) 46 and 48 are in the time domain, each following the respective Inverse Filterbank 30 and 36 in their channel. In FIG. 9, respective decorrelator functions or devices (“Decorrelators”) 50 and 52 are in the frequency domain, each preceding the respective Inverse Filterbank 30 and 36 in their channel. In both the FIG. 8 and FIG. 9 arrangements, each of the Decorrelators (46, 48, 50, 52) has a unique characteristic so that their outputs are mutually decorrelated with respect to each other. The Decorrelation Scale Factor may be used to control, for example, the ratio of decorrelated to uncorrelated signal provided in each channel. Optionally, the Transient Flag may also be used to shift the mode of operation of the Decorrelator, as is explained below. In both the FIG. 8 and FIG. 9 arrangements, each Decorrelator may be a Schroeder-type reverberator having its own unique filter characteristic, in which the amount or degree of reverberation is controlled by the decorrelation scale factor (implemented, for example, by controlling the degree to which the Decorrelator output forms a part of a linear combination of the Decorrelator input and output). Alternatively, other controllable decorrelation techniques may be employed either alone or in combination with each other or with a Schroeder-type reverberator. Schroeder-type reverberators are well known and may trace their origin to two journal papers: “‘Colorless’ Artificial Reverberation” by M. R. Schroeder and B. F. Logan, IRE Transactions on Audio, vol. AU-9, pp. 209-214, 1961 and “Natural Sounding Artificial Reverberation” by M. R. Schroeder, Journal A.E.S., July 1962, vol. 10, no. 2, pp. 219-223.
When the Decorrelators 46 and 48 operate in the time domain, as in the FIG. 8 arrangement, a single (i.e., wideband) Decorrelation Scale Factor is required. This may be obtained by any of several ways. For example, only a single Decorrelation Scale Factor may be generated in the encoder of FIG. 1 or FIG. 7. Alternatively, if the encoder of FIG. 1 or FIG. 7 generates Decorrelation Scale Factors on a subband basis, the Subband Decorrelation Scale Factors may be amplitude or power summed in the encoder of FIG. 1 or FIG. 7 or in the decoder of FIG. 8.
When the Decorrelators 50 and 52 operate in the frequency domain, as in the FIG. 9 arrangement, they may receive a decorrelation scale factor for each subband or groups of subbands and, concomitantly, provide a commensurate degree of decorrelation for such subbands or groups of subbands.
The Decorrelators 46 and 48 of FIG. 8 and the Decorrelators 50 and 52 of FIG. 9 may optionally receive the Transient Flag. In the time-domain Decorrelators of FIG. 8, the Transient Flag may be employed to shift the mode of operation of the respective Decorrelator. For example, the Decorrelator may operate as a Schroeder-type reverberator in the absence of the transient flag but upon its receipt and for a short subsequent time period, say 1 to 10 milliseconds, operate as a fixed delay. Each channel may have a predetermined fixed delay or the delay may be varied in response to a plurality of transients within a short time period. In the frequency-domain Decorrelators of FIG. 9, the transient flag may also be employed to shift the mode of operation of the respective Decorrelator. However, in this case, the receipt of a transient flag may, for example, trigger a short (several milliseconds) increase in amplitude in the channel in which the flag occurred.
In both the FIGS. 8 and 9 arrangements, an Interpolator 27 (33), controlled by the optional Transient Flag, may provide interpolation across frequency of the phase angles output of Rotate Angle 28 (33) in a manner as described above.
As mentioned above, when two or more channels are sent in addition to sidechain information, it may be acceptable to reduce the number of sidechain parameters. For example, it may be acceptable to send only the Amplitude Scale Factor, in which case the decorrelation and angle devices or functions in the decoder may be omitted (in that case, FIGS. 7, 8 and 9 reduce to the same arrangement).
Alternatively, only the amplitude scale factor, the Decorrelation Scale Factor, and, optionally, the Transient Flag may be sent. In that case, any of the FIG. 7, 8 or 9 arrangements may be employed (omitting the Rotate Angle 28 and 34 in each of them).
As another alternative, only the amplitude scale factor and the angle control parameter may be sent. In that case, any of the FIG. 7, 8 or 9 arrangements may be employed (omitting the Decorrelator 38 and 42 of FIGS. 7 and 46, 48, 50, 52 of FIGS. 8 and 9).
As in FIGS. 1 and 2, the arrangements of FIGS. 6-9 are intended to show any number of input and output channels although, for simplicity in presentation, only two channels are shown.
It should be understood that implementation of other variations and modifications of the invention and its various aspects will be apparent to those skilled in the art, and that the invention is not limited by these specific embodiments described. It is therefore contemplated to cover by the present invention any and all modifications, variations, or equivalents that fall within the true spirit and scope of the basic underlying principles disclosed herein.

Claims (12)

The invention claimed is:
1. A method for decoding M encoded audio channels representing N audio channels, where N is two or more, and a set of one or more spatial parameters, the method comprising:
a) receiving said M encoded audio channels and said set of spatial parameters,
b) deriving N audio signals from said M encoded channels, wherein each audio signal is divided into a plurality of frequency bands, wherein each band comprises one or more spectral components, and
c) generating a multichannel output signal from the N audio signals and the spatial parameters,
whereby
M is two or more,
at least one of said N audio signals is a correlated signal derived from a weighted combination of at least two of said M encoded audio channels,
said set of spatial parameters includes a first parameter indicative of the amount of an uncorrelated signal to mix with a correlated signal and
step c) includes deriving at least one uncorrelated signal from said at least one correlated signal, and controlling the proportion of said at least one correlated signal to said at least one uncorrelated signal in at least one channel of said multichannel output signal in response to one or ones of said spatial parameters, wherein said controlling is at least partly in accordance with said first parameter.
2. The method of claim 1 wherein step c) includes deriving said at least one uncorrelated signal by applying an artificial reverberation filter to said at least one correlated signal.
3. The method of claim 1 wherein step c) includes deriving said at least one uncorrelated signal by applying a plurality of artificial reverberation filters to said at least one correlated signal.
4. The method of claim 3 wherein each of said plurality of artificial reverberation filters has a unique filter characteristic.
5. The method of claim 1 wherein said controlling in step c) includes deriving a separate proportion of said at least one correlated signal to said at least one uncorrelated signal for each of said plurality of frequency bands, at least partly in accordance with said first parameter.
6. The method of claim 1 wherein said N audio signals are derived from said M encoded audio channels by a process that includes dematrixing said M encoded audio channels.
7. The method of claim 6 wherein the dematrixing operates at least partly in response to one or ones of said spatial parameters.
8. The method of claim 1 further comprising shifting the magnitudes of spectral components in at least one of said N audio signals in response to one or ones of said spatial parameters.
9. The method of claim 1 wherein said multichannel output signal is in the time domain.
10. The method of claim 1 wherein said multichannel output signal is in the frequency domain.
11. The method of claim 1 wherein N is 3 or more.
12. An apparatus comprising means adapted to carry out each of the steps of any one of the methods of claims 1-11.
US10/591,374 2004-03-01 2005-02-28 Multichannel audio coding Active 2032-02-10 US8983834B2 (en)

Priority Applications (18)

Application Number Priority Date Filing Date Title
US10/591,374 US8983834B2 (en) 2004-03-01 2005-02-28 Multichannel audio coding
US11/888,657 US8170882B2 (en) 2004-03-01 2007-07-31 Multichannel audio coding
US12/283,712 US20090299756A1 (en) 2004-03-01 2008-09-12 Ratio of speech to non-speech audio such as for elderly or hearing-impaired listeners
US14/614,672 US9311922B2 (en) 2004-03-01 2015-02-05 Method, apparatus, and storage medium for decoding encoded audio channels
US15/060,425 US9520135B2 (en) 2004-03-01 2016-03-03 Reconstructing audio signals with multiple decorrelation techniques
US15/060,382 US9454969B2 (en) 2004-03-01 2016-03-03 Multichannel audio coding
US15/344,137 US9640188B2 (en) 2004-03-01 2016-11-04 Reconstructing audio signals with multiple decorrelation techniques
US15/422,132 US9672839B1 (en) 2004-03-01 2017-02-01 Reconstructing audio signals with multiple decorrelation techniques and differentially coded parameters
US15/422,119 US9691404B2 (en) 2004-03-01 2017-02-01 Reconstructing audio signals with multiple decorrelation techniques
US15/422,107 US9715882B2 (en) 2004-03-01 2017-02-01 Reconstructing audio signals with multiple decorrelation techniques
US15/446,663 US9697842B1 (en) 2004-03-01 2017-03-01 Reconstructing audio signals with multiple decorrelation techniques and differentially coded parameters
US15/446,699 US9779745B2 (en) 2004-03-01 2017-03-01 Reconstructing audio signals with multiple decorrelation techniques and differentially coded parameters
US15/446,693 US9704499B1 (en) 2004-03-01 2017-03-01 Reconstructing audio signals with multiple decorrelation techniques and differentially coded parameters
US15/446,678 US9691405B1 (en) 2004-03-01 2017-03-01 Reconstructing audio signals with multiple decorrelation techniques and differentially coded parameters
US15/691,309 US10269364B2 (en) 2004-03-01 2017-08-30 Reconstructing audio signals with multiple decorrelation techniques
US16/226,289 US10403297B2 (en) 2004-03-01 2018-12-19 Methods and apparatus for adjusting a level of an audio signal
US16/226,252 US10460740B2 (en) 2004-03-01 2018-12-19 Methods and apparatus for adjusting a level of an audio signal
US16/666,276 US10796706B2 (en) 2004-03-01 2019-10-28 Methods and apparatus for reconstructing audio signals with decorrelation and differentially coded parameters

Applications Claiming Priority (5)

Application Number Priority Date Filing Date Title
US54936804P 2004-03-01 2004-03-01
US57997404P 2004-06-14 2004-06-14
US58825604P 2004-07-14 2004-07-14
US10/591,374 US8983834B2 (en) 2004-03-01 2005-02-28 Multichannel audio coding
PCT/US2005/006359 WO2005086139A1 (en) 2004-03-01 2005-02-28 Multichannel audio coding

Related Parent Applications (1)

Application Number Title Priority Date Filing Date
PCT/US2005/006359 A-371-Of-International WO2005086139A1 (en) 2004-03-01 2005-02-28 Multichannel audio coding

Related Child Applications (2)

Application Number Title Priority Date Filing Date
US11/888,657 Continuation US8170882B2 (en) 2004-03-01 2007-07-31 Multichannel audio coding
US14/614,672 Continuation US9311922B2 (en) 2004-03-01 2015-02-05 Method, apparatus, and storage medium for decoding encoded audio channels

Publications (2)

Publication Number Publication Date
US20070140499A1 US20070140499A1 (en) 2007-06-21
US8983834B2 true US8983834B2 (en) 2015-03-17

Family

ID=34923263

Family Applications (18)

Application Number Title Priority Date Filing Date
US10/591,374 Active 2032-02-10 US8983834B2 (en) 2004-03-01 2005-02-28 Multichannel audio coding
US11/888,657 Active 2027-08-17 US8170882B2 (en) 2004-03-01 2007-07-31 Multichannel audio coding
US14/614,672 Active US9311922B2 (en) 2004-03-01 2015-02-05 Method, apparatus, and storage medium for decoding encoded audio channels
US15/060,425 Active US9520135B2 (en) 2004-03-01 2016-03-03 Reconstructing audio signals with multiple decorrelation techniques
US15/060,382 Active US9454969B2 (en) 2004-03-01 2016-03-03 Multichannel audio coding
US15/344,137 Active US9640188B2 (en) 2004-03-01 2016-11-04 Reconstructing audio signals with multiple decorrelation techniques
US15/422,107 Active US9715882B2 (en) 2004-03-01 2017-02-01 Reconstructing audio signals with multiple decorrelation techniques
US15/422,132 Active US9672839B1 (en) 2004-03-01 2017-02-01 Reconstructing audio signals with multiple decorrelation techniques and differentially coded parameters
US15/422,119 Active US9691404B2 (en) 2004-03-01 2017-02-01 Reconstructing audio signals with multiple decorrelation techniques
US15/446,663 Active US9697842B1 (en) 2004-03-01 2017-03-01 Reconstructing audio signals with multiple decorrelation techniques and differentially coded parameters
US15/446,678 Active US9691405B1 (en) 2004-03-01 2017-03-01 Reconstructing audio signals with multiple decorrelation techniques and differentially coded parameters
US15/446,693 Active US9704499B1 (en) 2004-03-01 2017-03-01 Reconstructing audio signals with multiple decorrelation techniques and differentially coded parameters
US15/446,699 Active US9779745B2 (en) 2004-03-01 2017-03-01 Reconstructing audio signals with multiple decorrelation techniques and differentially coded parameters
US15/691,309 Active 2025-03-15 US10269364B2 (en) 2004-03-01 2017-08-30 Reconstructing audio signals with multiple decorrelation techniques
US16/226,252 Active US10460740B2 (en) 2004-03-01 2018-12-19 Methods and apparatus for adjusting a level of an audio signal
US16/226,289 Active US10403297B2 (en) 2004-03-01 2018-12-19 Methods and apparatus for adjusting a level of an audio signal
US16/666,276 Active US10796706B2 (en) 2004-03-01 2019-10-28 Methods and apparatus for reconstructing audio signals with decorrelation and differentially coded parameters
US17/063,137 Active US11308969B2 (en) 2004-03-01 2020-10-05 Methods and apparatus for reconstructing audio signals with decorrelation and differentially coded parameters

Family Applications After (17)

Application Number Title Priority Date Filing Date
US11/888,657 Active 2027-08-17 US8170882B2 (en) 2004-03-01 2007-07-31 Multichannel audio coding
US14/614,672 Active US9311922B2 (en) 2004-03-01 2015-02-05 Method, apparatus, and storage medium for decoding encoded audio channels
US15/060,425 Active US9520135B2 (en) 2004-03-01 2016-03-03 Reconstructing audio signals with multiple decorrelation techniques
US15/060,382 Active US9454969B2 (en) 2004-03-01 2016-03-03 Multichannel audio coding
US15/344,137 Active US9640188B2 (en) 2004-03-01 2016-11-04 Reconstructing audio signals with multiple decorrelation techniques
US15/422,107 Active US9715882B2 (en) 2004-03-01 2017-02-01 Reconstructing audio signals with multiple decorrelation techniques
US15/422,132 Active US9672839B1 (en) 2004-03-01 2017-02-01 Reconstructing audio signals with multiple decorrelation techniques and differentially coded parameters
US15/422,119 Active US9691404B2 (en) 2004-03-01 2017-02-01 Reconstructing audio signals with multiple decorrelation techniques
US15/446,663 Active US9697842B1 (en) 2004-03-01 2017-03-01 Reconstructing audio signals with multiple decorrelation techniques and differentially coded parameters
US15/446,678 Active US9691405B1 (en) 2004-03-01 2017-03-01 Reconstructing audio signals with multiple decorrelation techniques and differentially coded parameters
US15/446,693 Active US9704499B1 (en) 2004-03-01 2017-03-01 Reconstructing audio signals with multiple decorrelation techniques and differentially coded parameters
US15/446,699 Active US9779745B2 (en) 2004-03-01 2017-03-01 Reconstructing audio signals with multiple decorrelation techniques and differentially coded parameters
US15/691,309 Active 2025-03-15 US10269364B2 (en) 2004-03-01 2017-08-30 Reconstructing audio signals with multiple decorrelation techniques
US16/226,252 Active US10460740B2 (en) 2004-03-01 2018-12-19 Methods and apparatus for adjusting a level of an audio signal
US16/226,289 Active US10403297B2 (en) 2004-03-01 2018-12-19 Methods and apparatus for adjusting a level of an audio signal
US16/666,276 Active US10796706B2 (en) 2004-03-01 2019-10-28 Methods and apparatus for reconstructing audio signals with decorrelation and differentially coded parameters
US17/063,137 Active US11308969B2 (en) 2004-03-01 2020-10-05 Methods and apparatus for reconstructing audio signals with decorrelation and differentially coded parameters

Country Status (17)

Country Link
US (18) US8983834B2 (en)
EP (4) EP2224430B1 (en)
JP (1) JP4867914B2 (en)
KR (1) KR101079066B1 (en)
CN (3) CN102176311B (en)
AT (4) ATE527654T1 (en)
AU (2) AU2005219956B2 (en)
BR (1) BRPI0508343B1 (en)
CA (11) CA2992125C (en)
DE (3) DE602005014288D1 (en)
ES (1) ES2324926T3 (en)
HK (4) HK1092580A1 (en)
IL (1) IL177094A (en)
MY (1) MY145083A (en)
SG (3) SG10201605609PA (en)
TW (3) TWI484478B (en)
WO (1) WO2005086139A1 (en)

Cited By (26)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20140369503A1 (en) * 2012-01-11 2014-12-18 Dolby Laboratories Licensing Corporation Simultaneous broadcaster-mixed and receiver-mixed supplementary audio services
US9165562B1 (en) 2001-04-13 2015-10-20 Dolby Laboratories Licensing Corporation Processing audio signals with adaptive time or frequency resolution
US9311922B2 (en) 2004-03-01 2016-04-12 Dolby Laboratories Licensing Corporation Method, apparatus, and storage medium for decoding encoded audio channels
US20160240183A1 (en) * 2015-02-12 2016-08-18 Dts, Inc. Multi-rate system for audio processing
US9489956B2 (en) 2013-02-14 2016-11-08 Dolby Laboratories Licensing Corporation Audio signal enhancement using estimated spatial parameters
US9754596B2 (en) 2013-02-14 2017-09-05 Dolby Laboratories Licensing Corporation Methods for controlling the inter-channel coherence of upmixed audio signals
US9818412B2 (en) 2013-05-24 2017-11-14 Dolby International Ab Methods for audio encoding and decoding, corresponding computer-readable media and corresponding audio encoder and decoder
US9830916B2 (en) 2013-02-14 2017-11-28 Dolby Laboratories Licensing Corporation Signal decorrelation in an audio processing system
US9830917B2 (en) 2013-02-14 2017-11-28 Dolby Laboratories Licensing Corporation Methods for audio signal transient detection and decorrelation control
US10375500B2 (en) 2013-06-27 2019-08-06 Clarion Co., Ltd. Propagation delay correction apparatus and propagation delay correction method
US10553224B2 (en) * 2017-10-03 2020-02-04 Dolby Laboratories Licensing Corporation Method and system for inter-channel coding
US11297423B2 (en) 2018-06-15 2022-04-05 Shure Acquisition Holdings, Inc. Endfire linear array microphone
US11297426B2 (en) 2019-08-23 2022-04-05 Shure Acquisition Holdings, Inc. One-dimensional array microphone with improved directivity
US11303981B2 (en) 2019-03-21 2022-04-12 Shure Acquisition Holdings, Inc. Housings and associated design features for ceiling array microphones
US11302347B2 (en) 2019-05-31 2022-04-12 Shure Acquisition Holdings, Inc. Low latency automixer integrated with voice and noise activity detection
US11310596B2 (en) 2018-09-20 2022-04-19 Shure Acquisition Holdings, Inc. Adjustable lobe shape for array microphones
US11310592B2 (en) 2015-04-30 2022-04-19 Shure Acquisition Holdings, Inc. Array microphone system and method of assembling the same
US11438691B2 (en) 2019-03-21 2022-09-06 Shure Acquisition Holdings, Inc. Auto focus, auto focus within regions, and auto placement of beamformed microphone lobes with inhibition functionality
US11445294B2 (en) 2019-05-23 2022-09-13 Shure Acquisition Holdings, Inc. Steerable speaker array, system, and method for the same
US11477327B2 (en) 2017-01-13 2022-10-18 Shure Acquisition Holdings, Inc. Post-mixing acoustic echo cancellation systems and methods
US11523212B2 (en) 2018-06-01 2022-12-06 Shure Acquisition Holdings, Inc. Pattern-forming microphone array
US11552611B2 (en) 2020-02-07 2023-01-10 Shure Acquisition Holdings, Inc. System and method for automatic adjustment of reference gain
US11558693B2 (en) 2019-03-21 2023-01-17 Shure Acquisition Holdings, Inc. Auto focus, auto focus within regions, and auto placement of beamformed microphone lobes with inhibition and voice activity detection functionality
US11678109B2 (en) 2015-04-30 2023-06-13 Shure Acquisition Holdings, Inc. Offset cartridge microphones
US11706562B2 (en) 2020-05-29 2023-07-18 Shure Acquisition Holdings, Inc. Transducer steering and configuration systems and methods using a local positioning system
US11785380B2 (en) 2021-01-28 2023-10-10 Shure Acquisition Holdings, Inc. Hybrid audio beamforming system

Families Citing this family (246)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US7644282B2 (en) 1998-05-28 2010-01-05 Verance Corporation Pre-processed information embedding system
US6737957B1 (en) 2000-02-16 2004-05-18 Verance Corporation Remote control signaling using audio watermarks
US7283954B2 (en) 2001-04-13 2007-10-16 Dolby Laboratories Licensing Corporation Comparing audio using characterizations based on auditory events
US7610205B2 (en) 2002-02-12 2009-10-27 Dolby Laboratories Licensing Corporation High quality time-scaling and pitch-scaling of audio signals
US7461002B2 (en) 2001-04-13 2008-12-02 Dolby Laboratories Licensing Corporation Method for time aligning audio signals using characterizations based on auditory events
US7240001B2 (en) 2001-12-14 2007-07-03 Microsoft Corporation Quality improvement techniques in an audio encoder
US6934677B2 (en) 2001-12-14 2005-08-23 Microsoft Corporation Quantization matrices based on critical band pattern information for digital audio wherein quantization bands differ from critical bands
US7502743B2 (en) 2002-09-04 2009-03-10 Microsoft Corporation Multi-channel audio encoding and decoding with multi-channel transform selection
EP2442566A3 (en) 2002-10-15 2012-08-08 Verance Corporation Media Monitoring, Management and Information System
US7369677B2 (en) * 2005-04-26 2008-05-06 Verance Corporation System reactions to the detection of embedded watermarks in a digital host content
US20060239501A1 (en) 2005-04-26 2006-10-26 Verance Corporation Security enhancements of digital watermarks for multi-media content
US7460990B2 (en) 2004-01-23 2008-12-02 Microsoft Corporation Efficient coding of digital media spectral data using wide-sense perceptual similarity
PL1769491T3 (en) 2004-07-14 2010-03-31 Koninl Philips Electronics Nv Audio channel conversion
US7508947B2 (en) 2004-08-03 2009-03-24 Dolby Laboratories Licensing Corporation Method for combining audio signals using auditory scene analysis
TWI393121B (en) 2004-08-25 2013-04-11 Dolby Lab Licensing Corp Method and apparatus for processing a set of n audio signals, and computer program associated therewith
TWI497485B (en) * 2004-08-25 2015-08-21 Dolby Lab Licensing Corp Method for reshaping the temporal envelope of synthesized output audio signal to approximate more closely the temporal envelope of input audio signal
CN101048935B (en) 2004-10-26 2011-03-23 杜比实验室特许公司 Method and device for controlling the perceived loudness and/or the perceived spectral balance of an audio signal
SE0402652D0 (en) 2004-11-02 2004-11-02 Coding Tech Ab Methods for improved performance of prediction based multi-channel reconstruction
SE0402651D0 (en) * 2004-11-02 2004-11-02 Coding Tech Ab Advanced methods for interpolation and parameter signaling
US7573912B2 (en) * 2005-02-22 2009-08-11 Fraunhofer-Gesellschaft Zur Foerderung Der Angewandten Forschunng E.V. Near-transparent or transparent multi-channel encoder/decoder scheme
DE102005014477A1 (en) 2005-03-30 2006-10-12 Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V. Apparatus and method for generating a data stream and generating a multi-channel representation
US7983922B2 (en) * 2005-04-15 2011-07-19 Fraunhofer-Gesellschaft Zur Foerderung Der Angewandten Forschung E.V. Apparatus and method for generating multi-channel synthesizer control signal and apparatus and method for multi-channel synthesizing
US7418394B2 (en) * 2005-04-28 2008-08-26 Dolby Laboratories Licensing Corporation Method and system for operating audio encoders utilizing data from overlapping audio segments
WO2006126843A2 (en) 2005-05-26 2006-11-30 Lg Electronics Inc. Method and apparatus for decoding audio signal
JP4988717B2 (en) 2005-05-26 2012-08-01 エルジー エレクトロニクス インコーポレイティド Audio signal decoding method and apparatus
EP1927102A2 (en) * 2005-06-03 2008-06-04 Dolby Laboratories Licensing Corporation Apparatus and method for encoding audio signals with decoding instructions
US8020004B2 (en) 2005-07-01 2011-09-13 Verance Corporation Forensic marking using a common customization function
US8781967B2 (en) 2005-07-07 2014-07-15 Verance Corporation Watermarking in an encrypted domain
ATE490454T1 (en) * 2005-07-22 2010-12-15 France Telecom METHOD FOR SWITCHING RATE AND BANDWIDTH SCALABLE AUDIO DECODING RATE
TWI396188B (en) 2005-08-02 2013-05-11 Dolby Lab Licensing Corp Controlling spatial audio coding parameters as a function of auditory events
US7917358B2 (en) * 2005-09-30 2011-03-29 Apple Inc. Transient detection by power weighted average
EP1946304A4 (en) * 2005-10-05 2009-07-22 Lg Electronics Inc Method and apparatus for signal processing and encoding and decoding method, and apparatus therefor
KR100878828B1 (en) * 2005-10-05 2009-01-14 엘지전자 주식회사 Method and apparatus for signal processing and encoding and decoding method, and apparatus therefor
US7974713B2 (en) * 2005-10-12 2011-07-05 Fraunhofer-Gesellschaft Zur Foerderung Der Angewandten Forschung E.V. Temporal and spatial shaping of multi-channel audio signals
KR20070041398A (en) * 2005-10-13 2007-04-18 엘지전자 주식회사 Method and apparatus for processing a signal
WO2007043844A1 (en) 2005-10-13 2007-04-19 Lg Electronics Inc. Method and apparatus for processing a signal
KR20070043651A (en) * 2005-10-20 2007-04-25 엘지전자 주식회사 Method for encoding and decoding multi-channel audio signal and apparatus thereof
US8620644B2 (en) * 2005-10-26 2013-12-31 Qualcomm Incorporated Encoder-assisted frame loss concealment techniques for audio coding
US7676360B2 (en) * 2005-12-01 2010-03-09 Sasken Communication Technologies Ltd. Method for scale-factor estimation in an audio encoder
TWI420918B (en) * 2005-12-02 2013-12-21 Dolby Lab Licensing Corp Low-complexity audio matrix decoder
TWI469133B (en) 2006-01-19 2015-01-11 Lg Electronics Inc Method and apparatus for processing a media signal
US8190425B2 (en) * 2006-01-20 2012-05-29 Microsoft Corporation Complex cross-correlation parameters for multi-channel audio
US7831434B2 (en) * 2006-01-20 2010-11-09 Microsoft Corporation Complex-transform channel coding with extended-band frequency coding
US7953604B2 (en) * 2006-01-20 2011-05-31 Microsoft Corporation Shape and scale parameters for extended-band frequency coding
JP4951985B2 (en) * 2006-01-30 2012-06-13 ソニー株式会社 Audio signal processing apparatus, audio signal processing system, program
TWI329464B (en) 2006-02-07 2010-08-21 Lg Electronics Inc Apparatus and method for encoding / decoding signal
DE102006062774B4 (en) * 2006-02-09 2008-08-28 Infineon Technologies Ag Device and method for the detection of audio signal frames
TW200742275A (en) * 2006-03-21 2007-11-01 Dolby Lab Licensing Corp Low bit rate audio encoding and decoding in which multiple channels are represented by fewer channels and auxiliary information
MX2008012324A (en) 2006-03-28 2008-10-10 Fraunhofer Ges Zur Foeerderung Enhanced method for signal shaping in multi-channel audio reconstruction.
TWI517562B (en) 2006-04-04 2016-01-11 杜比實驗室特許公司 Method, apparatus, and computer program for scaling the overall perceived loudness of a multichannel audio signal by a desired amount
ATE448638T1 (en) * 2006-04-13 2009-11-15 Fraunhofer Ges Forschung AUDIO SIGNAL DECORRELATOR
MX2008013753A (en) 2006-04-27 2009-03-06 Dolby Lab Licensing Corp Audio gain control using specific-loudness-based auditory event detection.
ATE527833T1 (en) 2006-05-04 2011-10-15 Lg Electronics Inc IMPROVE STEREO AUDIO SIGNALS WITH REMIXING
CN101529898B (en) * 2006-10-12 2014-09-17 Lg电子株式会社 Apparatus for processing a mix signal and method thereof
US8849433B2 (en) 2006-10-20 2014-09-30 Dolby Laboratories Licensing Corporation Audio dynamics processing using a reset
JP4838361B2 (en) 2006-11-15 2011-12-14 エルジー エレクトロニクス インコーポレイティド Audio signal decoding method and apparatus
CN101568958B (en) 2006-12-07 2012-07-18 Lg电子株式会社 A method and an apparatus for processing an audio signal
JP5463143B2 (en) 2006-12-07 2014-04-09 エルジー エレクトロニクス インコーポレイティド Audio signal decoding method and apparatus
CN102883257B (en) * 2006-12-27 2015-11-04 韩国电子通信研究院 For equipment and the method for coding multi-object audio signal
US8200351B2 (en) * 2007-01-05 2012-06-12 STMicroelectronics Asia PTE., Ltd. Low power downmix energy equalization in parametric stereo encoders
CN101606195B (en) * 2007-02-12 2012-05-02 杜比实验室特许公司 Improved ratio of speech to non-speech audio such as for elderly or hearing-impaired listeners
US8195454B2 (en) 2007-02-26 2012-06-05 Dolby Laboratories Licensing Corporation Speech enhancement in entertainment audio
DE102007018032B4 (en) 2007-04-17 2010-11-11 Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V. Generation of decorrelated signals
BRPI0809760B1 (en) 2007-04-26 2020-12-01 Dolby International Ab apparatus and method for synthesizing an output signal
US8644970B2 (en) 2007-06-08 2014-02-04 Lg Electronics Inc. Method and an apparatus for processing an audio signal
US7953188B2 (en) * 2007-06-25 2011-05-31 Broadcom Corporation Method and system for rate>1 SFBC/STBC using hybrid maximum likelihood (ML)/minimum mean squared error (MMSE) estimation
US7885819B2 (en) 2007-06-29 2011-02-08 Microsoft Corporation Bitstream syntax for multi-process audio decoding
JP5192544B2 (en) 2007-07-13 2013-05-08 ドルビー ラボラトリーズ ライセンシング コーポレイション Acoustic processing using auditory scene analysis and spectral distortion
US8135230B2 (en) * 2007-07-30 2012-03-13 Dolby Laboratories Licensing Corporation Enhancing dynamic ranges of images
US8385556B1 (en) 2007-08-17 2013-02-26 Dts, Inc. Parametric stereo conversion system and method
WO2009045649A1 (en) * 2007-08-20 2009-04-09 Neural Audio Corporation Phase decorrelation for audio processing
CA2697920C (en) 2007-08-27 2018-01-02 Telefonaktiebolaget L M Ericsson (Publ) Transient detector and method for supporting encoding of an audio signal
US8155971B2 (en) * 2007-10-17 2012-04-10 Fraunhofer-Gesellschaft Zur Foerderung Der Angewandten Forschung E.V. Audio decoding of multi-audio-object signal using upmixing
US8543231B2 (en) * 2007-12-09 2013-09-24 Lg Electronics Inc. Method and an apparatus for processing a signal
PL2232700T3 (en) 2007-12-21 2015-01-30 Dts Llc System for adjusting perceived loudness of audio signals
CA2710741A1 (en) * 2008-01-01 2009-07-09 Lg Electronics Inc. A method and an apparatus for processing a signal
KR101449434B1 (en) * 2008-03-04 2014-10-13 삼성전자주식회사 Method and apparatus for encoding/decoding multi-channel audio using plurality of variable length code tables
AU2009225027B2 (en) 2008-03-10 2012-09-20 Fraunhofer-Gesellschaft Zur Forderung Der Angewandten Forschung E.V. Device and method for manipulating an audio signal having a transient event
JP5340261B2 (en) * 2008-03-19 2013-11-13 パナソニック株式会社 Stereo signal encoding apparatus, stereo signal decoding apparatus, and methods thereof
KR20090110242A (en) * 2008-04-17 2009-10-21 삼성전자주식회사 Method and apparatus for processing audio signal
KR101599875B1 (en) * 2008-04-17 2016-03-14 삼성전자주식회사 Method and apparatus for multimedia encoding based on attribute of multimedia content, method and apparatus for multimedia decoding based on attributes of multimedia content
KR20090110244A (en) * 2008-04-17 2009-10-21 삼성전자주식회사 Method for encoding/decoding audio signals using audio semantic information and apparatus thereof
WO2009128078A1 (en) * 2008-04-17 2009-10-22 Waves Audio Ltd. Nonlinear filter for separation of center sounds in stereophonic audio
KR101061129B1 (en) * 2008-04-24 2011-08-31 엘지전자 주식회사 Method of processing audio signal and apparatus thereof
US8060042B2 (en) 2008-05-23 2011-11-15 Lg Electronics Inc. Method and an apparatus for processing an audio signal
US8630848B2 (en) 2008-05-30 2014-01-14 Digital Rise Technology Co., Ltd. Audio signal transient detection
WO2009146734A1 (en) * 2008-06-03 2009-12-10 Nokia Corporation Multi-channel audio coding
US8355921B2 (en) * 2008-06-13 2013-01-15 Nokia Corporation Method, apparatus and computer program product for providing improved audio processing
US8259938B2 (en) 2008-06-24 2012-09-04 Verance Corporation Efficient and secure forensic marking in compressed
JP5110529B2 (en) * 2008-06-27 2012-12-26 日本電気株式会社 Target search device, target search program, and target search method
EP2144229A1 (en) * 2008-07-11 2010-01-13 Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V. Efficient use of phase information in audio encoding and decoding
KR101428487B1 (en) * 2008-07-11 2014-08-08 삼성전자주식회사 Method and apparatus for encoding and decoding multi-channel
KR101381513B1 (en) 2008-07-14 2014-04-07 광운대학교 산학협력단 Apparatus for encoding and decoding of integrated voice and music
EP2154911A1 (en) * 2008-08-13 2010-02-17 Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V. An apparatus for determining a spatial output multi-channel audio signal
EP2154910A1 (en) * 2008-08-13 2010-02-17 Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V. Apparatus for merging spatial audio streams
KR101108061B1 (en) * 2008-09-25 2012-01-25 엘지전자 주식회사 A method and an apparatus for processing a signal
US8346380B2 (en) 2008-09-25 2013-01-01 Lg Electronics Inc. Method and an apparatus for processing a signal
WO2010036059A2 (en) 2008-09-25 2010-04-01 Lg Electronics Inc. A method and an apparatus for processing a signal
TWI413109B (en) * 2008-10-01 2013-10-21 Dolby Lab Licensing Corp Decorrelator for upmixing systems
EP2175670A1 (en) * 2008-10-07 2010-04-14 Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V. Binaural rendering of a multi-channel audio signal
KR101600352B1 (en) * 2008-10-30 2016-03-07 삼성전자주식회사 / method and apparatus for encoding/decoding multichannel signal
JP5317177B2 (en) * 2008-11-07 2013-10-16 日本電気株式会社 Target detection apparatus, target detection control program, and target detection method
JP5317176B2 (en) * 2008-11-07 2013-10-16 日本電気株式会社 Object search device, object search program, and object search method
JP5309944B2 (en) * 2008-12-11 2013-10-09 富士通株式会社 Audio decoding apparatus, method, and program
US8964994B2 (en) * 2008-12-15 2015-02-24 Orange Encoding of multichannel digital audio signals
TWI449442B (en) * 2009-01-14 2014-08-11 Dolby Lab Licensing Corp Method and system for frequency domain active matrix decoding without feedback
EP2214162A1 (en) * 2009-01-28 2010-08-04 Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V. Upmixer, method and computer program for upmixing a downmix audio signal
EP2214161A1 (en) * 2009-01-28 2010-08-04 Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V. Apparatus, method and computer program for upmixing a downmix audio signal
US8892052B2 (en) * 2009-03-03 2014-11-18 Agency For Science, Technology And Research Methods for determining whether a signal includes a wanted signal and apparatuses configured to determine whether a signal includes a wanted signal
US8666752B2 (en) * 2009-03-18 2014-03-04 Samsung Electronics Co., Ltd. Apparatus and method for encoding and decoding multi-channel signal
AU2010233863B2 (en) * 2009-04-08 2013-09-26 Fraunhofer-Gesellschaft Zur Foerderung Der Angewandten Forschung E.V. Apparatus, method and computer program for upmixing a downmix audio signal using a phase value smoothing
CN101533641B (en) 2009-04-20 2011-07-20 华为技术有限公司 Method for correcting channel delay parameters of multichannel signals and device
CN102307323B (en) * 2009-04-20 2013-12-18 华为技术有限公司 Method for modifying sound channel delay parameter of multi-channel signal
CN101556799B (en) * 2009-05-14 2013-08-28 华为技术有限公司 Audio decoding method and audio decoder
WO2011047887A1 (en) * 2009-10-21 2011-04-28 Dolby International Ab Oversampling in a combined transposer filter bank
US9105264B2 (en) 2009-07-31 2015-08-11 Panasonic Intellectual Property Management Co., Ltd. Coding apparatus and decoding apparatus
US8538042B2 (en) 2009-08-11 2013-09-17 Dts Llc System for increasing perceived loudness of speakers
KR101599884B1 (en) * 2009-08-18 2016-03-04 삼성전자주식회사 Method and apparatus for decoding multi-channel audio
MX2012004564A (en) 2009-10-20 2012-06-08 Fraunhofer Ges Forschung Audio encoder, audio decoder, method for encoding an audio information, method for decoding an audio information and computer program using an iterative interval size reduction.
KR20110049068A (en) * 2009-11-04 2011-05-12 삼성전자주식회사 Method and apparatus for encoding/decoding multichannel audio signal
DE102009052992B3 (en) * 2009-11-12 2011-03-17 Institut für Rundfunktechnik GmbH Method for mixing microphone signals of a multi-microphone sound recording
US9324337B2 (en) * 2009-11-17 2016-04-26 Dolby Laboratories Licensing Corporation Method and system for dialog enhancement
CN103854651B (en) * 2009-12-16 2017-04-12 杜比国际公司 Sbr bitstream parameter downmix
FR2954640B1 (en) * 2009-12-23 2012-01-20 Arkamys METHOD FOR OPTIMIZING STEREO RECEPTION FOR ANALOG RADIO AND ANALOG RADIO RECEIVER
EP2524371B1 (en) 2010-01-12 2016-12-07 Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V. Audio encoder, audio decoder, method for encoding an audio information, method for decoding an audio information and computer program using a hash table describing both significant state values and interval boundaries
CN102741920B (en) * 2010-02-01 2014-07-30 伦斯莱尔工艺研究院 Decorrelating audio signals for stereophonic and surround sound using coded and maximum-length-class sequences
TWI443646B (en) * 2010-02-18 2014-07-01 Dolby Lab Licensing Corp Audio decoder and decoding method using efficient downmixing
US8428209B2 (en) * 2010-03-02 2013-04-23 Vt Idirect, Inc. System, apparatus, and method of frequency offset estimation and correction for mobile remotes in a communication network
JP5604933B2 (en) * 2010-03-30 2014-10-15 富士通株式会社 Downmix apparatus and downmix method
KR20110116079A (en) 2010-04-17 2011-10-25 삼성전자주식회사 Apparatus for encoding/decoding multichannel signal and method thereof
WO2012006770A1 (en) * 2010-07-12 2012-01-19 Huawei Technologies Co., Ltd. Audio signal generator
JP6075743B2 (en) * 2010-08-03 2017-02-08 ソニー株式会社 Signal processing apparatus and method, and program
AU2011295368B2 (en) * 2010-08-25 2015-05-07 Fraunhofer-Gesellschaft Zur Foerderung Der Angewandten Forschung E.V. Apparatus for generating a decorrelated signal using transmitted phase information
KR101697550B1 (en) * 2010-09-16 2017-02-02 삼성전자주식회사 Apparatus and method for bandwidth extension for multi-channel audio
US9607131B2 (en) 2010-09-16 2017-03-28 Verance Corporation Secure and efficient content screening in a networked environment
US9008811B2 (en) 2010-09-17 2015-04-14 Xiph.org Foundation Methods and systems for adaptive time-frequency resolution in digital data coding
EP2612321B1 (en) 2010-09-28 2016-01-06 Huawei Technologies Co., Ltd. Device and method for postprocessing decoded multi-channel audio signal or decoded stereo signal
JP5533502B2 (en) * 2010-09-28 2014-06-25 富士通株式会社 Audio encoding apparatus, audio encoding method, and audio encoding computer program
DK2975610T3 (en) * 2010-11-22 2019-05-27 Ntt Docomo Inc AUDIO CODING DEVICE AND PROCEDURE
TWI496461B (en) * 2010-12-03 2015-08-11 Dolby Lab Licensing Corp Adaptive processing with multiple media processing nodes
EP2464145A1 (en) 2010-12-10 2012-06-13 Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V. Apparatus and method for decomposing an input signal using a downmixer
EP2477188A1 (en) * 2011-01-18 2012-07-18 Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V. Encoding and decoding of slot positions of events in an audio signal frame
WO2012122303A1 (en) 2011-03-07 2012-09-13 Xiph. Org Method and system for two-step spreading for tonal artifact avoidance in audio coding
US9009036B2 (en) 2011-03-07 2015-04-14 Xiph.org Foundation Methods and systems for bit allocation and partitioning in gain-shape vector quantization for audio coding
WO2012122297A1 (en) * 2011-03-07 2012-09-13 Xiph. Org. Methods and systems for avoiding partial collapse in multi-block audio coding
RU2595912C2 (en) 2011-05-26 2016-08-27 Конинклейке Филипс Н.В. Audio system and method therefor
US9129607B2 (en) 2011-06-28 2015-09-08 Adobe Systems Incorporated Method and apparatus for combining digital signals
EP2727105B1 (en) * 2011-06-30 2015-08-12 Telefonaktiebolaget LM Ericsson (PUBL) Transform audio codec and methods for encoding and decoding a time segment of an audio signal
US8682026B2 (en) 2011-11-03 2014-03-25 Verance Corporation Efficient extraction of embedded watermarks in the presence of host content distortions
US8615104B2 (en) 2011-11-03 2013-12-24 Verance Corporation Watermark extraction based on tentative watermarks
US8923548B2 (en) 2011-11-03 2014-12-30 Verance Corporation Extraction of embedded watermarks from a host content using a plurality of tentative watermarks
US8533481B2 (en) 2011-11-03 2013-09-10 Verance Corporation Extraction of embedded watermarks from a host content based on extrapolation techniques
US8745403B2 (en) 2011-11-23 2014-06-03 Verance Corporation Enhanced content management based on watermark extraction records
US9547753B2 (en) 2011-12-13 2017-01-17 Verance Corporation Coordinated watermarking
US9323902B2 (en) 2011-12-13 2016-04-26 Verance Corporation Conditional access using embedded watermarks
WO2013150341A1 (en) 2012-04-05 2013-10-10 Nokia Corporation Flexible spatial audio capture apparatus
US9312829B2 (en) 2012-04-12 2016-04-12 Dts Llc System for adjusting loudness of audio signals in real time
US9571606B2 (en) 2012-08-31 2017-02-14 Verance Corporation Social media viewing system
DK2894861T3 (en) * 2012-09-07 2020-02-10 Saturn Licensing Llc TRANSFER DEVICE, TRANSFER PROCEDURE, RECEIVER DEVICE AND RECEIVE PROCEDURE
US9106964B2 (en) 2012-09-13 2015-08-11 Verance Corporation Enhanced content distribution using advertisements
US8869222B2 (en) 2012-09-13 2014-10-21 Verance Corporation Second screen content
US8726304B2 (en) 2012-09-13 2014-05-13 Verance Corporation Time varying evaluation of multimedia content
US9269363B2 (en) * 2012-11-02 2016-02-23 Dolby Laboratories Licensing Corporation Audio data hiding based on perceptual masking and detection based on code multiplexing
US9191516B2 (en) * 2013-02-20 2015-11-17 Qualcomm Incorporated Teleconferencing using steganographically-embedded audio data
US9262794B2 (en) 2013-03-14 2016-02-16 Verance Corporation Transactional video marking system
WO2014159898A1 (en) * 2013-03-29 2014-10-02 Dolby Laboratories Licensing Corporation Methods and apparatuses for generating and using low-resolution preview tracks with high-quality encoded object and multichannel audio signals
WO2014162171A1 (en) 2013-04-04 2014-10-09 Nokia Corporation Visual audio processing apparatus
EP3217398B1 (en) * 2013-04-05 2019-08-14 Dolby International AB Advanced quantizer
TWI546799B (en) * 2013-04-05 2016-08-21 杜比國際公司 Audio encoder and decoder
KR20160111042A (en) 2013-04-05 2016-09-23 돌비 인터네셔널 에이비 Stereo audio encoder and decoder
WO2014184618A1 (en) 2013-05-17 2014-11-20 Nokia Corporation Spatial object oriented audio apparatus
JP6305694B2 (en) * 2013-05-31 2018-04-04 クラリオン株式会社 Signal processing apparatus and signal processing method
EP3017446B1 (en) 2013-07-05 2021-08-25 Dolby International AB Enhanced soundfield coding using parametric component generation
FR3008533A1 (en) * 2013-07-12 2015-01-16 Orange OPTIMIZED SCALE FACTOR FOR FREQUENCY BAND EXTENSION IN AUDIO FREQUENCY SIGNAL DECODER
PT3022949T (en) 2013-07-22 2018-01-23 Fraunhofer Ges Forschung Multi-channel audio decoder, multi-channel audio encoder, methods, computer program and encoded audio representation using a decorrelation of rendered audio signals
EP2830336A3 (en) 2013-07-22 2015-03-04 Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V. Renderer controlled spatial upmix
EP2830333A1 (en) 2013-07-22 2015-01-28 Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V. Multi-channel decorrelator, multi-channel audio decoder, multi-channel audio encoder, methods and computer program using a premix of decorrelator input signals
EP2830063A1 (en) 2013-07-22 2015-01-28 Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V. Apparatus, method and computer program for decoding an encoded audio signal
EP2838086A1 (en) 2013-07-22 2015-02-18 Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V. In an reduction of comb filter artifacts in multi-channel downmix with adaptive phase alignment
EP2830332A3 (en) 2013-07-22 2015-03-11 Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V. Method, signal processing unit, and computer program for mapping a plurality of input channels of an input channel configuration to output channels of an output channel configuration
US9251549B2 (en) 2013-07-23 2016-02-02 Verance Corporation Watermark extractor enhancements based on payload ranking
US9489952B2 (en) * 2013-09-11 2016-11-08 Bally Gaming, Inc. Wagering game having seamless looping of compressed audio
JP6212645B2 (en) 2013-09-12 2017-10-11 ドルビー・インターナショナル・アーベー Audio decoding system and audio encoding system
KR102215129B1 (en) * 2013-09-17 2021-02-10 주식회사 윌러스표준기술연구소 Method and apparatus for processing audio signals
TWI557724B (en) * 2013-09-27 2016-11-11 杜比實驗室特許公司 A method for encoding an n-channel audio program, a method for recovery of m channels of an n-channel audio program, an audio encoder configured to encode an n-channel audio program and a decoder configured to implement recovery of an n-channel audio pro
ES2659019T3 (en) 2013-10-21 2018-03-13 Dolby International Ab Structure of de-correlator for parametric reconstruction of audio signals
CN105874819B (en) 2013-10-22 2018-04-10 韩国电子通信研究院 Generate the method and its parametrization device of the wave filter for audio signal
EP2866227A1 (en) * 2013-10-22 2015-04-29 Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V. Method for decoding and encoding a downmix matrix, method for presenting audio content, encoder and decoder for a downmix matrix, audio encoder and audio decoder
US9208334B2 (en) 2013-10-25 2015-12-08 Verance Corporation Content management using multiple abstraction layers
CN108922552B (en) 2013-12-23 2023-08-29 韦勒斯标准与技术协会公司 Method for generating a filter for an audio signal and parameterization device therefor
CN103730112B (en) * 2013-12-25 2016-08-31 讯飞智元信息科技有限公司 Multi-channel voice simulation and acquisition method
US9564136B2 (en) * 2014-03-06 2017-02-07 Dts, Inc. Post-encoding bitrate reduction of multiple object audio
US9596521B2 (en) 2014-03-13 2017-03-14 Verance Corporation Interactive content acquisition using embedded codes
CN108600935B (en) 2014-03-19 2020-11-03 韦勒斯标准与技术协会公司 Audio signal processing method and apparatus
EP3128766A4 (en) 2014-04-02 2018-01-03 Wilus Institute of Standards and Technology Inc. Audio signal processing method and device
WO2015170539A1 (en) * 2014-05-08 2015-11-12 株式会社村田製作所 Resin multilayer substrate and method for producing same
JP6641304B2 (en) * 2014-06-27 2020-02-05 ドルビー・インターナショナル・アーベー Apparatus for determining the minimum number of integer bits required to represent a non-differential gain value for compression of a HOA data frame representation
EP4057280A1 (en) * 2014-06-27 2022-09-14 Dolby International AB Method for determining for the compression of an hoa data frame representation a lowest integer number of bits required for representing non-differential gain values
EP2980801A1 (en) * 2014-07-28 2016-02-03 Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V. Method for estimating noise in an audio signal, noise estimator, audio encoder, audio decoder, and system for transmitting audio signals
BR112017006325B1 (en) 2014-10-02 2023-12-26 Dolby International Ab DECODING METHOD AND DECODER FOR DIALOGUE HIGHLIGHTING
CN107430862B (en) * 2015-02-27 2022-10-04 奥罗技术公司 Encoding and decoding of digital data sets
EP3300374B1 (en) * 2015-05-22 2022-07-06 Sony Group Corporation Transmission device, transmission method, image processing device, image processing method, receiving device, and receiving method
US10043527B1 (en) * 2015-07-17 2018-08-07 Digimarc Corporation Human auditory system modeling with masking energy adaptation
FR3048808A1 (en) * 2016-03-10 2017-09-15 Orange OPTIMIZED ENCODING AND DECODING OF SPATIALIZATION INFORMATION FOR PARAMETRIC CODING AND DECODING OF A MULTICANAL AUDIO SIGNAL
JP6790114B2 (en) 2016-03-18 2020-11-25 フラウンホッファー−ゲゼルシャフト ツァ フェルダールング デァ アンゲヴァンテン フォアシュンク エー.ファオ Encoding by restoring phase information using a structured tensor based on audio spectrogram
CN107731238B (en) * 2016-08-10 2021-07-16 华为技术有限公司 Coding method and coder for multi-channel signal
CN107886960B (en) * 2016-09-30 2020-12-01 华为技术有限公司 Audio signal reconstruction method and device
US10362423B2 (en) * 2016-10-13 2019-07-23 Qualcomm Incorporated Parametric audio decoding
EP4167233A1 (en) * 2016-11-08 2023-04-19 Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V. Apparatus and method for encoding or decoding a multichannel signal using a side gain and a residual gain
MX2019005805A (en) 2016-11-23 2019-08-12 Ericsson Telefon Ab L M Method and apparatus for adaptive control of decorrelation filters.
US10210874B2 (en) * 2017-02-03 2019-02-19 Qualcomm Incorporated Multi channel coding
EP3616196A4 (en) 2017-04-28 2021-01-20 DTS, Inc. Audio coder window and transform implementations
CN107274907A (en) * 2017-07-03 2017-10-20 北京小鱼在家科技有限公司 The method and apparatus that directive property pickup is realized in dual microphone equipment
AU2018308668A1 (en) 2017-07-28 2020-02-06 Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V. Apparatus for encoding or decoding an encoded multichannel signal using a filling signal generated by a broad band filter
KR102489914B1 (en) 2017-09-15 2023-01-20 삼성전자주식회사 Electronic Device and method for controlling the electronic device
US10854209B2 (en) * 2017-10-03 2020-12-01 Qualcomm Incorporated Multi-stream audio coding
EP3483879A1 (en) 2017-11-10 2019-05-15 Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V. Analysis/synthesis windowing function for modulated lapped transformation
EP3483880A1 (en) 2017-11-10 2019-05-15 Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V. Temporal noise shaping
WO2019091576A1 (en) 2017-11-10 2019-05-16 Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V. Audio encoders, audio decoders, methods and computer programs adapting an encoding and decoding of least significant bits
EP3483883A1 (en) 2017-11-10 2019-05-15 Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V. Audio coding and decoding with selective postfiltering
EP3483886A1 (en) 2017-11-10 2019-05-15 Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V. Selecting pitch lag
EP3483878A1 (en) 2017-11-10 2019-05-15 Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V. Audio decoder supporting a set of different loss concealment tools
EP3483884A1 (en) 2017-11-10 2019-05-15 Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V. Signal filtering
EP3483882A1 (en) 2017-11-10 2019-05-15 Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V. Controlling bandwidth in encoders and/or decoders
WO2019091573A1 (en) * 2017-11-10 2019-05-16 Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V. Apparatus and method for encoding and decoding an audio signal using downsampling or interpolation of scale parameters
CN111316353B (en) * 2017-11-10 2023-11-17 诺基亚技术有限公司 Determining spatial audio parameter coding and associated decoding
US10306391B1 (en) 2017-12-18 2019-05-28 Apple Inc. Stereophonic to monophonic down-mixing
CN111670473A (en) 2017-12-19 2020-09-15 杜比国际公司 Method and apparatus for unified speech and audio decoding QMF-based harmonic transposition shifter improvements
TWI812658B (en) * 2017-12-19 2023-08-21 瑞典商都比國際公司 Methods, apparatus and systems for unified speech and audio decoding and encoding decorrelation filter improvements
KR20200099561A (en) 2017-12-19 2020-08-24 돌비 인터네셔널 에이비 Methods, devices and systems for improved integrated speech and audio decoding and encoding
TWI702594B (en) 2018-01-26 2020-08-21 瑞典商都比國際公司 Backward-compatible integration of high frequency reconstruction techniques for audio signals
WO2019195269A1 (en) * 2018-04-04 2019-10-10 Harman International Industries, Incorporated Dynamic audio upmixer parameters for simulating natural spatial variations
US11544032B2 (en) * 2019-01-24 2023-01-03 Dolby Laboratories Licensing Corporation Audio connection and transmission device
MX2021010570A (en) * 2019-03-06 2021-10-13 Fraunhofer Ges Forschung Downmixer and method of downmixing.
WO2020216459A1 (en) * 2019-04-23 2020-10-29 Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V. Apparatus, method or computer program for generating an output downmix representation
US11056114B2 (en) * 2019-05-30 2021-07-06 International Business Machines Corporation Voice response interfacing with multiple smart devices of different types
CN112218020B (en) * 2019-07-09 2023-03-21 海信视像科技股份有限公司 Audio data transmission method and device for multi-channel platform
US11270712B2 (en) 2019-08-28 2022-03-08 Insoundz Ltd. System and method for separation of audio sources that interfere with each other using a microphone array
DE102019219922B4 (en) 2019-12-17 2023-07-20 Volkswagen Aktiengesellschaft Method for transmitting a plurality of signals and method for receiving a plurality of signals
CN112153535B (en) * 2020-09-03 2022-04-08 Oppo广东移动通信有限公司 Sound field expansion method, circuit, electronic equipment and storage medium
TWI772930B (en) * 2020-10-21 2022-08-01 美商音美得股份有限公司 Analysis filter bank and computing procedure thereof, analysis filter bank based signal processing system and procedure suitable for real-time applications
CN112309419B (en) * 2020-10-30 2023-05-02 浙江蓝鸽科技有限公司 Noise reduction and output method and system for multipath audio
CN112584300B (en) * 2020-12-28 2023-05-30 科大讯飞(苏州)科技有限公司 Audio upmixing method, device, electronic equipment and storage medium
CN112566008A (en) * 2020-12-28 2021-03-26 科大讯飞(苏州)科技有限公司 Audio upmixing method and device, electronic equipment and storage medium
US11837244B2 (en) 2021-03-29 2023-12-05 Invictumtech Inc. Analysis filter bank and computing procedure thereof, analysis filter bank based signal processing system and procedure suitable for real-time applications
US20220399026A1 (en) * 2021-06-11 2022-12-15 Nuance Communications, Inc. System and Method for Self-attention-based Combining of Multichannel Signals for Speech Processing

Citations (104)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US1124580A (en) 1911-07-03 1915-01-12 Edward H Amet Method of and means for localizing sound reproduction.
US1850130A (en) 1928-10-31 1932-03-22 American Telephone & Telegraph Talking moving picture system
US1855147A (en) 1929-01-11 1932-04-19 Jones W Bartlett Distortion in sound transmission
US2114680A (en) 1934-12-24 1938-04-19 Rca Corp System for the reproduction of sound
US2819342A (en) 1954-12-30 1958-01-07 Bell Telephone Labor Inc Monaural-binaural transmission of sound
US2860541A (en) 1954-04-27 1958-11-18 Vitarama Corp Wireless control for recording sound for stereophonic reproduction
US2927963A (en) 1955-01-04 1960-03-08 Jordan Robert Oakes Single channel binaural or stereo-phonic sound system
US3046337A (en) 1957-08-05 1962-07-24 Hamner Electronics Company Inc Stereophonic sound
US3067292A (en) 1958-02-03 1962-12-04 Jerry B Minter Stereophonic sound transmission and reproduction
US3846719A (en) 1973-09-13 1974-11-05 Dolby Laboratories Inc Noise reduction systems
US4308424A (en) 1980-04-14 1981-12-29 Bice Jr Robert G Simulated stereo from a monaural source sound reproduction system
US4359605A (en) 1979-11-01 1982-11-16 Victor Company Of Japan, Ltd. Monaural signal to artificial stereo signals convertings and processing circuit for headphones
US4464784A (en) 1981-04-30 1984-08-07 Eventide Clockworks, Inc. Pitch changer with glitch minimizer
US4624009A (en) 1980-05-02 1986-11-18 Figgie International, Inc. Signal pattern encoder and classifier
US4799260A (en) 1985-03-07 1989-01-17 Dolby Laboratories Licensing Corporation Variable matrix decoder
US4922535A (en) 1986-03-03 1990-05-01 Dolby Ray Milton Transient control aspects of circuit arrangements for altering the dynamic range of audio signals
EP0372155A2 (en) 1988-12-09 1990-06-13 John J. Karamon Method and system for synchronization of an auxiliary sound source which may contain multiple language channels to motion picture film, video tape, or other picture source containing a sound track
US4941177A (en) 1985-03-07 1990-07-10 Dolby Laboratories Licensing Corporation Variable matrix decoder
US5040081A (en) 1986-09-23 1991-08-13 Mccutchen David Audiovisual synchronization signal generator using audio signature comparison
US5046098A (en) 1985-03-07 1991-09-03 Dolby Laboratories Licensing Corporation Variable matrix decoder with three output channels
WO1991020164A1 (en) 1990-06-15 1991-12-26 Auris Corp. Method for eliminating the precedence effect in stereophonic sound systems and recording made with said method
WO1991019989A1 (en) 1990-06-21 1991-12-26 Reynolds Software, Inc. Method and apparatus for wave analysis and event recognition
US5105462A (en) 1989-08-28 1992-04-14 Qsound Ltd. Sound imaging method and apparatus
US5121433A (en) * 1990-06-15 1992-06-09 Auris Corp. Apparatus and method for controlling the magnitude spectrum of acoustically combined signals
US5164840A (en) 1988-08-29 1992-11-17 Matsushita Electric Industrial Co., Ltd. Apparatus for supplying control codes to sound field reproduction apparatus
US5172415A (en) 1990-06-08 1992-12-15 Fosgate James W Surround processor
EP0525544A2 (en) 1991-07-23 1993-02-03 Siemens Rolm Communications Inc. (a Delaware corp.) Method for time-scale modification of signals
US5235646A (en) * 1990-06-15 1993-08-10 Wilde Martin D Method and apparatus for creating de-correlated audio output signals and audio recordings made thereby
US5274740A (en) 1991-01-08 1993-12-28 Dolby Laboratories Licensing Corporation Decoder for variable number of channel presentation of multidimensional sound fields
US5394473A (en) 1990-04-12 1995-02-28 Dolby Laboratories Licensing Corporation Adaptive-block-length, adaptive-transforn, and adaptive-window transform coder, decoder, and encoder/decoder for high-quality audio
US5394472A (en) * 1993-08-09 1995-02-28 Richard G. Broadie Monaural to stereo sound translation process and apparatus
US5428687A (en) 1990-06-08 1995-06-27 James W. Fosgate Control voltage generator multiplier and one-shot for integrated surround sound processor
US5463424A (en) * 1993-08-03 1995-10-31 Dolby Laboratories Licensing Corporation Multi-channel transmitter/receiver system providing matrix-decoding compatible signals
US5504819A (en) 1990-06-08 1996-04-02 Harman International Industries, Inc. Surround sound processor with improved control voltage generator
CN1130961A (en) 1994-06-13 1996-09-11 索尼公司 Method and device for encoding signal, method and device for decoding signal, recording medium, and signal transmitting device
US5583963A (en) 1993-01-21 1996-12-10 France Telecom System for predictive coding/decoding of a digital speech signal by embedded-code adaptive transform
US5621855A (en) 1991-02-01 1997-04-15 U.S. Philips Corporation Subband coding of a digital signal in a stereo intensity mode
US5625696A (en) 1990-06-08 1997-04-29 Harman International Industries, Inc. Six-axis surround sound processor with improved matrix and cancellation control
US5633981A (en) 1991-01-08 1997-05-27 Dolby Laboratories Licensing Corporation Method and apparatus for adjusting dynamic range and gain in an encoder/decoder for multidimensional sound fields
US5659619A (en) * 1994-05-11 1997-08-19 Aureal Semiconductor, Inc. Three-dimensional virtual audio display employing reduced complexity imaging filters
US5727119A (en) 1995-03-27 1998-03-10 Dolby Laboratories Licensing Corporation Method and apparatus for efficient implementation of single-sideband filter banks providing accurate measures of spectral magnitude and phase
JPH1074097A (en) 1996-07-26 1998-03-17 Ind Technol Res Inst Parameter changing method and device for audio signal
US5742689A (en) * 1996-01-04 1998-04-21 Virtual Listening Systems, Inc. Method and device for processing a multichannel signal for use with a headphone
WO1998020482A1 (en) 1996-11-07 1998-05-14 Creative Technology Ltd. Time-domain time/pitch scaling of speech or audio signals, with transient handling
US5857026A (en) * 1996-03-26 1999-01-05 Scheiber; Peter Space-mapping sound system
US5862228A (en) 1997-02-21 1999-01-19 Dolby Laboratories Licensing Corporation Audio matrix encoding
US5870480A (en) * 1996-07-19 1999-02-09 Lexicon Multichannel active matrix encoder and decoder with maximum lateral separation
US5890125A (en) * 1997-07-16 1999-03-30 Dolby Laboratories Licensing Corporation Method and apparatus for encoding and decoding multiple audio channels at low bit rates using adaptive selection of encoding method
WO1999029114A1 (en) 1997-12-03 1999-06-10 At & T Corp. Electronic watermarking in the compressed domain utilizing perceptual coding
US5956674A (en) * 1995-12-01 1999-09-21 Digital Theater Systems, Inc. Multi-channel predictive subband audio coder using psychoacoustic adaptive bit allocation in frequency, time and over the multiple channels
WO2000019414A1 (en) 1998-09-26 2000-04-06 Liquid Audio, Inc. Audio encoding apparatus and methods
USRE36714E (en) 1989-10-18 2000-05-23 Lucent Technologies Inc. Perceptual coding of audio signals
WO2000045378A2 (en) 1999-01-27 2000-08-03 Lars Gustaf Liljeryd Efficient spectral envelope coding using variable time/frequency resolution and time/frequency switching
US6211919B1 (en) 1997-03-28 2001-04-03 Tektronix, Inc. Transparent embedment of data in a video signal
WO2001035389A1 (en) 1999-11-11 2001-05-17 Koninklijke Philips Electronics N.V. Tone features for speech recognition
WO2001041505A1 (en) 1999-12-03 2001-06-07 Dolby Laboratories Licensing Corporation Method and apparatus for deriving at least one audio signal from two or more input audio signals
WO2001041504A1 (en) 1999-12-03 2001-06-07 Dolby Laboratories Licensing Corporation Method for deriving at least three audio signals from two input audio signals
US20010027393A1 (en) 1999-12-08 2001-10-04 Touimi Abdellatif Benjelloun Method of and apparatus for processing at least one coded binary audio flux organized into frames
US20010032087A1 (en) * 2000-03-15 2001-10-18 Oomen Arnoldus Werner Johannes Audio coding
US20010038643A1 (en) 1998-07-29 2001-11-08 British Broadcasting Corporation Method for inserting auxiliary data in an audio data stream
WO2002015587A2 (en) 2000-08-16 2002-02-21 Dolby Laboratories Licensing Corporation Modulating one or more parameters of an audio or video perceptual coding system in response to supplemental information
WO2002019768A2 (en) 2000-08-31 2002-03-07 Dolby Laboratories Licensing Corporation Method for apparatus for audio matrix decoding
US6430533B1 (en) 1996-05-03 2002-08-06 Lsi Logic Corporation Audio decoder core MPEG-1/MPEG-2/AC-3 functional algorithm partitioning and implementation
WO2002063925A2 (en) 2001-02-07 2002-08-15 Dolby Laboratories Licensing Corporation Audio channel translation
WO2002084645A2 (en) 2001-04-13 2002-10-24 Dolby Laboratories Licensing Corporation High quality time-scaling and pitch-scaling of audio signals
WO2002093560A1 (en) 2001-05-10 2002-11-21 Dolby Laboratories Licensing Corporation Improving transient performance of low bit rate audio coding systems by reducing pre-noise
WO2002097791A1 (en) 2001-05-25 2002-12-05 Dolby Laboratories Licensing Corporation Method for time aligning audio signals using characterizations based on auditory events
WO2002097790A1 (en) 2001-05-25 2002-12-05 Dolby Laboratories Licensing Corporation Comparing audio using characterizations based on auditory events
US20030035553A1 (en) 2001-08-10 2003-02-20 Frank Baumgarte Backwards-compatible perceptual coding of spatial cues
WO2003069954A2 (en) 2002-02-18 2003-08-21 Koninklijke Philips Electronics N.V. Parametric audio coding
WO2003090208A1 (en) 2002-04-22 2003-10-30 Koninklijke Philips Electronics N.V. pARAMETRIC REPRESENTATION OF SPATIAL AUDIO
US6658117B2 (en) * 1998-11-12 2003-12-02 Yamaha Corporation Sound field effect control apparatus and method
US20030236583A1 (en) * 2002-06-24 2003-12-25 Frank Baumgarte Hybrid multi-channel/cue coding/decoding of audio signals
TW200400488A (en) 2002-06-28 2004-01-01 Samsung Electronics Co Ltd Voice recognition device, observation probability calculating device, complex fast fourier transform calculation device and method, cache device, and method of controlling the cache device
WO2004008806A1 (en) * 2002-07-16 2004-01-22 Koninklijke Philips Electronics N.V. Audio coding
US20040037421A1 (en) 2001-12-17 2004-02-26 Truman Michael Mead Parital encryption of assembled bitstreams
US20040044525A1 (en) 2002-08-30 2004-03-04 Vinton Mark Stuart Controlling loudness of speech in signals that contain speech and other types of audio material
WO2004019656A2 (en) 2001-02-07 2004-03-04 Dolby Laboratories Licensing Corporation Audio channel spatial translation
US20040122662A1 (en) 2002-02-12 2004-06-24 Crockett Brett Greham High quality time-scaling and pitch-scaling of audio signals
US20040148159A1 (en) 2001-04-13 2004-07-29 Crockett Brett G Method for time aligning audio signals using characterizations based on auditory events
WO2004073178A2 (en) 2003-02-06 2004-08-26 Dolby Laboratories Licensing Corporation Continuous backup audio
US20040165730A1 (en) 2001-04-13 2004-08-26 Crockett Brett G Segmenting audio signals into auditory events
US20040184537A1 (en) 2002-08-09 2004-09-23 Ralf Geiger Method and apparatus for scalable encoding and method and apparatus for scalable decoding
US6807528B1 (en) 2001-05-08 2004-10-19 Dolby Laboratories Licensing Corporation Adding data to a compressed data frame
WO2004111994A2 (en) 2003-05-28 2004-12-23 Dolby Laboratories Licensing Corporation Method, apparatus and computer program for calculating and adjusting the perceived loudness of an audio signal
TW200501056A (en) 2002-11-19 2005-01-01 Yamaha Corp Interchange format of voice data in music file
US20050078840A1 (en) 2003-08-25 2005-04-14 Riedl Steven E. Methods and systems for determining audio loudness levels in programming
US6931370B1 (en) * 1999-11-02 2005-08-16 Digital Theater Systems, Inc. System and method for providing interactive audio in a multi-channel audio environment
WO2005086139A1 (en) 2004-03-01 2005-09-15 Dolby Laboratories Licensing Corporation Multichannel audio coding
US20060002572A1 (en) 2004-07-01 2006-01-05 Smithers Michael J Method for correcting metadata affecting the playback loudness and dynamic range of audio information
US20060029239A1 (en) 2004-08-03 2006-02-09 Smithers Michael J Method for combining audio signals using auditory scene analysis
US20060136229A1 (en) 2004-11-02 2006-06-22 Kristofer Kjoerling Advanced methods for interpolation and parameter signalling
US20060133618A1 (en) * 2004-11-02 2006-06-22 Lars Villemoes Stereo compatible multi-channel audio coding
US20060165184A1 (en) 2004-11-02 2006-07-27 Heiko Purnhagen Audio coding using de-correlated signals
WO2006113062A1 (en) 2005-04-13 2006-10-26 Dolby Laboratories Licensing Corporation Audio metadata verification
WO2006113047A1 (en) 2005-04-13 2006-10-26 Dolby Laboratories Licensing Corporation Economical loudness measurement of coded audio
WO2006132857A2 (en) 2005-06-03 2006-12-14 Dolby Laboratories Licensing Corporation Apparatus and method for encoding audio signals with decoding instructions
WO2007016107A2 (en) 2005-08-02 2007-02-08 Dolby Laboratories Licensing Corporation Controlling spatial audio coding parameters as a function of auditory events
US20070067162A1 (en) * 2003-10-30 2007-03-22 Knoninklijke Philips Electronics N.V. Audio signal encoding or decoding
US7283954B2 (en) 2001-04-13 2007-10-16 Dolby Laboratories Licensing Corporation Comparing audio using characterizations based on auditory events
WO2007127023A1 (en) 2006-04-27 2007-11-08 Dolby Laboratories Licensing Corporation Audio gain control using specific-loudness-based auditory event detection
US7382888B2 (en) * 2000-12-12 2008-06-03 Bose Corporation Phase shifting audio signal combining
US7639823B2 (en) * 2004-03-03 2009-12-29 Agere Systems Inc. Audio mixing using magnitude equalization
US7644003B2 (en) * 2001-05-04 2010-01-05 Agere Systems Inc. Cue-based audio coding/decoding

Family Cites Families (55)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US554334A (en) * 1896-02-11 Folding or portable stove
US4308719A (en) * 1979-08-09 1982-01-05 Abrahamson Daniel P Fluid power system
US4932059A (en) * 1988-01-11 1990-06-05 Fosgate Inc. Variable matrix decoder for periphonic reproduction of sound
JPH0525025A (en) * 1991-07-22 1993-02-02 Kao Corp Hair-care cosmetics
US5173944A (en) * 1992-01-29 1992-12-22 The United States Of America As Represented By The Administrator Of The National Aeronautics And Space Administration Head related transfer function pseudo-stereophony
JPH09102742A (en) * 1995-10-05 1997-04-15 Sony Corp Encoding method and device, decoding method and device and recording medium
KR100356109B1 (en) 1996-01-19 2002-11-18 헬무트 칼 Electrically Screening Housing
US6111958A (en) * 1997-03-21 2000-08-29 Euphonics, Incorporated Audio spatial enhancement apparatus and methods
TW384434B (en) * 1997-03-31 2000-03-11 Sony Corp Encoding method, device therefor, decoding method, device therefor and recording medium
JPH1132399A (en) * 1997-05-13 1999-02-02 Sony Corp Coding method and system and recording medium
KR100335611B1 (en) * 1997-11-20 2002-10-09 삼성전자 주식회사 Scalable stereo audio encoding/decoding method and apparatus
TW358925B (en) * 1997-12-31 1999-05-21 Ind Tech Res Inst Improvement of oscillation encoding of a low bit rate sine conversion language encoder
TW374152B (en) * 1998-03-17 1999-11-11 Aurix Ltd Voice analysis system
GB2343347B (en) * 1998-06-20 2002-12-31 Central Research Lab Ltd A method of synthesising an audio signal
MY123651A (en) 1999-04-07 2006-05-31 Dolby Laboratories Licensing Corp Matrix improvements to lossless encoding and decoding
EP1054575A3 (en) * 1999-05-17 2002-09-18 Bose Corporation Directional decoding
US6389562B1 (en) * 1999-06-29 2002-05-14 Sony Corporation Source code shuffling to provide for robust error recovery
US7184556B1 (en) * 1999-08-11 2007-02-27 Microsoft Corporation Compensation system and method for sound reproduction
US6920223B1 (en) 1999-12-03 2005-07-19 Dolby Laboratories Licensing Corporation Method for deriving at least three audio signals from two input audio signals
US7212872B1 (en) * 2000-05-10 2007-05-01 Dts, Inc. Discrete multichannel audio with a backward compatible mix
US7076071B2 (en) * 2000-06-12 2006-07-11 Robert A. Katz Process for enhancing the existing ambience, imaging, depth, clarity and spaciousness of sound recordings
ES2461167T3 (en) * 2000-07-19 2014-05-19 Koninklijke Philips N.V. Multi-channel stereo converter to derive a stereo surround signal and / or audio center
US20020054685A1 (en) * 2000-11-09 2002-05-09 Carlos Avendano System for suppressing acoustic echoes and interferences in multi-channel audio systems
US20040062401A1 (en) 2002-02-07 2004-04-01 Davis Mark Franklin Audio channel translation
US7660424B2 (en) 2001-02-07 2010-02-09 Dolby Laboratories Licensing Corporation Audio channel spatial translation
US7254239B2 (en) * 2001-02-09 2007-08-07 Thx Ltd. Sound system and method of sound reproduction
JP3404024B2 (en) * 2001-02-27 2003-05-06 三菱電機株式会社 Audio encoding method and audio encoding device
US7583805B2 (en) * 2004-02-12 2009-09-01 Agere Systems Inc. Late reverberation-based synthesis of auditory scenes
US7006636B2 (en) * 2002-05-24 2006-02-28 Agere Systems Inc. Coherence-based audio coding and synthesis
TW552580B (en) * 2001-05-11 2003-09-11 Syntek Semiconductor Co Ltd Fast ADPCM method and minimum logic implementation circuit
TW556153B (en) * 2001-06-01 2003-10-01 Syntek Semiconductor Co Ltd Fast adaptive differential pulse coding modulation method for random access and channel noise resistance
TW569551B (en) * 2001-09-25 2004-01-01 Roger Wallace Dressler Method and apparatus for multichannel logic matrix decoding
TW526466B (en) * 2001-10-26 2003-04-01 Inventec Besta Co Ltd Encoding and voice integration method of phoneme
US20050004791A1 (en) * 2001-11-23 2005-01-06 Van De Kerkhof Leon Maria Perceptual noise substitution
US7240001B2 (en) * 2001-12-14 2007-07-03 Microsoft Corporation Quality improvement techniques in an audio encoder
EP1349386B1 (en) 2002-02-26 2012-10-24 Broadcom Corporation Method and apparatus of performing sample rate conversion of a multi-channel audio signal
US7599835B2 (en) 2002-03-08 2009-10-06 Nippon Telegraph And Telephone Corporation Digital signal encoding method, decoding method, encoding device, decoding device, digital signal encoding program, and decoding program
DE10217567A1 (en) 2002-04-19 2003-11-13 Infineon Technologies Ag Semiconductor component with an integrated capacitance structure and method for its production
DE60311794T2 (en) * 2002-04-22 2007-10-31 Koninklijke Philips Electronics N.V. SIGNAL SYNTHESIS
US7428440B2 (en) * 2002-04-23 2008-09-23 Realnetworks, Inc. Method and apparatus for preserving matrix surround information in encoded audio/video
WO2003094369A2 (en) * 2002-05-03 2003-11-13 Harman International Industries, Incorporated Multi-channel downmixing device
US7567845B1 (en) * 2002-06-04 2009-07-28 Creative Technology Ltd Ambience generation for stereo signals
US7257231B1 (en) * 2002-06-04 2007-08-14 Creative Technology Ltd. Stream segregation for stereo signals
US7536305B2 (en) * 2002-09-04 2009-05-19 Microsoft Corporation Mixed lossless audio compression
WO2004080125A1 (en) * 2003-03-04 2004-09-16 Nokia Corporation Support of a multichannel audio extension
KR100493172B1 (en) * 2003-03-06 2005-06-02 삼성전자주식회사 Microphone array structure, method and apparatus for beamforming with constant directivity and method and apparatus for estimating direction of arrival, employing the same
TWI223791B (en) * 2003-04-14 2004-11-11 Ind Tech Res Inst Method and system for utterance verification
US7447317B2 (en) * 2003-10-02 2008-11-04 Fraunhofer-Gesellschaft Zur Foerderung Der Angewandten Forschung E.V Compatible multi-channel coding/decoding by weighting the downmix channel
US7412380B1 (en) * 2003-12-17 2008-08-12 Creative Technology Ltd. Ambience extraction and modification for enhancement and upmix of audio signals
US7394903B2 (en) * 2004-01-20 2008-07-01 Fraunhofer-Gesellschaft Zur Forderung Der Angewandten Forschung E.V. Apparatus and method for constructing a multi-channel output signal or for generating a downmix signal
TW200742275A (en) * 2006-03-21 2007-11-01 Dolby Lab Licensing Corp Low bit rate audio encoding and decoding in which multiple channels are represented by fewer channels and auxiliary information
US7965848B2 (en) 2006-03-29 2011-06-21 Dolby International Ab Reduced number of channels decoding
JP2009117000A (en) * 2007-11-09 2009-05-28 Funai Electric Co Ltd Optical pickup
ATE518222T1 (en) 2007-11-23 2011-08-15 Michal Markiewicz ROAD TRAFFIC MONITORING SYSTEM
CN103387583B (en) * 2012-05-09 2018-04-13 中国科学院上海药物研究所 Diaryl simultaneously [a, g] quinolizine class compound, its preparation method, pharmaceutical composition and its application

Patent Citations (123)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US1124580A (en) 1911-07-03 1915-01-12 Edward H Amet Method of and means for localizing sound reproduction.
US1850130A (en) 1928-10-31 1932-03-22 American Telephone & Telegraph Talking moving picture system
US1855147A (en) 1929-01-11 1932-04-19 Jones W Bartlett Distortion in sound transmission
US2114680A (en) 1934-12-24 1938-04-19 Rca Corp System for the reproduction of sound
US2860541A (en) 1954-04-27 1958-11-18 Vitarama Corp Wireless control for recording sound for stereophonic reproduction
US2819342A (en) 1954-12-30 1958-01-07 Bell Telephone Labor Inc Monaural-binaural transmission of sound
US2927963A (en) 1955-01-04 1960-03-08 Jordan Robert Oakes Single channel binaural or stereo-phonic sound system
US3046337A (en) 1957-08-05 1962-07-24 Hamner Electronics Company Inc Stereophonic sound
US3067292A (en) 1958-02-03 1962-12-04 Jerry B Minter Stereophonic sound transmission and reproduction
US3846719A (en) 1973-09-13 1974-11-05 Dolby Laboratories Inc Noise reduction systems
US4359605A (en) 1979-11-01 1982-11-16 Victor Company Of Japan, Ltd. Monaural signal to artificial stereo signals convertings and processing circuit for headphones
US4308424A (en) 1980-04-14 1981-12-29 Bice Jr Robert G Simulated stereo from a monaural source sound reproduction system
US4624009A (en) 1980-05-02 1986-11-18 Figgie International, Inc. Signal pattern encoder and classifier
US4464784A (en) 1981-04-30 1984-08-07 Eventide Clockworks, Inc. Pitch changer with glitch minimizer
US4799260A (en) 1985-03-07 1989-01-17 Dolby Laboratories Licensing Corporation Variable matrix decoder
US5046098A (en) 1985-03-07 1991-09-03 Dolby Laboratories Licensing Corporation Variable matrix decoder with three output channels
US4941177A (en) 1985-03-07 1990-07-10 Dolby Laboratories Licensing Corporation Variable matrix decoder
US4922535A (en) 1986-03-03 1990-05-01 Dolby Ray Milton Transient control aspects of circuit arrangements for altering the dynamic range of audio signals
US5040081A (en) 1986-09-23 1991-08-13 Mccutchen David Audiovisual synchronization signal generator using audio signature comparison
US5164840A (en) 1988-08-29 1992-11-17 Matsushita Electric Industrial Co., Ltd. Apparatus for supplying control codes to sound field reproduction apparatus
EP0372155A2 (en) 1988-12-09 1990-06-13 John J. Karamon Method and system for synchronization of an auxiliary sound source which may contain multiple language channels to motion picture film, video tape, or other picture source containing a sound track
US5105462A (en) 1989-08-28 1992-04-14 Qsound Ltd. Sound imaging method and apparatus
USRE36714E (en) 1989-10-18 2000-05-23 Lucent Technologies Inc. Perceptual coding of audio signals
US5394473A (en) 1990-04-12 1995-02-28 Dolby Laboratories Licensing Corporation Adaptive-block-length, adaptive-transforn, and adaptive-window transform coder, decoder, and encoder/decoder for high-quality audio
US5504819A (en) 1990-06-08 1996-04-02 Harman International Industries, Inc. Surround sound processor with improved control voltage generator
US5172415A (en) 1990-06-08 1992-12-15 Fosgate James W Surround processor
US5644640A (en) 1990-06-08 1997-07-01 Harman International Industries, Inc. Surround sound processor with improved control voltage generator
US5625696A (en) 1990-06-08 1997-04-29 Harman International Industries, Inc. Six-axis surround sound processor with improved matrix and cancellation control
US5428687A (en) 1990-06-08 1995-06-27 James W. Fosgate Control voltage generator multiplier and one-shot for integrated surround sound processor
US5121433A (en) * 1990-06-15 1992-06-09 Auris Corp. Apparatus and method for controlling the magnitude spectrum of acoustically combined signals
US5235646A (en) * 1990-06-15 1993-08-10 Wilde Martin D Method and apparatus for creating de-correlated audio output signals and audio recordings made thereby
WO1991020164A1 (en) 1990-06-15 1991-12-26 Auris Corp. Method for eliminating the precedence effect in stereophonic sound systems and recording made with said method
WO1991019989A1 (en) 1990-06-21 1991-12-26 Reynolds Software, Inc. Method and apparatus for wave analysis and event recognition
US5400433A (en) 1991-01-08 1995-03-21 Dolby Laboratories Licensing Corporation Decoder for variable-number of channel presentation of multidimensional sound fields
US5909664A (en) 1991-01-08 1999-06-01 Ray Milton Dolby Method and apparatus for encoding and decoding audio information representing three-dimensional sound fields
US5274740A (en) 1991-01-08 1993-12-28 Dolby Laboratories Licensing Corporation Decoder for variable number of channel presentation of multidimensional sound fields
US5633981A (en) 1991-01-08 1997-05-27 Dolby Laboratories Licensing Corporation Method and apparatus for adjusting dynamic range and gain in an encoder/decoder for multidimensional sound fields
US6021386A (en) 1991-01-08 2000-02-01 Dolby Laboratories Licensing Corporation Coding method and apparatus for multiple channels of audio information representing three-dimensional sound fields
US5621855A (en) 1991-02-01 1997-04-15 U.S. Philips Corporation Subband coding of a digital signal in a stereo intensity mode
EP0525544A2 (en) 1991-07-23 1993-02-03 Siemens Rolm Communications Inc. (a Delaware corp.) Method for time-scale modification of signals
US5583963A (en) 1993-01-21 1996-12-10 France Telecom System for predictive coding/decoding of a digital speech signal by embedded-code adaptive transform
US5463424A (en) * 1993-08-03 1995-10-31 Dolby Laboratories Licensing Corporation Multi-channel transmitter/receiver system providing matrix-decoding compatible signals
US5394472A (en) * 1993-08-09 1995-02-28 Richard G. Broadie Monaural to stereo sound translation process and apparatus
US5659619A (en) * 1994-05-11 1997-08-19 Aureal Semiconductor, Inc. Three-dimensional virtual audio display employing reduced complexity imaging filters
CN1130961A (en) 1994-06-13 1996-09-11 索尼公司 Method and device for encoding signal, method and device for decoding signal, recording medium, and signal transmitting device
US5727119A (en) 1995-03-27 1998-03-10 Dolby Laboratories Licensing Corporation Method and apparatus for efficient implementation of single-sideband filter banks providing accurate measures of spectral magnitude and phase
US5956674A (en) * 1995-12-01 1999-09-21 Digital Theater Systems, Inc. Multi-channel predictive subband audio coder using psychoacoustic adaptive bit allocation in frequency, time and over the multiple channels
US5742689A (en) * 1996-01-04 1998-04-21 Virtual Listening Systems, Inc. Method and device for processing a multichannel signal for use with a headphone
US5857026A (en) * 1996-03-26 1999-01-05 Scheiber; Peter Space-mapping sound system
US6430533B1 (en) 1996-05-03 2002-08-06 Lsi Logic Corporation Audio decoder core MPEG-1/MPEG-2/AC-3 functional algorithm partitioning and implementation
US5870480A (en) * 1996-07-19 1999-02-09 Lexicon Multichannel active matrix encoder and decoder with maximum lateral separation
JPH1074097A (en) 1996-07-26 1998-03-17 Ind Technol Res Inst Parameter changing method and device for audio signal
WO1998020482A1 (en) 1996-11-07 1998-05-14 Creative Technology Ltd. Time-domain time/pitch scaling of speech or audio signals, with transient handling
US5862228A (en) 1997-02-21 1999-01-19 Dolby Laboratories Licensing Corporation Audio matrix encoding
US6211919B1 (en) 1997-03-28 2001-04-03 Tektronix, Inc. Transparent embedment of data in a video signal
US5890125A (en) * 1997-07-16 1999-03-30 Dolby Laboratories Licensing Corporation Method and apparatus for encoding and decoding multiple audio channels at low bit rates using adaptive selection of encoding method
WO1999029114A1 (en) 1997-12-03 1999-06-10 At & T Corp. Electronic watermarking in the compressed domain utilizing perceptual coding
US20010038643A1 (en) 1998-07-29 2001-11-08 British Broadcasting Corporation Method for inserting auxiliary data in an audio data stream
WO2000019414A1 (en) 1998-09-26 2000-04-06 Liquid Audio, Inc. Audio encoding apparatus and methods
US6658117B2 (en) * 1998-11-12 2003-12-02 Yamaha Corporation Sound field effect control apparatus and method
WO2000045378A2 (en) 1999-01-27 2000-08-03 Lars Gustaf Liljeryd Efficient spectral envelope coding using variable time/frequency resolution and time/frequency switching
US6931370B1 (en) * 1999-11-02 2005-08-16 Digital Theater Systems, Inc. System and method for providing interactive audio in a multi-channel audio environment
WO2001035389A1 (en) 1999-11-11 2001-05-17 Koninklijke Philips Electronics N.V. Tone features for speech recognition
TW526467B (en) 1999-11-11 2003-04-01 Koninkl Philips Electronics Nv Speech recognition system
WO2001041504A1 (en) 1999-12-03 2001-06-07 Dolby Laboratories Licensing Corporation Method for deriving at least three audio signals from two input audio signals
WO2001041505A1 (en) 1999-12-03 2001-06-07 Dolby Laboratories Licensing Corporation Method and apparatus for deriving at least one audio signal from two or more input audio signals
US20010027393A1 (en) 1999-12-08 2001-10-04 Touimi Abdellatif Benjelloun Method of and apparatus for processing at least one coded binary audio flux organized into frames
US20010032087A1 (en) * 2000-03-15 2001-10-18 Oomen Arnoldus Werner Johannes Audio coding
US6925434B2 (en) * 2000-03-15 2005-08-02 Koninklijke Philips Electronics N.V. Audio coding
WO2002015587A2 (en) 2000-08-16 2002-02-21 Dolby Laboratories Licensing Corporation Modulating one or more parameters of an audio or video perceptual coding system in response to supplemental information
WO2002019768A2 (en) 2000-08-31 2002-03-07 Dolby Laboratories Licensing Corporation Method for apparatus for audio matrix decoding
US20040125960A1 (en) 2000-08-31 2004-07-01 Fosgate James W. Method for apparatus for audio matrix decoding
US7382888B2 (en) * 2000-12-12 2008-06-03 Bose Corporation Phase shifting audio signal combining
WO2004019656A2 (en) 2001-02-07 2004-03-04 Dolby Laboratories Licensing Corporation Audio channel spatial translation
WO2002063925A2 (en) 2001-02-07 2002-08-15 Dolby Laboratories Licensing Corporation Audio channel translation
US20040148159A1 (en) 2001-04-13 2004-07-29 Crockett Brett G Method for time aligning audio signals using characterizations based on auditory events
US20040165730A1 (en) 2001-04-13 2004-08-26 Crockett Brett G Segmenting audio signals into auditory events
US7283954B2 (en) 2001-04-13 2007-10-16 Dolby Laboratories Licensing Corporation Comparing audio using characterizations based on auditory events
WO2002084645A2 (en) 2001-04-13 2002-10-24 Dolby Laboratories Licensing Corporation High quality time-scaling and pitch-scaling of audio signals
US7644003B2 (en) * 2001-05-04 2010-01-05 Agere Systems Inc. Cue-based audio coding/decoding
US6807528B1 (en) 2001-05-08 2004-10-19 Dolby Laboratories Licensing Corporation Adding data to a compressed data frame
WO2002093560A1 (en) 2001-05-10 2002-11-21 Dolby Laboratories Licensing Corporation Improving transient performance of low bit rate audio coding systems by reducing pre-noise
US7313519B2 (en) 2001-05-10 2007-12-25 Dolby Laboratories Licensing Corporation Transient performance of low bit rate audio coding systems by reducing pre-noise
WO2002097791A1 (en) 2001-05-25 2002-12-05 Dolby Laboratories Licensing Corporation Method for time aligning audio signals using characterizations based on auditory events
WO2002097790A1 (en) 2001-05-25 2002-12-05 Dolby Laboratories Licensing Corporation Comparing audio using characterizations based on auditory events
WO2002097792A1 (en) 2001-05-25 2002-12-05 Dolby Laboratories Licensing Corporation Segmenting audio signals into auditory events
US20030035553A1 (en) 2001-08-10 2003-02-20 Frank Baumgarte Backwards-compatible perceptual coding of spatial cues
US20040037421A1 (en) 2001-12-17 2004-02-26 Truman Michael Mead Parital encryption of assembled bitstreams
US20040122662A1 (en) 2002-02-12 2004-06-24 Crockett Brett Greham High quality time-scaling and pitch-scaling of audio signals
US20050078832A1 (en) * 2002-02-18 2005-04-14 Van De Par Steven Leonardus Josephus Dimphina Elisabeth Parametric audio coding
WO2003069954A2 (en) 2002-02-18 2003-08-21 Koninklijke Philips Electronics N.V. Parametric audio coding
EP1479071B1 (en) * 2002-02-18 2006-01-11 Koninklijke Philips Electronics N.V. Parametric audio coding
US20080170711A1 (en) * 2002-04-22 2008-07-17 Koninklijke Philips Electronics N.V. Parametric representation of spatial audio
WO2003090208A1 (en) 2002-04-22 2003-10-30 Koninklijke Philips Electronics N.V. pARAMETRIC REPRESENTATION OF SPATIAL AUDIO
US20030236583A1 (en) * 2002-06-24 2003-12-25 Frank Baumgarte Hybrid multi-channel/cue coding/decoding of audio signals
US20040002862A1 (en) 2002-06-28 2004-01-01 Samsung Electronics Co., Ltd. Voice recognition device, observation probability calculating device, complex fast fourier transform calculation device and method, cache device, and method of controlling the cache device
TW200400488A (en) 2002-06-28 2004-01-01 Samsung Electronics Co Ltd Voice recognition device, observation probability calculating device, complex fast fourier transform calculation device and method, cache device, and method of controlling the cache device
WO2004008806A1 (en) * 2002-07-16 2004-01-22 Koninklijke Philips Electronics N.V. Audio coding
US20040184537A1 (en) 2002-08-09 2004-09-23 Ralf Geiger Method and apparatus for scalable encoding and method and apparatus for scalable decoding
US20040044525A1 (en) 2002-08-30 2004-03-04 Vinton Mark Stuart Controlling loudness of speech in signals that contain speech and other types of audio material
TW200501056A (en) 2002-11-19 2005-01-01 Yamaha Corp Interchange format of voice data in music file
WO2004073178A2 (en) 2003-02-06 2004-08-26 Dolby Laboratories Licensing Corporation Continuous backup audio
WO2004111994A2 (en) 2003-05-28 2004-12-23 Dolby Laboratories Licensing Corporation Method, apparatus and computer program for calculating and adjusting the perceived loudness of an audio signal
US20050078840A1 (en) 2003-08-25 2005-04-14 Riedl Steven E. Methods and systems for determining audio loudness levels in programming
US20070067162A1 (en) * 2003-10-30 2007-03-22 Knoninklijke Philips Electronics N.V. Audio signal encoding or decoding
EP2224430B1 (en) 2004-03-01 2011-10-05 Dolby Laboratories Licensing Corporation Multichannel audio decoding
EP2065885B1 (en) 2004-03-01 2010-07-28 Dolby Laboratories Licensing Corporation Multichannel audio decoding
EP1914722B1 (en) 2004-03-01 2009-04-29 Dolby Laboratories Licensing Corporation Multichannel audio decoding
WO2005086139A1 (en) 2004-03-01 2005-09-15 Dolby Laboratories Licensing Corporation Multichannel audio coding
US20070140499A1 (en) 2004-03-01 2007-06-21 Dolby Laboratories Licensing Corporation Multichannel audio coding
US7639823B2 (en) * 2004-03-03 2009-12-29 Agere Systems Inc. Audio mixing using magnitude equalization
WO2006006977A1 (en) 2004-07-01 2006-01-19 Dolby Laboratories Licensing Corporation Method for correcting metadata affecting the playback loudness and dynamic range of audio information
US20060002572A1 (en) 2004-07-01 2006-01-05 Smithers Michael J Method for correcting metadata affecting the playback loudness and dynamic range of audio information
US20060029239A1 (en) 2004-08-03 2006-02-09 Smithers Michael J Method for combining audio signals using auditory scene analysis
WO2006019719A1 (en) 2004-08-03 2006-02-23 Dolby Laboratories Licensing Corporation Combining audio signals using auditory scene analysis
US20060165184A1 (en) 2004-11-02 2006-07-27 Heiko Purnhagen Audio coding using de-correlated signals
US20060133618A1 (en) * 2004-11-02 2006-06-22 Lars Villemoes Stereo compatible multi-channel audio coding
US20060136229A1 (en) 2004-11-02 2006-06-22 Kristofer Kjoerling Advanced methods for interpolation and parameter signalling
WO2006113047A1 (en) 2005-04-13 2006-10-26 Dolby Laboratories Licensing Corporation Economical loudness measurement of coded audio
WO2006113062A1 (en) 2005-04-13 2006-10-26 Dolby Laboratories Licensing Corporation Audio metadata verification
WO2006132857A2 (en) 2005-06-03 2006-12-14 Dolby Laboratories Licensing Corporation Apparatus and method for encoding audio signals with decoding instructions
WO2007016107A2 (en) 2005-08-02 2007-02-08 Dolby Laboratories Licensing Corporation Controlling spatial audio coding parameters as a function of auditory events
WO2007127023A1 (en) 2006-04-27 2007-11-08 Dolby Laboratories Licensing Corporation Audio gain control using specific-loudness-based auditory event detection

Non-Patent Citations (130)

* Cited by examiner, † Cited by third party
Title
ATSC Standard A52/A: Digital Audio Compression Standard (AC-3), Revision A, Advanced Television Systems Committee, Aug. 20, 2001.
ATSC Standard: Digital Audio Compression (AC-3), Revision A, Doc A/52A, ATSC Standard, Aug. 20, 2001, pp. 1-140.
Australian Patent Office-Feb. 19, 2007-Examiner's first report on application No. 2002248431.
Australian Patent Office-Feb. 26, 2007-Examiner's first report on application No. 2002307533.
Australian Patent Office-Mar. 9, 2007-Examiner's first report on application No. 2002252143.
Baumgarte, et al., "Estimation of Auditory Spatial Cues for Binaural Cue Coding," 2002, IEEE, pp. II-1801-II-1804.
Baumgarte, et al., "Why Binaural Cue Coding is Better Than Intensity Stereo Coding," May 1-13, 2002, Presented at the 112th AES Convention , Munich, Germany.
Blesser, B., "An Ultraminiature Console Compression System with Maximum User Flexibility," presented Oct. 8, 1971 at the 41st Convention of the Audio Engineering Society, New York, AES May 1972 vol. 20, No. 4, pp. 297-302.
Boueri, et al, "Audio Signal Decorrelation Based on a Critical Band Approach," AES Convention Paper 6291, presented at the 117th Convention Oct. 28-31, 2004 San Francisco, CA.
Brandenburg, K., "MP3 and AAC Explained," Proceedings of the International AES Conference, 1999, pp. 99-110.
Breebaart, et al., "High-Quality Parametric Spatial Audio Coding at Low Bitrates," AES Convention Paper 6072, presented at the 116th Convention May 8-11, 2004 Berlin, Germany.
C. Faller and F. Baumgarte, "Binaural cue coding-Part II: Schemes and applications," IEEE Trans. Speech Audio Processing, vol. 11, pp. 520-531, Nov. 2003. *
Carroll, Tim, "Audio Metadata: You Can Get There from Here," Oct. 11, 2004, pp. 1-4, Retrieved from the Internet: URL:http://tvtechnology.com/features/audio-notes/f-TC-metadta-8.21.02.shtml.
Cheng, "Introduction to Head-Related Transfer Functions (HRTS'S): Representations of HRTF's in Time, Frequency, and Space," University of Michigan, Dept. of Electrical Eng. and Computer Science, (invited tutorial). coreyc@eecs.umich.edu; Apr. 2001 http://www.eecs.umich.edu/-coreyc.
Cheng, et al., "Introduction to Head-Related Transfer Functions (HRTS'S): Representations of HRTF'S in Time, Frequency, and Space," (invited tutorial). coreyc@eecs.umich.edu ; http://www.eecs.umich.edu/˜coreyc.
Chinese Patent Office-Apr. 22, 2005-Notification of First Office Action for Application No. 02808144.7.
Chinese Patent Office-Apr. 28, 2006-Notification of Third Office Action for Application No. 02810671.7.
Chinese Patent Office-Aug. 26, 2005-Notification of Second Office Action for Application No. 02810672.5.
Chinese Patent Office-Dec. 31, 2004-Notification of the First Office Action for Application No. 02810671.7.
Chinese Patent Office-Dec. 9, 2005-Notification of Second Office Action for Application No. 02808144.7.
Chinese Patent Office-Feb. 15, 2008-Notification of Fourth Office Action for Application No. 02810671.7.
Chinese Patent Office-Feb. 17, 2006-Notification of Second Office Action for Application No. 02809542.1.
Chinese Patent Office-Jul. 15, 2005-Notification of Second Office Action for Application No. 02810671.7.
Chinese Patent Office-Mar. 10, 2006-Notification of the First Office Action for Application No. 02810670.9.
Chinese Patent Office-May 13, 2005-Notification of First Office Action for Application No. 02809542.1.
Chinese Patent Office-Nov. 5, 2004-Notification of First Office Action for Application No. 02810672.5.
Edmonds, et al., "Automatic Feature Extraction from Spectrograms for Acoustic-Phonetic Analysis", pp. 701-704, Lutchi Research Center, Loughborough University of Technology, Loughborough, U.K. Issue Date: Aug. 30-Sep. 3, 1992.
Edmonds, et al., "Automatic Feature Extraction from Spectrograms for Acoustic-Phonetic Analysis," pp. 701-704, Lutchi Research Center, Loughborough University of Technology, Loughborough, U.K.
Engdegard, et al., "Synthetic Ambience in Parametric Stereo Coding," AES Convention Paper 6074, presented at the 116th Convention May 8-11, 2004 Berlin, Germany.
European Patent Office, "Amended claims filed after receipt of (European) search report", dated Feb. 10, 2008, EP Appln. No. 1914722.
European Patent Office, "Amendments received before examination", dated Feb. 10, 2008, EP Appln. No. 1914722.
European Patent Office, "Bibliographic data of the European patent application", dated Nov. 27, 2008, EP Appln. No. 1914722.
European Patent Office, "CDS Clean-up—amended data concerning the representative of the applicant (Association)", dated Feb. 2, 2010, EP Appln. No. 1914722.
European Patent Office, "Communication about intention to grant a European patent" dated Nov. 27, 2008, EP Appln. No. 1914722.
European Patent Office, "Communication of amended entries concerning the representative", dated Apr. 2, 2010, EP Appln. No. 19147722.
European Patent Office, "Communication regarding the expiry of opposition period", dated May 3, 2010, EP Appln. No. 1914722.
European Patent Office, "Communication regarding the transmission of the European search report", dated Mar. 25, 2008, EP Appln. No. 1914722.
European Patent Office, "Decision to grant a European patent", dated Feb. 4, 2009, EP Appln. No. 1914722.
European Patent Office, "European search opinion", dated Mar. 25, 2008, EP Appln. No. 1914722.
European Patent Office, "European search report", dated Mar. 25, 2008, EP Appln. No. 1914722.
European Patent Office, "Filing of the translations of the claims", dated Mar. 13, 2009, EP Appln. No. 1914722.
European Patent Office, "Intention to grant (signatures)", dated Nov. 27, 2008, EP Appln. No. 1914722.
European Patent Office, "Letters concerning search matters", dated Jan. 28, 2008, EP Appln. No. 1914722.
European Patent Office, "Notification of forthcoming publication", dated Mar. 27, 2008, EP Appln. No. 1914722.
European Patent Office, "Reminder period for payment of examination fee/designation fee and correction of deficiencies in Written Opinion/amendment", dated Apr. 28, 2008, EP Appln. No. 1914722.
European Patent Office-Aug. 10, 2004-Communication pursuant to Article 96(2) EPC for Application No. 02 707896.3-1247.
European Patent Office-Dec. 16, 2005-Communication pursuant to Article 96(2) EPC for Application No. 02 707 896.3-1247.
European Patent Office-Dec. 19, 2005-Communication Pursuant to Article 96(2) for EP Application No. 02 769 666.5-2218.
European Patent Office-Jan. 26, 2007-Communication pursuant to Article 96(2) EPC for Application No. 05 724 000.4-2218.
European Patent Office-Sep. 28, 2007-Examination Report for Application No. 05 724 000.4-2225.
Faller, at al., "Binaural Cue Coding: A Novel and Efficient Representation of Spatial Audio," 2002, IEEE, pp. II-1841-II-1844.
Faller, Christof, "Coding of Spatial Audio Compatible with Different Playback Formats," Audio Engineering Society Convention Paper, presented at the 117th Convention, pp. 1-12, Oct. 28-31, 2004 San Francisco, CA.
Faller, Christof, "Parametric Coding of Spatial Audio," These No. 3062, pp. 1-164, (2004) Lausanne, EPFL.
Faller, et al., "Binaural Cue Coding Applied to Stereo and Multi-Channel Audio Compression," May 10-13, 2002, presented at the 112th AES Convention, Munich, Germany.
Faller, et al., "Efficient Representation of Spatial Audio Using Perceptual Parametrization," Oct. 21-24, 2001, IEEE Workshop on Applications of Signal Processing to Audio and Acoustics, pp. 199-202.
Fielder, et al., "Introduction to Dolby Digital Plus, an Enhancement to the Dolby Digital Coding System," Audio Engineering Society Convention Paper, presented at the 117th Convention, pp. 1-29, Oct. 28-31, 2004, San Francisco, CA.
Fishbach, Alon, Primary Segmentation of Auditory Scenes, IEEE, pp. 113-117, 1994.
Foti, Frank, "DTV Audio Processing: Exploring the New Frontier," OMNIA, Nov. 1998, pp. 1-3.
Glasberg, B. R., et al., "A Model of Loudness Applicable to Time-Varying Sounds," Audio Engineering Society, New York, NY, vol. 50, No. 5, May 2002, pp. 331-342.
Hauenstein, M., "A Computationally Efficient Algorithm for Calculating Loudness Patterns of Narrowband Speech," Acoustics, Speech and Signal Processing, 1997, IEEE International Conference, Munich, Germany, Apr. 21-24, 1997, Los Alamitos, CA USE, IEEE Comput. Soc. US Apr. 21, 1997, pp. 1311-1314.
Herre, et al., "MP3 Surround: Efficient and Compatible Coding of Multi-Channel Audio," Audio Engineering Society Convention Paper, presented at the 116th Convention, pp. 1-14, May 8-11, 2004 Berlin, Germany.
Herre, et al., "Spatial Audio Coding: Next-Generation Efficient and Compatible Coding of Multi-Channel Audio," Audio Engineering Society Convention Paper, presented at the 117th Convention, pp. 1-13, Oct. 28-31, 2004 San Francisco, CA.
Herre, et al., "The Reference Model Architecture for MPEG Spatial Audio Coding," Audio Engineering Society Convention Paper, presented at the 118th Convention, pp. 1-13, May 28-31, 2005, Barcelona, Spain.
Hoeg, W., et al., "Dynamic Range Control (DRC) and Music/Speech Control (MSC) Programme-Associated Data Services for DAB," EBU Review-Technical, European Broadcasting Union. Brussels, BE, No. 261, Sep. 21, 1994, pp. 56-70.
Indian Patent Office-Aug. 10, 2007-Letter for Application No. 01490/KOLNP/2003.
Indian Patent Office-Jan. 3, 2007-First Examination Report for Application No. 1308/KOLNP/2003-J.
Indian Patent Office-Jul. 30, 2007 (Aug. 2, 2007) Letter from the Indian Patent Office for Application No. 01487/KOLNP/2003-G.
Indian Patent Office-May 29, 2007-Letter for Application No. 01490/KOLNP/2003.
Indian Patent Office-Nov. 23, 2006 First Examination Report for Application No. 01487/KOLNP/2003-G.
Indian Patent Office-Oct. 10, 2006-First Examination Report for Application No. 01490/KOLNP/2003.
Japanese Patent Office-Partial Translation of Office Action received Oct. 5, 2007.
Laroche, Jean, "Autocorrelation Method for High-Quality Time/Pitch-Scaling," Telecom Paris, Departement Signal, 75634 Paris Cedex 13. France, email: laroche@sig.enst.fr.
Malaysian Patent Office-Apr. 7, 2006-Substantive Examination Adverse Report-Section 30(1) / 30(2)) for Application No. PI 20021371.
Moore, B. C. J., et al., "A Model for the Prediction of Thresholds, Loudness and Partial Loudness," Journal of the Audio Engineering Society, New York, NY vol. 45, No. 4, Apr. 1, 1997, pp. 224-240.
Office Action dated Apr. 8, 2014 from the Chinese Patent Office—regarding Patent Application No. 201110104718.1. (4 pages).
Office action dated May 17, 2013 from Government of India Patent Office—re patent application No. 2362/KOLNP/2006 filed Aug. 21, 2006. 1 page.
Office Action dated Sep. 1, 2014 in related Taiwan case TW 10321056940. 4 Pages.
Painter, T., et al., "Perceptual Coding of Digital Audio", Proceedings of the IEEE, New York, NY, vol. 88, No. 4, Apr. 2000, pp. 451-513.
PCT/US02/04317, filed Feb. 12, 2002-International Search Report dated Oct. 15, 2002.
PCT/US02/05329, filed Feb. 22, 2002-International Search Report dated Oct. 7, 2002.
PCT/US02/05806, filed Feb. 25, 2002-International Search Report dated Oct. 7, 2002.
PCT/US02/05999, filed Feb. 26, 2002-International Search Report dated Oct. 7, 2002.
PCT/US02/12957, filed Apr. 25, 2002-International Search Report dated Aug. 12, 2002.
PCT/US2005/006359, filed Feb. 28, 2005-International Search Report and Written Opinion dated Jun. 6, 2005.
PCT/US2005/024630, filed Jul. 13, 2005-International Search Report and Written Opinion dated Dec. 1, 2005.
PCT/US2006/020882, filed May 26, 2006-International Search Report and Written Opinion dated Feb. 20, 2007.
PCT/US2006/028874, filed Jul. 24, 2006-Alan Jeffrey Seefeldt and Mark Stuart Vinton-Pending claims in application.
PCT/US2007/008313, filed Mar. 30, 2007-International Search Report and Written Opinion dated Sep. 21, 2007.
Percival, W. S., "A Compressed-Bandwidth Stereophonic System for Radio Transmission," IEEE Paper No. 3152 E, Nov. 1959.
Princen, et al., "Subband/Transform Coding Using Filter Bank Designs on Time Domain Aliasing Cancellation," Proc. Int. Conf. Acoust., Speech, and Signal Proc., May 1987, pp. 2161-2164.
Riedmiller Jeffrey C., "Solving TV Loudness Problems Can You 'Accurately' Hear the Difference," Communications Technology, Feb. 2004.
Schroeder, et al., "Colorless Artificial Reverberation," 1961, IRE Transactions on Audio, vol. AU-9, pp. 209-214.
Schroeder, M. R., "Natural Sounding Artificial Reverberation," Jul. 1962, Journal AES, vol. 10, No. 2, pp. 219-223.
Schuijers, E., et al.; "Advances in Parametric Coding for High-Quality Audio," Preprints of Papers Presented at the AES Convention, Mar. 22, 2003, pp. 1-11, Amsterdam, The Netherlands.
Schuijers, et al., "Low Complexity Parametric Stereo Coding," AES Convention Paper 6073, presented at the 116th Convention May 8-11, 2004 Berlin, Germany.
Schuijers, et al., "Low Complexity Parametric Stereo Coding," Audio Engineering Society Convention Paper, presented at the 116th Convention, pp. 1-11, May 8-11, 2004, Berlin, Germany.
SG 200605858-0 Singapore Patent Office Written Opinion dated Oct. 17, 2007 based on PCT Application filed Feb. 28, 2005.
Shimada, et al., "A Low Power SBR Algorithm for the MPEG-4 Audio Standard and its DSP Implementation," AES Convention Paper 6048, presented at the 116th Convention May 8-11, 2004 Berlin, Germany.
Smith, et al., "Tandem-Free VoIP Conferencing: A Bridge to Next-Generation Networks," IEEE Communications Magazine, May 2003, pp. 136-145.
Swanson, M. D., et al., "Multiresolution Video Watermarking Using Perceptual Models and Scene Segmentation," Proceedings of the International Conference on Image Processing, Santa Barbara, Ca, Oct. 26-29, 1997, Los Alamitos, CA IEEE Computer Society, US, vol. 2, Oct. 1997, pp. 558-561.
Todd, et al., "AC-3: Flexible Perceptual Coding for Audio Transmission and Storage," 96th Convention of the Audio Engineering Society, Preprint 3796, Feb. 1994, pp. 1-16.
Todd, et al., "AC-3: Flexible Perceptual Coding for Audio Transmission and Storage," Feb. 26-Mar. 1, 1994, presented at the 96th AES Convention as Preprint 3796.
Trappe, W., et al., "Key Distribution fro Secure Multimedia Multicasts via Data Embedding," 2001 IEEE International Conferences on Acoustics, Speech and Signal Processing Proceedings, Salt Lake City UT, May 7-11, 2001 IEEE International Conference on Acoustics, Speech and Signal Processing, New York, NY, IEEE, US, vol. 1 of 6, May 7, 2001, pp. 1449-1452.
U.S. Appl. No. 10/474,387, filed Oct. 7, 2003, Brett Graham Crockett-Jul. 6, 2007 Office Action.
U.S. Appl. No. 10/474,387, filed Oct. 7, 2003, Brett Graham Crockett-Sep. 20, 2007 Response to Office Action.
U.S. Appl. No. 10/476,347, filed Oct. 28, 2003, Brett Graham Crockett-Feb. 12, 2007 Office Action.
U.S. Appl. No. 10/476,347, filed Oct. 28, 2003, Brett Graham Crockett-May 14, 2007 Response to Office Action.
U.S. Appl. No. 10/478,397, filed Nov. 20, 2003, Brett G. Crockett-Feb. 27, 2007 Office Action.
U.S. Appl. No. 10/478,397, filed Nov. 20, 2003, Brett G. Crockett-May 29, 2007 Response to Office Action.
U.S. Appl. No. 10/478,398, filed Nov. 20, 2003, Brett G. Crockett-Feb. 27, 2007 Office Action.
U.S. Appl. No. 10/478,398, filed Nov. 20, 2003, Brett G. Crockett-Jan. 30, 2008 Office Action.
U.S. Appl. No. 10/478,398, filed Nov. 20, 2003, Brett G. Crockett-May 29, 2007 Response to Office Action.
U.S. Appl. No. 10/478,398, filed Nov. 20, 2003, Brett G. Crockett-Oct. 19, 2007 Request for Continued Examination with attached IDS.
U.S. Appl. No. 10/478,538, filed Nov. 20, 2003, Brett G Crockett-Jan. 9, 2008-Response to Office Action.
U.S. Appl. No. 10/478,538, filed Nov. 20, 2003, Brett G. Crockett-Aug. 24, 2006 Office Action.
U.S. Appl. No. 10/478,538, filed Nov. 20, 2003, Brett G. Crockett-Feb. 23, 2007 Office Action.
U.S. Appl. No. 10/478,538, filed Nov. 20, 2003, Brett G. Crockett-Jun. 25, 2007 Response to Office Action.
U.S. Appl. No. 10/478,538, filed Nov. 20, 2003, Brett G. Crockett-Nov. 24, 2006 Response to Office Action.
U.S. Appl. No. 10/478,538, filed Nov. 20, 2003, Brett G. Crockett-Sep. 10, 2007 Office Action.
U.S. Appl. No. 10/591,374, filed Aug. 31, 2006, Mark Franklin Davis-Pending claims in application.
U.S. Appl. No. 10/911,404, filed Aug. 3, 2004, Michael John Smithers-Aug. 10, 2007 Office Action.
U.S. Appl. No. 10/911,404, filed Aug. 3, 2004, Michael John Smithers-Dec. 7, 2007 Response to Office Action.
U.S. Appl. No. 10/911,404, filed Aug. 3, 2004, Michael John Smithers-Jan. 5, 2007 Response to Office Action.
U.S. Appl. No. 10/911,404, filed Aug. 3, 2004, Michael John Smithers-Jun. 28, 2007 RCE and Response to Office Action.
U.S. Appl. No. 10/911,404, filed Aug. 3, 2004, Michael John Smithers-Mar. 28, 2007 Office Action.
U.S. Appl. No. 10/911,404, filed Aug. 3, 2004, Michael John Smithers-Oct. 5, 2006 Office Action.
U.S. Appl. No. 11/999,159, filed Dec. 3, 2007, Alan Jeffrey Seefeldt, et al.-Pending claims in application.
Vafin, et al., "Improved Modeling of Audio Signals by Modifying Transient Locations," pp. W2001-W2001-4, Oct. 21-24, 2001, New Paltz, New York.
Vafin, et al., "Modifying Transients for Efficient Coding of Audio," IEEE, pp. 3285-3288, Apr. 2001.
Vernon, Steve, "Design and Implementation of AC-3 Coders," reprinted by permission of IEEE, published in IEEE Tr. Consumer Electronics, vol. 41, No. 3, Aug. 1995.

Cited By (50)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US9165562B1 (en) 2001-04-13 2015-10-20 Dolby Laboratories Licensing Corporation Processing audio signals with adaptive time or frequency resolution
US10460740B2 (en) 2004-03-01 2019-10-29 Dolby Laboratories Licensing Corporation Methods and apparatus for adjusting a level of an audio signal
US9697842B1 (en) 2004-03-01 2017-07-04 Dolby Laboratories Licensing Corporation Reconstructing audio signals with multiple decorrelation techniques and differentially coded parameters
US11308969B2 (en) 2004-03-01 2022-04-19 Dolby Laboratories Licensing Corporation Methods and apparatus for reconstructing audio signals with decorrelation and differentially coded parameters
US9454969B2 (en) 2004-03-01 2016-09-27 Dolby Laboratories Licensing Corporation Multichannel audio coding
US10403297B2 (en) 2004-03-01 2019-09-03 Dolby Laboratories Licensing Corporation Methods and apparatus for adjusting a level of an audio signal
US9520135B2 (en) 2004-03-01 2016-12-13 Dolby Laboratories Licensing Corporation Reconstructing audio signals with multiple decorrelation techniques
US10796706B2 (en) 2004-03-01 2020-10-06 Dolby Laboratories Licensing Corporation Methods and apparatus for reconstructing audio signals with decorrelation and differentially coded parameters
US9640188B2 (en) 2004-03-01 2017-05-02 Dolby Laboratories Licensing Corporation Reconstructing audio signals with multiple decorrelation techniques
US9672839B1 (en) 2004-03-01 2017-06-06 Dolby Laboratories Licensing Corporation Reconstructing audio signals with multiple decorrelation techniques and differentially coded parameters
US9691404B2 (en) 2004-03-01 2017-06-27 Dolby Laboratories Licensing Corporation Reconstructing audio signals with multiple decorrelation techniques
US9691405B1 (en) 2004-03-01 2017-06-27 Dolby Laboratories Licensing Corporation Reconstructing audio signals with multiple decorrelation techniques and differentially coded parameters
US10269364B2 (en) 2004-03-01 2019-04-23 Dolby Laboratories Licensing Corporation Reconstructing audio signals with multiple decorrelation techniques
US9704499B1 (en) 2004-03-01 2017-07-11 Dolby Laboratories Licensing Corporation Reconstructing audio signals with multiple decorrelation techniques and differentially coded parameters
US9715882B2 (en) 2004-03-01 2017-07-25 Dolby Laboratories Licensing Corporation Reconstructing audio signals with multiple decorrelation techniques
US9311922B2 (en) 2004-03-01 2016-04-12 Dolby Laboratories Licensing Corporation Method, apparatus, and storage medium for decoding encoded audio channels
US9779745B2 (en) 2004-03-01 2017-10-03 Dolby Laboratories Licensing Corporation Reconstructing audio signals with multiple decorrelation techniques and differentially coded parameters
US20140369503A1 (en) * 2012-01-11 2014-12-18 Dolby Laboratories Licensing Corporation Simultaneous broadcaster-mixed and receiver-mixed supplementary audio services
US9830916B2 (en) 2013-02-14 2017-11-28 Dolby Laboratories Licensing Corporation Signal decorrelation in an audio processing system
US9830917B2 (en) 2013-02-14 2017-11-28 Dolby Laboratories Licensing Corporation Methods for audio signal transient detection and decorrelation control
US9754596B2 (en) 2013-02-14 2017-09-05 Dolby Laboratories Licensing Corporation Methods for controlling the inter-channel coherence of upmixed audio signals
US9489956B2 (en) 2013-02-14 2016-11-08 Dolby Laboratories Licensing Corporation Audio signal enhancement using estimated spatial parameters
US9818412B2 (en) 2013-05-24 2017-11-14 Dolby International Ab Methods for audio encoding and decoding, corresponding computer-readable media and corresponding audio encoder and decoder
US10375500B2 (en) 2013-06-27 2019-08-06 Clarion Co., Ltd. Propagation delay correction apparatus and propagation delay correction method
US9609451B2 (en) * 2015-02-12 2017-03-28 Dts, Inc. Multi-rate system for audio processing
US10008217B2 (en) * 2015-02-12 2018-06-26 Dts, Inc. Multi-rate system for audio processing
US20160240183A1 (en) * 2015-02-12 2016-08-18 Dts, Inc. Multi-rate system for audio processing
US11832053B2 (en) 2015-04-30 2023-11-28 Shure Acquisition Holdings, Inc. Array microphone system and method of assembling the same
US11310592B2 (en) 2015-04-30 2022-04-19 Shure Acquisition Holdings, Inc. Array microphone system and method of assembling the same
US11678109B2 (en) 2015-04-30 2023-06-13 Shure Acquisition Holdings, Inc. Offset cartridge microphones
US11477327B2 (en) 2017-01-13 2022-10-18 Shure Acquisition Holdings, Inc. Post-mixing acoustic echo cancellation systems and methods
US10553224B2 (en) * 2017-10-03 2020-02-04 Dolby Laboratories Licensing Corporation Method and system for inter-channel coding
US11800281B2 (en) 2018-06-01 2023-10-24 Shure Acquisition Holdings, Inc. Pattern-forming microphone array
US11523212B2 (en) 2018-06-01 2022-12-06 Shure Acquisition Holdings, Inc. Pattern-forming microphone array
US11297423B2 (en) 2018-06-15 2022-04-05 Shure Acquisition Holdings, Inc. Endfire linear array microphone
US11770650B2 (en) 2018-06-15 2023-09-26 Shure Acquisition Holdings, Inc. Endfire linear array microphone
US11310596B2 (en) 2018-09-20 2022-04-19 Shure Acquisition Holdings, Inc. Adjustable lobe shape for array microphones
US11778368B2 (en) 2019-03-21 2023-10-03 Shure Acquisition Holdings, Inc. Auto focus, auto focus within regions, and auto placement of beamformed microphone lobes with inhibition functionality
US11303981B2 (en) 2019-03-21 2022-04-12 Shure Acquisition Holdings, Inc. Housings and associated design features for ceiling array microphones
US11558693B2 (en) 2019-03-21 2023-01-17 Shure Acquisition Holdings, Inc. Auto focus, auto focus within regions, and auto placement of beamformed microphone lobes with inhibition and voice activity detection functionality
US11438691B2 (en) 2019-03-21 2022-09-06 Shure Acquisition Holdings, Inc. Auto focus, auto focus within regions, and auto placement of beamformed microphone lobes with inhibition functionality
US11800280B2 (en) 2019-05-23 2023-10-24 Shure Acquisition Holdings, Inc. Steerable speaker array, system and method for the same
US11445294B2 (en) 2019-05-23 2022-09-13 Shure Acquisition Holdings, Inc. Steerable speaker array, system, and method for the same
US11688418B2 (en) 2019-05-31 2023-06-27 Shure Acquisition Holdings, Inc. Low latency automixer integrated with voice and noise activity detection
US11302347B2 (en) 2019-05-31 2022-04-12 Shure Acquisition Holdings, Inc. Low latency automixer integrated with voice and noise activity detection
US11750972B2 (en) 2019-08-23 2023-09-05 Shure Acquisition Holdings, Inc. One-dimensional array microphone with improved directivity
US11297426B2 (en) 2019-08-23 2022-04-05 Shure Acquisition Holdings, Inc. One-dimensional array microphone with improved directivity
US11552611B2 (en) 2020-02-07 2023-01-10 Shure Acquisition Holdings, Inc. System and method for automatic adjustment of reference gain
US11706562B2 (en) 2020-05-29 2023-07-18 Shure Acquisition Holdings, Inc. Transducer steering and configuration systems and methods using a local positioning system
US11785380B2 (en) 2021-01-28 2023-10-10 Shure Acquisition Holdings, Inc. Hybrid audio beamforming system

Also Published As

Publication number Publication date
EP1721312B1 (en) 2008-03-26
US20170148457A1 (en) 2017-05-25
US9454969B2 (en) 2016-09-27
CA2556575A1 (en) 2005-09-15
DE602005014288D1 (en) 2009-06-10
US9691405B1 (en) 2017-06-27
US8170882B2 (en) 2012-05-01
CA2992051A1 (en) 2005-09-15
CA3026245C (en) 2019-04-09
US10796706B2 (en) 2020-10-06
ATE527654T1 (en) 2011-10-15
IL177094A (en) 2010-11-30
CA2992097C (en) 2018-09-11
US20170148456A1 (en) 2017-05-25
TW201329959A (en) 2013-07-16
JP2007526522A (en) 2007-09-13
US20160189718A1 (en) 2016-06-30
SG10202004688SA (en) 2020-06-29
ATE390683T1 (en) 2008-04-15
AU2009202483B2 (en) 2012-07-19
DE602005022641D1 (en) 2010-09-09
KR101079066B1 (en) 2011-11-02
CA2992065A1 (en) 2005-09-15
BRPI0508343B1 (en) 2018-11-06
US20150187362A1 (en) 2015-07-02
US11308969B2 (en) 2022-04-19
CA3026245A1 (en) 2005-09-15
SG10201605609PA (en) 2016-08-30
AU2005219956A1 (en) 2005-09-15
CA3026267C (en) 2019-04-16
CA2992097A1 (en) 2005-09-15
US20200066287A1 (en) 2020-02-27
US20210090583A1 (en) 2021-03-25
EP2224430A2 (en) 2010-09-01
DE602005005640D1 (en) 2008-05-08
ATE475964T1 (en) 2010-08-15
CN102176311B (en) 2014-09-10
BRPI0508343A (en) 2007-07-24
CA2992051C (en) 2019-01-22
CN1926607B (en) 2011-07-06
CA3035175C (en) 2020-02-25
US20170178650A1 (en) 2017-06-22
US9520135B2 (en) 2016-12-13
US10403297B2 (en) 2019-09-03
US10460740B2 (en) 2019-10-29
HK1119820A1 (en) 2009-03-13
TW200537436A (en) 2005-11-16
US20170178653A1 (en) 2017-06-22
AU2005219956B2 (en) 2009-05-28
US9715882B2 (en) 2017-07-25
US9697842B1 (en) 2017-07-04
US20170178651A1 (en) 2017-06-22
US20170076731A1 (en) 2017-03-16
US20070140499A1 (en) 2007-06-21
EP2224430B1 (en) 2011-10-05
JP4867914B2 (en) 2012-02-01
HK1142431A1 (en) 2010-12-03
DE602005005640T2 (en) 2009-05-14
MY145083A (en) 2011-12-15
TWI397902B (en) 2013-06-01
CN102176311A (en) 2011-09-07
US20190122683A1 (en) 2019-04-25
IL177094A0 (en) 2006-12-10
TW201331932A (en) 2013-08-01
CN102169693B (en) 2014-07-23
US9704499B1 (en) 2017-07-11
EP1721312A1 (en) 2006-11-15
US9779745B2 (en) 2017-10-03
EP2224430A3 (en) 2010-09-15
CA2992089C (en) 2018-08-21
CN102169693A (en) 2011-08-31
CA2556575C (en) 2013-07-02
US9672839B1 (en) 2017-06-06
HK1092580A1 (en) 2007-02-09
CA2917518C (en) 2018-04-03
US9640188B2 (en) 2017-05-02
ATE430360T1 (en) 2009-05-15
CA2992125A1 (en) 2005-09-15
CA2992125C (en) 2018-09-25
TWI498883B (en) 2015-09-01
HK1128100A1 (en) 2009-10-16
KR20060132682A (en) 2006-12-21
SG149871A1 (en) 2009-02-27
US10269364B2 (en) 2019-04-23
ES2324926T3 (en) 2009-08-19
EP1914722B1 (en) 2009-04-29
US20170365268A1 (en) 2017-12-21
CA2992089A1 (en) 2005-09-15
AU2009202483A1 (en) 2009-07-16
WO2005086139A1 (en) 2005-09-15
CA2992065C (en) 2018-11-20
EP2065885A1 (en) 2009-06-03
EP2065885B1 (en) 2010-07-28
CA3026276A1 (en) 2012-12-27
CA3035175A1 (en) 2012-12-27
TWI484478B (en) 2015-05-11
CA3026267A1 (en) 2005-09-15
US20080031463A1 (en) 2008-02-07
US20190147898A1 (en) 2019-05-16
EP1914722A1 (en) 2008-04-23
CN1926607A (en) 2007-03-07
US20170178652A1 (en) 2017-06-22
US20160189723A1 (en) 2016-06-30
US9311922B2 (en) 2016-04-12
US20170148458A1 (en) 2017-05-25
CA3026276C (en) 2019-04-16
US9691404B2 (en) 2017-06-27
CA2917518A1 (en) 2005-09-15

Similar Documents

Publication Publication Date Title
US11308969B2 (en) Methods and apparatus for reconstructing audio signals with decorrelation and differentially coded parameters
CA2808226C (en) Multichannel audio coding
AU2012208987B2 (en) Multichannel Audio Coding

Legal Events

Date Code Title Description
AS Assignment

Owner name: DOLBY LABORATORIES LICENSING CORPORATION, CALIFORN

Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:DAVIS, MARK FRANKLIN;REEL/FRAME:018282/0045

Effective date: 20060807

STCF Information on status: patent grant

Free format text: PATENTED CASE

MAFP Maintenance fee payment

Free format text: PAYMENT OF MAINTENANCE FEE, 4TH YEAR, LARGE ENTITY (ORIGINAL EVENT CODE: M1551); ENTITY STATUS OF PATENT OWNER: LARGE ENTITY

Year of fee payment: 4

MAFP Maintenance fee payment

Free format text: PAYMENT OF MAINTENANCE FEE, 8TH YEAR, LARGE ENTITY (ORIGINAL EVENT CODE: M1552); ENTITY STATUS OF PATENT OWNER: LARGE ENTITY

Year of fee payment: 8