US20050100094A1 - Buffer management in variable bit-rate compression systems - Google Patents
Buffer management in variable bit-rate compression systems Download PDFInfo
- Publication number
- US20050100094A1 US20050100094A1 US11/003,992 US399204A US2005100094A1 US 20050100094 A1 US20050100094 A1 US 20050100094A1 US 399204 A US399204 A US 399204A US 2005100094 A1 US2005100094 A1 US 2005100094A1
- Authority
- US
- United States
- Prior art keywords
- bit
- rate
- buffer
- bit rate
- decoder
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Abandoned
Links
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04Q—SELECTING
- H04Q11/00—Selecting arrangements for multiplex systems
- H04Q11/04—Selecting arrangements for multiplex systems for time-division multiplexing
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/44—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream, rendering scenes according to MPEG-4 scene graphs
- H04N21/44004—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream, rendering scenes according to MPEG-4 scene graphs involving video buffer management, e.g. video decoder buffer or video display buffer
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
- H04N19/102—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or selection affected or controlled by the adaptive coding
- H04N19/115—Selection of the code volume for a coding unit prior to coding
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
- H04N19/102—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or selection affected or controlled by the adaptive coding
- H04N19/124—Quantisation
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
- H04N19/134—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or criterion affecting or controlling the adaptive coding
- H04N19/136—Incoming video signal characteristics or properties
- H04N19/14—Coding unit complexity, e.g. amount of activity or edge presence estimation
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
- H04N19/134—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or criterion affecting or controlling the adaptive coding
- H04N19/146—Data rate or code amount at the encoder output
- H04N19/152—Data rate or code amount at the encoder output by measuring the fullness of the transmission buffer
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
- H04N19/169—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding
- H04N19/177—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being a group of pictures [GOP]
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
- H04N19/169—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding
- H04N19/184—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being bits, e.g. of the compressed video stream
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/50—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/60—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using transform coding
- H04N19/61—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using transform coding in combination with predictive coding
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
- H04N21/234—Processing of video elementary streams, e.g. splicing of video streams, manipulating MPEG-4 scene graphs
- H04N21/23406—Processing of video elementary streams, e.g. splicing of video streams, manipulating MPEG-4 scene graphs involving management of server-side video buffer
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
- H04N19/134—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or criterion affecting or controlling the adaptive coding
- H04N19/146—Data rate or code amount at the encoder output
Definitions
- the present invention relates to a method and apparatus for the compression of digital video signals and in particular to the use of such method and apparatus in the encoding and decoding of signals.
- VBR Variable bit rate
- CBR constant bit-rate
- VBR compression is better than CBR, it can only be used in a limited number of applications.
- the medium should be able to convey variable bit-rate signals.
- the ISO/OSI model almost every medium conveys a fixed bit rate at the physical layer.
- the medium can be converted into a (logically) variable bit rate medium.
- VBR compression is joint bit-rate control, in which a number of sources make use of a single channel.
- bit-rate control the bit-rate of the video signals is controlled such that the individual bit rates can be varying (through optimal allocation of bit rate) but so that the sum of all bit rates is constant.
- This type of system may occur in for instance cable television or in satellite television services.
- joint bit-rate control for multi-program video signal encoding has been found to be advantageous, particularly for video signals coded according to the ISO MPEG standards.
- a system for joint bit-rate control needs technical measures for two problems, namely the bit allocation and the buffer management.
- bit allocation the bit need of the programs is measured and the bits are spread accordingly over the programs.
- Buffer management encompasses several sub-problems, some of which are described in “Constraints on variable bit-rate video for ATM-networks” by Amy Reibman and Barry Haskell; in IEEE Transactions on Circuits and Systems for Video Technology, Vol 2, No. 4 Dec. 1992 pp. 361-372.
- the Reibman and Haskell paper examines the constraints resulting from encoder and decoder buffering in an asynchronous transfer mode (ATM) network, in particular the additional constraints needed to prevent overflowing or underflowing of the decoder buffer when a variable bit-rate data channel links encoder and decoder. They describe a method in which the number of encoded bits for each video frame and the number of bits transmitted across the variable bit-rate channel are selected jointly, a necessity imposed by the differing constraints imposed on the transmitted bit rate by the encoder and decoder buffers respectively.
- ATM asynchronous transfer mode
- An MPEG decoder contains a physical buffer, and correct MPEG bit streams must fulfil the video buffering verifier (VBV) constraints, which means that the signals may not overflow or underflow a hypothetical decoder buffer.
- VBV video buffering verifier
- an incorrect buffer management may limit the performance of a VBR compression system.
- the analyses of buffering systems rely strongly on the concept of a system delay whereby, in order to have a continuous display of video, the delay must be constant. This requirement has an effect on the buffering strategy.
- the delay must be relatively large for a low bit-rate and relatively low for a high bit-rate in order to make full use of the available buffering space in the decoder. If the bit rate is variable a compromise setting of the buffering system must be used. As a consequence of this compromise the effective buffer size in the decoder is too low for an acceptable performance at low bit rates. Essentially, two things are required, namely a constant end-to-end delay, and a low buffering delay for high bit rates and a high buffering delay for low bit rates. These requirements would appear to be incompatible.
- the tunable delay resulting from the varied output and input bit rates in the encoder buffer, the contents of the nominal decoder buffer will remain substantially constant.
- the relationship between input and output rates means that at high input signal bit rates, where the remainder of the buffering system (provided by the encoder stage and the decoder) provides a relatively low delay, the tunable delay provides a relatively high delay. At low input signal bit rates, the tunable delay is reduced to counter the relatively higher delay introduced by the remainder of the buffering system.
- the range of possible input bit rates may suitably be divided into discrete levels with a derived second bit rate being maintained constant until an input signal bit rate within a different one of the levels is detected at which point the second bit rate is recalculated.
- the second bit rate is suitably set to equal that bit rate: in other words, at minimum input bit rate, the delay is set to zero.
- Successive groupings of one or more image frames may be specified with the second bit rate being derived from the first frame of the grouping and maintained constant until the bit rate of the first frame of a succeeding grouping is detected.
- the groupings may be determined on the basis of successive frames within a range of bit rates as mentioned above or may be specified on other criteria.
- a first grouping may be specified for I-pictures, with one or more other groupings for other types of image.
- a video signal encoding apparatus operable to encode a digital video signal for transmission, the apparatus comprising an encoder stage operable to encode a received video signal according to a predetermined coding scheme and to output the signal as a variable bit-rate data stream and a buffer coupled to receive the said variable bit-rate data stream from the encoder and arranged to output a data signal for transmission; characterised by means operable to detect the bit-rate of the said variable bit-rate data stream, to derive a second bit rate as a percentage of the encoder stage output bit rate, which percentage changes in inverse relation to changes in the encoder stage output rate, and to control the buffer output data signal bit rate at the said second bit rate.
- an encoded video signal compressed (for transmission) by the method recited above comprising a bit stream of encoded data for a succession of image frames, has its instantaneous bit rate inversely related to the bit density of an image frame n frame periods later where n is determined by the said bit density.
- the bit rate of the uncompressed signal is determined by the bit density, and the n frame periods (where n is not necessarily an integer) corresponds to the lag introduced by the tunable delay.
- FIG. 1 schematically represents a series of image frames coded according to the MPEG standard
- FIG. 2 is a block diagram of part of an encoder apparatus embodying the invention
- FIG. 3 represents usage of the encoder buffer of the apparatus of FIG. 2 in relation to decoder buffer usage
- FIG. 4 graphically represents increase in decoder buffer fullness over time
- FIG. 5 represents a modified version of FIG. 3 embodying the present invention
- FIG. 6 schematically illustrates the combination of video and MPEG program streams
- FIG. 7 represents skew resulting from bit-rate changes.
- the MPEG standard describes a syntax and semantics of bit streams for compressed video and associated audio. Whilst the semantics in principle specify the functionality of the decoder, the standard provides no prescriptions for the decoder architecture. Each decoder will have an input buffer of some sort but how this is to be realized and what exact size this buffer must have is not specified.
- I-pictures provide access points for random pictures and accordingly have only limited compression.
- P-pictures are coded with reference to a past (I or P) picture and often form a reference for future P-pictures.
- B-pictures have the highest degree of compression but require both a past and future reference for prediction.
- a typical MPEG sequence of I, P and B-pictures is shown in FIG. 1 .
- FIG. 2 A schematic representation of an MPEG encoder is shown in FIG. 2 .
- a received video signal is passed to encoder stage 10 together with a control signal which varies the quantisation coarseness of the encoding. In many cases (although not for joint bit rate encoding) the control signal is kept constant to maintain coarseness at the same average level.
- the control signal is derived on the basis of the incoming video signal by detector 12 .
- the output of the encoder stage 10 is passed to an encoder buffer 14 at a first bit rate and also to a calculation unit 16 .
- the calculation unit 16 derives a value for a second bit rate and passes this to a header insertion stage 18 which reads the signal bit stream out of the buffer at the second bit rate and places the bit stream on a communication channel for transmission to a receiver/decoder.
- a header insertion stage 18 which reads the signal bit stream out of the buffer at the second bit rate and places the bit stream on a communication channel for transmission to a receiver/decoder.
- the MPEG standard constrains bit streams such that they may not overflow or underflow a hypothetical buffer: this hypothetical buffer can be related to the physical buffers appearing in the signal encoder and decoder stages.
- the MPEG standard is partitioned in three parts: the video part, the audio part and the systems part.
- the video part contains a mechanism called the VBV and the systems part contains a part called the transport system target decoder (T-STD).
- MPEG decoders are realisable because the signal (bitstream) has to fulfil certain conditions, and bitstreams that fulfil the VBV condition (or similar for T-STD) are said to be compliant. Since bitstreams must fulfil the VBV condition it is possible to design decoders that can decode compliant bitstreams.
- the VBV definition is based on a hypothetical decoder which reads the compressed pictures in zero time from the VBV buffer and a channel that continuously fills up the buffer.
- FIG. 4 shows characteristic VBV buffer contents as a function of time for a part of the MPEG frame sequence of FIG. 1 .
- the VBV is specifically defined for constant bit-rate operation. In case of variable bit-rate operation, the MPEG standard specifies that the definition of the VBV buffer is overruled by the definition of the T-STD.
- the bitstream is written into the buffer at the bit-rate specified in the sequence header.
- the bitstream contains information about the contents of the VBV buffer. This information is presented in a field in each picture header called the VBV delay, which specifies the time between the moment that the header enters the VBV buffer and the moment of decoding the picture.
- DTS decoding time stamp
- PTS presentation time stamp
- SCR system clock reference
- STD standard target decoder
- the systems part describes two types of systems layer: the transport stream and the program stream.
- the STD for the transport stream is referred to as T-STD and for the program stream the term P-STD is used. In the following the difference between these streams is explained.
- the program stream is defined for applications which have a very low error probability such as optical recording.
- the basic characteristic of the program stream is that it can convey only one program and that the bit-rate can be varying: as such it may be of limited general use.
- the transport stream which is intended for multi-program environments.
- the bit-rate for each program is allowed to vary but the sum of all bit-rates must be constant.
- the transport stream uses a fixed size packets of 188 bytes.
- the T-STD can be used for HD-CD (VBR optical medium) by reading a variable bit-rate from the disk and adding an artificial empty program to the bitstream in passing the information from the reader on to the decoder such that the total bit-rate is constant.
- the buffering model uses the following parameters
- the range of the buffer points is introduced as a separate variable which is time dependent, with the current buffer pointers E[n] and D[n] representing the buffer contents.
- a key variable in the buffer system is the input-output delay d which denotes the time between inputting a picture to the encoder and the time that this picture is decoded by the decoder.
- d the input-output delay
- Underflow in either of the two buffers is in fact a physical underflow and, hence, a loss of data.
- Equation 5 The use of this specified bit-rate technique in the encoder may be detected from the decoder by testing Equation 5 on the bit stream. If the equation yields an “overflow” it shows the technique to have been used.
- Equation 4 The choices for our larger encoder buffer and appropriate bit-rate over time will now be described.
- the conventional choice made in Equation 4 is the source for existing problems: we have appreciated that by making an alternative choice more flexibility in the decoder is provided.
- FIG. 4 illustrates this condition using the decoder buffer fullness.
- bit rate has to change d samples after the source bit rate has changed and also that the bit rate will generally have to be changed within a picture, rather than at the header of a picture, although this may occasionally occur.
- the bit rate changes are shown in terms of the MPEG syntax in FIG. 6 .
- the MPEG transport stream is meant for multi-program environments and the program stream is meant for environments with one program, like optical recording.
- FIG. 6 shows how a video bit stream can be wrapped in a program stream.
- PACK-headers and PES-headers PES-packetized elementary stream.
- Equation 15 and Equation 16 are shown in FIG. 7 which shows the skew between moment of inputting the groups of pictures to the buffer and the moment of changing the bit rate: the continuous lines represent the time interval in which the bits resulting from compressing a GOP are written into the buffer, and the dashed lines indicate the time interval for which the output bit rate calculated for that GOP is applied.
Abstract
A method of compression is provided for transmission of digital video signals between an encoder buffer and a decoder buffer. A tunable delay is provided at the encoder, suitably in the form of a portion of encoder buffer memory, with data being read out to a communications channel at a rate determined by the input bit rate of signals received a predetermined number of frame periods later. Use of the tunable delay improves efficiency of decoder buffering by maintaining a relatively constant level of decoder buffer fullness irrespective of signal bit rates.
Description
- The present invention relates to a method and apparatus for the compression of digital video signals and in particular to the use of such method and apparatus in the encoding and decoding of signals.
- Variable bit rate (VBR) video compression is known to give advantages over constant bit-rate (CBR) video compression. The main reason for this is that in a CBR system the bit rate has to be set so that the worst case quality is acceptable while in a VBR system the bit rate is set so that the quality (which is kept constant) is acceptable. The difference between the average bit rate of a VBR compressed signal compared to the bit rate of a CBR compressed signal has been found to be to be close to 30% in favour of VBR compression.
- Though VBR compression is better than CBR, it can only be used in a limited number of applications. In principle the medium should be able to convey variable bit-rate signals. In terms of the ISO/OSI model, almost every medium conveys a fixed bit rate at the physical layer. On a higher level, the medium can be converted into a (logically) variable bit rate medium.
- One particular application of VBR compression is joint bit-rate control, in which a number of sources make use of a single channel. In the case of joint bit-rate control the bit-rate of the video signals is controlled such that the individual bit rates can be varying (through optimal allocation of bit rate) but so that the sum of all bit rates is constant. This type of system may occur in for instance cable television or in satellite television services.
- The idea of joint bit-rate control for multi-program video signal encoding has been found to be advantageous, particularly for video signals coded according to the ISO MPEG standards. Basically a system for joint bit-rate control needs technical measures for two problems, namely the bit allocation and the buffer management. To deal with bit allocation, the bit need of the programs is measured and the bits are spread accordingly over the programs. Buffer management encompasses several sub-problems, some of which are described in “Constraints on variable bit-rate video for ATM-networks” by Amy Reibman and Barry Haskell; in IEEE Transactions on Circuits and Systems for Video Technology,
Vol 2, No. 4 Dec. 1992 pp. 361-372. The Reibman and Haskell paper examines the constraints resulting from encoder and decoder buffering in an asynchronous transfer mode (ATM) network, in particular the additional constraints needed to prevent overflowing or underflowing of the decoder buffer when a variable bit-rate data channel links encoder and decoder. They describe a method in which the number of encoded bits for each video frame and the number of bits transmitted across the variable bit-rate channel are selected jointly, a necessity imposed by the differing constraints imposed on the transmitted bit rate by the encoder and decoder buffers respectively. - In all these applications the transmission of video can be in the MPEG format. An MPEG decoder contains a physical buffer, and correct MPEG bit streams must fulfil the video buffering verifier (VBV) constraints, which means that the signals may not overflow or underflow a hypothetical decoder buffer. As will be shown hereinafter, an incorrect buffer management may limit the performance of a VBR compression system. The analyses of buffering systems rely strongly on the concept of a system delay whereby, in order to have a continuous display of video, the delay must be constant. This requirement has an effect on the buffering strategy.
- For CBR systems, given a fixed decoder buffer size, the delay must be relatively large for a low bit-rate and relatively low for a high bit-rate in order to make full use of the available buffering space in the decoder. If the bit rate is variable a compromise setting of the buffering system must be used. As a consequence of this compromise the effective buffer size in the decoder is too low for an acceptable performance at low bit rates. Essentially, two things are required, namely a constant end-to-end delay, and a low buffering delay for high bit rates and a high buffering delay for low bit rates. These requirements would appear to be incompatible.
- It is an object of the present invention to provide improved stability of decoder buffer operation.
- It is a further object of the present invention to provide greater efficiency in encoder buffer management.
- In accordance with the present invention there is provided a method of compression for transmission of encoded digital video signals having a variable number of data bits per image frame, comprising the steps of:
-
- a) detecting a first bit rate of the encoded digital video signal bit stream;
- b) sequentially writing the signal bit stream into a buffer at the first bit rate;
- c) deriving a second bit rate as a percentage of the first bit rate, changes in which percentage are inversely related to changes in the first bit rate;
- d) reading the bit stream out of the buffer at the second bit rate.
- By the provision of the “tunable delay” resulting from the varied output and input bit rates in the encoder buffer, the contents of the nominal decoder buffer will remain substantially constant. The relationship between input and output rates means that at high input signal bit rates, where the remainder of the buffering system (provided by the encoder stage and the decoder) provides a relatively low delay, the tunable delay provides a relatively high delay. At low input signal bit rates, the tunable delay is reduced to counter the relatively higher delay introduced by the remainder of the buffering system.
- The range of possible input bit rates may suitably be divided into discrete levels with a derived second bit rate being maintained constant until an input signal bit rate within a different one of the levels is detected at which point the second bit rate is recalculated. For a minimum input bit rate, the second bit rate is suitably set to equal that bit rate: in other words, at minimum input bit rate, the delay is set to zero.
- Successive groupings of one or more image frames may be specified with the second bit rate being derived from the first frame of the grouping and maintained constant until the bit rate of the first frame of a succeeding grouping is detected. The groupings may be determined on the basis of successive frames within a range of bit rates as mentioned above or may be specified on other criteria. For signals encoded according to the MPEG standard, a first grouping may be specified for I-pictures, with one or more other groupings for other types of image.
- Also in accordance with the present invention there is provided a video signal encoding apparatus operable to encode a digital video signal for transmission, the apparatus comprising an encoder stage operable to encode a received video signal according to a predetermined coding scheme and to output the signal as a variable bit-rate data stream and a buffer coupled to receive the said variable bit-rate data stream from the encoder and arranged to output a data signal for transmission; characterised by means operable to detect the bit-rate of the said variable bit-rate data stream, to derive a second bit rate as a percentage of the encoder stage output bit rate, which percentage changes in inverse relation to changes in the encoder stage output rate, and to control the buffer output data signal bit rate at the said second bit rate.
- Further in accordance with the present invention there is provided an encoded video signal compressed (for transmission) by the method recited above. The signal, comprising a bit stream of encoded data for a succession of image frames, has its instantaneous bit rate inversely related to the bit density of an image frame n frame periods later where n is determined by the said bit density. As will be understood, the bit rate of the uncompressed signal is determined by the bit density, and the n frame periods (where n is not necessarily an integer) corresponds to the lag introduced by the tunable delay.
- Preferred embodiments of the present invention will now be described, by way of example only, and with reference to the accompanying drawings in which:
-
FIG. 1 schematically represents a series of image frames coded according to the MPEG standard; -
FIG. 2 is a block diagram of part of an encoder apparatus embodying the invention; -
FIG. 3 represents usage of the encoder buffer of the apparatus ofFIG. 2 in relation to decoder buffer usage; -
FIG. 4 graphically represents increase in decoder buffer fullness over time; -
FIG. 5 represents a modified version ofFIG. 3 embodying the present invention; -
FIG. 6 schematically illustrates the combination of video and MPEG program streams; and -
FIG. 7 represents skew resulting from bit-rate changes. - The following description is concerned with the management of MPEG-coded video signals by way of example, although it will be readily appreciated by the skilled practitioner that the invention is not restricted to such coding standards.
- The MPEG standard describes a syntax and semantics of bit streams for compressed video and associated audio. Whilst the semantics in principle specify the functionality of the decoder, the standard provides no prescriptions for the decoder architecture. Each decoder will have an input buffer of some sort but how this is to be realized and what exact size this buffer must have is not specified.
- Recognising the importance of random access for stored video and the significant bit-rate reduction that may be obtained through motion-compensated interpolation, the MPEG standard recognises three types of pictures (frames) namely intra-pictures, predicted pictures and interpolated pictures, generally referred to as I, P, and B-pictures respectively. I-pictures provide access points for random pictures and accordingly have only limited compression. P-pictures are coded with reference to a past (I or P) picture and often form a reference for future P-pictures. B-pictures have the highest degree of compression but require both a past and future reference for prediction. A typical MPEG sequence of I, P and B-pictures is shown in
FIG. 1 . - A schematic representation of an MPEG encoder is shown in
FIG. 2 . A received video signal is passed toencoder stage 10 together with a control signal which varies the quantisation coarseness of the encoding. In many cases (although not for joint bit rate encoding) the control signal is kept constant to maintain coarseness at the same average level. The control signal is derived on the basis of the incoming video signal bydetector 12. The output of theencoder stage 10 is passed to anencoder buffer 14 at a first bit rate and also to acalculation unit 16. Thecalculation unit 16 derives a value for a second bit rate and passes this to aheader insertion stage 18 which reads the signal bit stream out of the buffer at the second bit rate and places the bit stream on a communication channel for transmission to a receiver/decoder. The basis of the calculations performed byunit 16 to derive an appropriate second bit rate will now be described in terms of a theoretical encoder/decoder buffer arrangement. - The MPEG standard constrains bit streams such that they may not overflow or underflow a hypothetical buffer: this hypothetical buffer can be related to the physical buffers appearing in the signal encoder and decoder stages.
- In studies of buffer management problems, analysis of the combination of the encoder buffer and the decoder buffer uses a model of the two buffers as shown in
FIG. 3 : this model will be used to explain the problem that occurs in a variable bit-rate situation. - The MPEG standard is partitioned in three parts: the video part, the audio part and the systems part. The video part contains a mechanism called the VBV and the systems part contains a part called the transport system target decoder (T-STD). MPEG decoders are realisable because the signal (bitstream) has to fulfil certain conditions, and bitstreams that fulfil the VBV condition (or similar for T-STD) are said to be compliant. Since bitstreams must fulfil the VBV condition it is possible to design decoders that can decode compliant bitstreams.
- The VBV definition is based on a hypothetical decoder which reads the compressed pictures in zero time from the VBV buffer and a channel that continuously fills up the buffer.
FIG. 4 shows characteristic VBV buffer contents as a function of time for a part of the MPEG frame sequence ofFIG. 1 . The VBV is specifically defined for constant bit-rate operation. In case of variable bit-rate operation, the MPEG standard specifies that the definition of the VBV buffer is overruled by the definition of the T-STD. - The bitstream is written into the buffer at the bit-rate specified in the sequence header. The bitstream contains information about the contents of the VBV buffer. This information is presented in a field in each picture header called the VBV delay, which specifies the time between the moment that the header enters the VBV buffer and the moment of decoding the picture.
- In the systems part of the MPEG standard, mechanisms are defined that provide means to synchronise the decoder. These mechanisms are called the decoding time stamp (DTS) and the presentation time stamp (PTS) which are measured in time units. The mechanism of system clock reference (SCR) is used to recover the correct time. The complete decoding operation is described again in terms of a hypothetical decoder which is referred to as the standard target decoder (STD). The systems part describes two types of systems layer: the transport stream and the program stream. The STD for the transport stream is referred to as T-STD and for the program stream the term P-STD is used. In the following the difference between these streams is explained.
- In principle the program stream is defined for applications which have a very low error probability such as optical recording. The basic characteristic of the program stream is that it can convey only one program and that the bit-rate can be varying: as such it may be of limited general use. Of greater utility is the transport stream, which is intended for multi-program environments. The bit-rate for each program is allowed to vary but the sum of all bit-rates must be constant. The transport stream uses a fixed size packets of 188 bytes. The T-STD can be used for HD-CD (VBR optical medium) by reading a variable bit-rate from the disk and adding an artificial empty program to the bitstream in passing the information from the reader on to the decoder such that the total bit-rate is constant. The definition of the functionality of both the P-STD and the T-STD is similar. We have recognised that a problem in conventional buffer-management is that the available buffer space in the decoder depends on the bit rate. At low bit rate we have too small an effective decoder buffer available that will hamper the image quality.
- Referring back now to the model of
FIG. 3 , the buffering model uses the following parameters -
- the (discrete) time n
- the current bit rate R[n]
- the input-output delay d
- physical encoder buffer size BE
- physical decoder buffer size BD
- encoder buffer pointer E[n]
- decoder buffer pointer D[n]
- range of decoder buffer pointer Dmin[n]≦D[n]<Dmax[n]
- range of encoder buffer pointer Emin[n]≦E[n]<Emax[n]
- It will be noted that the range of the buffer points is introduced as a separate variable which is time dependent, with the current buffer pointers E[n] and D[n] representing the buffer contents. A key variable in the buffer system is the input-output delay d which denotes the time between inputting a picture to the encoder and the time that this picture is decoded by the decoder. In the following derivations, we assume d to be an integer number of pictures, although non-integer values are possible as well. This variable is necessarily constant over the entire sequence since otherwise a non-continuous display would result, affecting motion portrayal.
- We assume that the buffers are operated in the following way
E[n]=E[n−1]−R[n]+p[n]
D[n]=D[n−1]+R[n]−p[n−d] (Equation 1)
In this model we assume an action (next n) every new picture. From this buffer behaviour model the following relation between the encoder buffer contents and the decoder buffer contents can be derived
FromEquation 2 we can derive relation between the boundaries of the buffer contents which yields
This equation shows that underflow in the encoder is linked to overflow in the decoder and vice versa; the encoder buffer and decoder buffer have dual behaviour. Clearly, there is a lag of d samples between encoder and decoder constraints. - A common choice (that is made in the Reibman and Haskell paper mentioned previously) is to select:
D min [n]=E min [n−d]=0 (Equation 4) - This choice means that underflow in either of the two buffers is in fact a physical underflow and, hence, a loss of data. Underflow in the encoder means the following violation on the decoder side of
- Hence the maximum available buffer space in the decoder depends on the (integrated) bit rate over the past d samples. This may lead to problems if, for instance, the bit rate is constant over more than d samples. In such a situation we have
D max [n]=d·R (Equation 7)
hence at a low bit-rate we have a small effective decoder buffer available. At a low bit-rate we still may have relatively large I-pictures, which can happen for scenes with high detail and absolutely no motion. Since the available buffer space is small, it is a conventional technique to reduce the quality of that I-picture such that the buffer constraint in Equation 5 is not violated. - Our solution to this problem is to have a small delay, as shown in
FIG. 5 and also to use a relatively high bit-rate for the I-picture. The small delay averages out over a small number of pictures, and hence a small bit-rate peak will help. The special treatment of I-pictures means that over a series of pictures such as the sequence ofFIG. 1 , we use two bit-rates; a relatively high one for the period of time containing the I-pictures and a lower one for the other classes of pictures. This provides us with higher peak bit-rates. For the sequence ofFIG. 1 , we therefore have three groups of pictures (GOP's), one for each of the I-pictures and one for the GOP of P- and B-pictures between them, with the bit-rate remaining constant (either high or low) in each GOP. If desired, a third bit-rate (between the relatively high and relatively low levels) may be specified for P-pictures in which case the sequence ofFIG. 1 would comprise five GOP with the bit-rate following the pattern of high-low-medium-low-high over the series. - The use of this specified bit-rate technique in the encoder may be detected from the decoder by testing Equation 5 on the bit stream. If the equation yields an “overflow” it shows the technique to have been used.
- The choices for our larger encoder buffer and appropriate bit-rate over time will now be described. The conventional choice made in
Equation 4 is the source for existing problems: we have appreciated that by making an alternative choice more flexibility in the decoder is provided. We choose
Dmin=0
Dmax=BD (Equation 8)
which may be considered as an advance selection of the largest possible decoder buffer. As will be shown, this choice leads to a larger encoder buffer. Note that an alternative choice for the buffer, such as
will yield similar conclusions for the encoder buffer, unless A=0, B=1 (which is the case in the original problem). - Substituting the choices from
Equation 8 inEquation 3 yields - These equations show that the lower limit of the encoder buffer contents is non-zero which means that the encoder buffer must be larger than is conventional. In fact the physical size of the encoder buffer equals that of the decoder buffer plus some margin. The margin is calculated from the maximum and minimum bit rate on the channel as will be demonstrated below.
- Considering
Equation 10 for our analysis, analysis of the extremal values of Emin yields insight in important system characteristics. One end of the scale is reached when Emin=0. This situation will occur if we transmit for more than d symbols at the minimum bit rate. Substituting these assumptions inEquation 10 yields
B D =d·R min (Equation 12) - Thus we use the minimum bit rate to select the required delay. It is appreciated that this delay will generally be larger than in the conventional situation, but the actual value remains acceptable, especially in the case of recording applications.
- At the other end of the scale we find the required extra buffer size by considering that the encoder buffer size can be written as
B E =B D+margin (Equation 13)
where the margin is equal to the maximum value of Emin. The maximum value is reached if the bit rate is at its maximum value for more than d samples (pictures). In this case we find - Turning now to the calculation of the time dependent bit rate R[n], the decoder buffer content is required to be the same at the beginning and at the end of a GOP.
FIG. 4 illustrates this condition using the decoder buffer fullness. - From
Equation 1 it can be seen that this condition means
and keeping the bit rate R[i]=R constant over a GOP of length N pictures we have - From Equation 15 it will be appreciated that the channel bit rate has to change d samples after the source bit rate has changed and also that the bit rate will generally have to be changed within a picture, rather than at the header of a picture, although this may occasionally occur. The bit rate changes are shown in terms of the MPEG syntax in
FIG. 6 . - The MPEG transport stream is meant for multi-program environments and the program stream is meant for environments with one program, like optical recording.
FIG. 6 shows how a video bit stream can be wrapped in a program stream. In the program stream we have the MPEG concepts PACK-headers and PES-headers (PES-packetized elementary stream). The PACK-header contains information on the elementary stream rate (=ES−rate). Since PACK-headers are not necessarily constrained to precede picture-headers or PES-headers we are allowed to change the bit rate at any moment. - The consequences of Equation 15 and
Equation 16 are shown inFIG. 7 which shows the skew between moment of inputting the groups of pictures to the buffer and the moment of changing the bit rate: the continuous lines represent the time interval in which the bits resulting from compressing a GOP are written into the buffer, and the dashed lines indicate the time interval for which the output bit rate calculated for that GOP is applied. - In the foregoing, we have shown an enhanced buffer management strategy that does not put constraints on the quality of compression, for only a small extra delay.
- From reading the present disclosure, other modifications will be apparent to persons skilled in the art. Such modifications may involve other features which are already known in the design, manufacture and use of digital video signal encoding and decoding systems and devices and component parts thereof and which may be used instead of or in addition to features already described herein. Although claims have bene formulated in this application to particular combinations of features, it should be understood that the scope of the disclosure of the present application also includes any novel feature or any novel combination of features disclosed herein either explicitly or implicitly or any generalisation thereof, whether or not it relates to the same invention as presently claimed in any claim and whether or not it mitigates any or all of the same technical problems as does the present invention. The applicants hereby give notice that new claims may be formulated to such features and/or combinations of such features during the prosecution of the present application or of any further application derived therefrom.
Claims (4)
1-8. (canceled)
9. A video signal decoding apparatus for decoding a received digital video signal for transmission, the apparatus comprising:
an decoder stage for decoding a received video signal according to a predetermined coding algorithm and producing the decoded video signal as a variable bit-rate data stream at an output of said decoder stage;
a buffer coupled to receive said variable bit-rate data stream from the decoder stage and arranged to output a data signal corresponding thereto for transmission; and
a detector coupled to said decoder stage to detect the bit-rate of said variable bit-rate data stream,
a processor to derive a second bit rate as a percentage of the detected bit-rate, which percentage changes in inverse relation to changes in the detected bit rate,
a buffer control to control said buffer to produce said output data signal at second bit rate, and transmit the output data signal to a decoder buffer at the second bit rate; wherein the detected bit rate and said second bit rate are variable.
10. An apparatus according to claim 9 , wherein the decoder stage is configured to decode the received video signal in accordance with the MPEG standard.
11. An apparatus according to claim 9 , wherein said means for detecting a bit rate stores a plurality of contiguous ranges of bit rate values and, on first detecting a dencoder output bit rate falling within a first of said ranges, maintains the derived second bit rate substantially constant until a detected encoder output bit rate falls with another of said ranges.
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US11/003,992 US20050100094A1 (en) | 1994-12-28 | 2004-12-03 | Buffer management in variable bit-rate compression systems |
Applications Claiming Priority (3)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US36633994A | 1994-12-28 | 1994-12-28 | |
US08/901,338 US6944221B1 (en) | 1994-12-28 | 1997-07-28 | Buffer management in variable bit-rate compression systems |
US11/003,992 US20050100094A1 (en) | 1994-12-28 | 2004-12-03 | Buffer management in variable bit-rate compression systems |
Related Parent Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US08/901,338 Continuation US6944221B1 (en) | 1994-12-28 | 1997-07-28 | Buffer management in variable bit-rate compression systems |
Publications (1)
Publication Number | Publication Date |
---|---|
US20050100094A1 true US20050100094A1 (en) | 2005-05-12 |
Family
ID=23442599
Family Applications (2)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US08/901,338 Expired - Fee Related US6944221B1 (en) | 1994-12-28 | 1997-07-28 | Buffer management in variable bit-rate compression systems |
US11/003,992 Abandoned US20050100094A1 (en) | 1994-12-28 | 2004-12-03 | Buffer management in variable bit-rate compression systems |
Family Applications Before (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US08/901,338 Expired - Fee Related US6944221B1 (en) | 1994-12-28 | 1997-07-28 | Buffer management in variable bit-rate compression systems |
Country Status (10)
Country | Link |
---|---|
US (2) | US6944221B1 (en) |
EP (1) | EP0753235B1 (en) |
JP (1) | JPH09510070A (en) |
KR (1) | KR100407085B1 (en) |
CN (1) | CN1115055C (en) |
AT (1) | ATE194742T1 (en) |
DE (1) | DE69517966T2 (en) |
ES (1) | ES2150013T3 (en) |
TW (1) | TW295765B (en) |
WO (1) | WO1996020575A2 (en) |
Cited By (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20090290638A1 (en) * | 2008-05-26 | 2009-11-26 | Jean-Baptiste Henry | Simplified transmission method for a stream of signals between a transmitter and an electronic device |
US20100104210A1 (en) * | 2006-10-10 | 2010-04-29 | Stephane Mallat | Method and apparatus for spatio-temporal subband video enhancement with small time delay |
US20100158101A1 (en) * | 2008-12-22 | 2010-06-24 | Chung-Ping Wu | Bit rate stream switching |
WO2011011717A1 (en) * | 2009-07-24 | 2011-01-27 | Netflix, Inc. | Adaptive streaming for digital content distribution |
US9648385B2 (en) | 2009-07-24 | 2017-05-09 | Netflix, Inc. | Adaptive streaming for digital content distribution |
Families Citing this family (30)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
GB2307151A (en) * | 1995-11-10 | 1997-05-14 | British Broadcasting Corp | Digital coding of video signals |
GB9607162D0 (en) * | 1996-04-04 | 1996-06-12 | Digi Media Vision Ltd | Improvements in or relating to the transmission of data |
FR2748623B1 (en) * | 1996-05-09 | 1998-11-27 | Thomson Multimedia Sa | VARIABLE FLOW ENCODER |
US6011590A (en) * | 1997-01-03 | 2000-01-04 | Ncr Corporation | Method of transmitting compressed information to minimize buffer space |
US6023233A (en) * | 1998-03-20 | 2000-02-08 | Craven; Peter G. | Data rate control for variable rate compression systems |
CN100348044C (en) * | 1999-03-31 | 2007-11-07 | 松下电器产业株式会社 | Device for seamless-decoding video stream including streams having different frame rates |
JP4063508B2 (en) * | 2001-07-04 | 2008-03-19 | 日本電気株式会社 | Bit rate conversion device and bit rate conversion method |
KR100420601B1 (en) * | 2001-11-22 | 2004-03-02 | 에스케이 텔레콤주식회사 | Streaming service method of video data |
FR2835996A1 (en) * | 2002-02-12 | 2003-08-15 | Koninkl Philips Electronics Nv | METHOD FOR ENCODING A SEQUENCE OF DIGITAL IMAGES |
US7418037B1 (en) * | 2002-07-15 | 2008-08-26 | Apple Inc. | Method of performing rate control for a compression system |
US7769084B1 (en) | 2002-07-15 | 2010-08-03 | Apple Inc. | Method for implementing a quantizer in a multimedia compression and encoding system |
US7940843B1 (en) | 2002-12-16 | 2011-05-10 | Apple Inc. | Method of implementing improved rate control for a multimedia compression and encoding system |
US7804897B1 (en) | 2002-12-16 | 2010-09-28 | Apple Inc. | Method for implementing an improved quantizer in a multimedia compression and encoding system |
CN100568964C (en) | 2003-02-18 | 2009-12-09 | 诺基亚有限公司 | Picture decoding method |
CA2515354C (en) * | 2003-02-18 | 2013-08-06 | Nokia Corporation | A method for buffering media data in systems where decoding order is different from transmission order |
US8428117B2 (en) * | 2003-04-24 | 2013-04-23 | Fujitsu Semiconductor Limited | Image encoder and image encoding method |
US7535959B2 (en) | 2003-10-16 | 2009-05-19 | Nvidia Corporation | Apparatus, system, and method for video encoder rate control |
US20050201471A1 (en) | 2004-02-13 | 2005-09-15 | Nokia Corporation | Picture decoding method |
US7296205B2 (en) | 2004-02-18 | 2007-11-13 | Nokia Corporation | Data repair |
KR100678891B1 (en) * | 2004-07-30 | 2007-02-05 | 삼성전자주식회사 | Method and apparatus for contents' attribute adaptive buffer control in audio-video data receiving |
US9124907B2 (en) | 2004-10-04 | 2015-09-01 | Nokia Technologies Oy | Picture buffering method |
DE102006034414B4 (en) * | 2006-07-25 | 2010-12-09 | Nokia Siemens Networks Gmbh & Co.Kg | Arrangement and method for decoding digital data |
US8184692B2 (en) * | 2006-09-25 | 2012-05-22 | Framecaster, Inc. | Distributed and automated video encoding and delivery system |
US8578045B2 (en) * | 2007-02-14 | 2013-11-05 | Microsoft Corporation | Adaptive bandwidth utilization |
CN102860010A (en) | 2010-05-06 | 2013-01-02 | 日本电信电话株式会社 | Video encoding control method and apparatus |
ES2703005T3 (en) | 2010-05-07 | 2019-03-06 | Nippon Telegraph & Telephone | Control method of animated image coding, animated image coding apparatus and animated image coding program |
CN102870415B (en) | 2010-05-12 | 2015-08-26 | 日本电信电话株式会社 | Moving picture control method, moving picture encoder and moving picture program |
KR102244612B1 (en) | 2014-04-21 | 2021-04-26 | 삼성전자주식회사 | Appratus and method for transmitting and receiving voice data in wireless communication system |
KR102264161B1 (en) | 2014-08-21 | 2021-06-11 | 삼성전자주식회사 | Image Processing Device and Method including a plurality of image signal processors |
US11956158B2 (en) | 2020-06-08 | 2024-04-09 | Sky Peak Technologies, Inc. | Content shaping and routing in a network |
Citations (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US5561466A (en) * | 1993-06-23 | 1996-10-01 | Nec Corporation | Video and audio data multiplexing into ATM cells with no dummy cell used and ATM cell demultiplexing |
US5606369A (en) * | 1994-12-28 | 1997-02-25 | U.S. Philips Corporation | Buffering for digital video signal encoders using joint bit-rate control |
US5617145A (en) * | 1993-12-28 | 1997-04-01 | Matsushita Electric Industrial Co., Ltd. | Adaptive bit allocation for video and audio coding |
Family Cites Families (24)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
DE69032361T2 (en) * | 1989-03-16 | 1998-10-29 | Fujitsu Ltd | VIDEO / AUDIO MULTIPLEX TRANSMISSION SYSTEM |
FR2653953A1 (en) * | 1989-10-27 | 1991-05-03 | Philips Electronique Lab | ENCODING DEVICE COMPRISING A VARIABLE LENGTH ENCODER AND ASSOCIATED DECODING DEVICE. |
US5134476A (en) * | 1990-03-30 | 1992-07-28 | At&T Bell Laboratories | Video signal encoding with bit rate control |
GB9012538D0 (en) * | 1990-06-05 | 1990-07-25 | Philips Nv | Coding of video signals |
US5038209A (en) * | 1990-09-27 | 1991-08-06 | At&T Bell Laboratories | Adaptive buffer/quantizer control for transform video coders |
JP3187852B2 (en) * | 1991-02-08 | 2001-07-16 | ソニー株式会社 | High efficiency coding method |
US5159447A (en) * | 1991-05-23 | 1992-10-27 | At&T Bell Laboratories | Buffer control for variable bit-rate channel |
CA2068751C (en) * | 1991-05-24 | 1998-05-19 | Tokumichi Murakami | Image coding system |
WO1993015571A1 (en) * | 1992-01-29 | 1993-08-05 | Bell Communications Research, Inc. | Smoothing delay-sensitive traffic offered to atm networks |
US5241383A (en) * | 1992-05-13 | 1993-08-31 | Bell Communications Research, Inc. | Pseudo-constant bit rate video coding with quantization parameter adjustment |
JP3164647B2 (en) * | 1992-06-03 | 2001-05-08 | 株式会社東芝 | Video coding method and apparatus |
US5287182A (en) * | 1992-07-02 | 1994-02-15 | At&T Bell Laboratories | Timing recovery for variable bit-rate video on asynchronous transfer mode (ATM) networks |
US5426463A (en) * | 1993-02-22 | 1995-06-20 | Rca Thomson Licensing Corporation | Apparatus for controlling quantizing in a video signal compressor |
US5410355A (en) * | 1993-04-02 | 1995-04-25 | Rca Thomson Licensing Corporation | Video signal processor including input codeword buffer for providing stored codewords to codeword priority analysis circuit |
WO1994024823A1 (en) * | 1993-04-16 | 1994-10-27 | Data Translation, Inc. | Adaptive video compression using variable quantization |
JPH0730589A (en) * | 1993-07-06 | 1995-01-31 | Canon Inc | Data transmitter |
US5461619A (en) * | 1993-07-06 | 1995-10-24 | Zenith Electronics Corp. | System for multiplexed transmission of compressed video and auxiliary data |
JP3224465B2 (en) * | 1993-12-22 | 2001-10-29 | シャープ株式会社 | Image coding device |
JPH07212710A (en) * | 1994-01-21 | 1995-08-11 | Hitachi Ltd | Picture transmission method, picture transmitter, picture reception method, picture receiver and storage device coping with variable speed |
US5563961A (en) * | 1994-03-03 | 1996-10-08 | Radius Inc. | Video data compression method and system which measures compressed data storage time to optimize compression rate |
US5566208A (en) * | 1994-03-17 | 1996-10-15 | Philips Electronics North America Corp. | Encoder buffer having an effective size which varies automatically with the channel bit-rate |
US5541852A (en) * | 1994-04-14 | 1996-07-30 | Motorola, Inc. | Device, method and system for variable bit-rate packet video communications |
US5506844A (en) * | 1994-05-20 | 1996-04-09 | Compression Labs, Inc. | Method for configuring a statistical multiplexer to dynamically allocate communication channel bandwidth |
US5534944A (en) * | 1994-07-15 | 1996-07-09 | Matsushita Electric Corporation Of America | Method of splicing MPEG encoded video |
-
1995
- 1995-12-04 WO PCT/IB1995/001087 patent/WO1996020575A2/en active IP Right Grant
- 1995-12-04 AT AT95937990T patent/ATE194742T1/en not_active IP Right Cessation
- 1995-12-04 JP JP8520326A patent/JPH09510070A/en active Pending
- 1995-12-04 KR KR1019960704805A patent/KR100407085B1/en not_active IP Right Cessation
- 1995-12-04 EP EP95937990A patent/EP0753235B1/en not_active Expired - Lifetime
- 1995-12-04 ES ES95937990T patent/ES2150013T3/en not_active Expired - Lifetime
- 1995-12-04 CN CN95192467A patent/CN1115055C/en not_active Expired - Fee Related
- 1995-12-04 DE DE69517966T patent/DE69517966T2/en not_active Expired - Fee Related
- 1995-12-12 TW TW084113226A patent/TW295765B/zh active
-
1997
- 1997-07-28 US US08/901,338 patent/US6944221B1/en not_active Expired - Fee Related
-
2004
- 2004-12-03 US US11/003,992 patent/US20050100094A1/en not_active Abandoned
Patent Citations (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US5561466A (en) * | 1993-06-23 | 1996-10-01 | Nec Corporation | Video and audio data multiplexing into ATM cells with no dummy cell used and ATM cell demultiplexing |
US5617145A (en) * | 1993-12-28 | 1997-04-01 | Matsushita Electric Industrial Co., Ltd. | Adaptive bit allocation for video and audio coding |
US5606369A (en) * | 1994-12-28 | 1997-02-25 | U.S. Philips Corporation | Buffering for digital video signal encoders using joint bit-rate control |
Cited By (15)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20100104210A1 (en) * | 2006-10-10 | 2010-04-29 | Stephane Mallat | Method and apparatus for spatio-temporal subband video enhancement with small time delay |
US8229245B2 (en) * | 2006-10-10 | 2012-07-24 | Zoran (France) | Method and apparatus for spatio-temporal subband video enhancement with small time delay |
US20090290638A1 (en) * | 2008-05-26 | 2009-11-26 | Jean-Baptiste Henry | Simplified transmission method for a stream of signals between a transmitter and an electronic device |
US9225758B2 (en) * | 2008-05-26 | 2015-12-29 | Thomson Licensing | Simplified transmission method for a stream of signals between a transmitter and an electronic device |
US10097607B2 (en) | 2008-12-22 | 2018-10-09 | Netflix, Inc. | Bit rate stream switching |
US20100158101A1 (en) * | 2008-12-22 | 2010-06-24 | Chung-Ping Wu | Bit rate stream switching |
US9009337B2 (en) | 2008-12-22 | 2015-04-14 | Netflix, Inc. | On-device multiplexing of streaming media content |
US9060187B2 (en) | 2008-12-22 | 2015-06-16 | Netflix, Inc. | Bit rate stream switching |
US9319696B2 (en) | 2008-12-22 | 2016-04-19 | Netflix, Inc. | Bit rate stream switching |
US11589058B2 (en) | 2008-12-22 | 2023-02-21 | Netflix, Inc. | On-device multiplexing of streaming media content |
US10484694B2 (en) | 2008-12-22 | 2019-11-19 | Netflix, Inc. | On-device multiplexing of streaming media content |
WO2011011717A1 (en) * | 2009-07-24 | 2011-01-27 | Netflix, Inc. | Adaptive streaming for digital content distribution |
US9769505B2 (en) | 2009-07-24 | 2017-09-19 | Netflix, Inc. | Adaptive streaming for digital content distribution |
US9648385B2 (en) | 2009-07-24 | 2017-05-09 | Netflix, Inc. | Adaptive streaming for digital content distribution |
US9521354B2 (en) | 2009-07-24 | 2016-12-13 | Netflix, Inc. | Adaptive streaming for digital content distribution |
Also Published As
Publication number | Publication date |
---|---|
TW295765B (en) | 1997-01-11 |
CN1145154A (en) | 1997-03-12 |
DE69517966D1 (en) | 2000-08-17 |
EP0753235A1 (en) | 1997-01-15 |
JPH09510070A (en) | 1997-10-07 |
EP0753235B1 (en) | 2000-07-12 |
ES2150013T3 (en) | 2000-11-16 |
WO1996020575A3 (en) | 1996-09-06 |
CN1115055C (en) | 2003-07-16 |
KR100407085B1 (en) | 2004-03-20 |
KR970701984A (en) | 1997-04-12 |
WO1996020575A2 (en) | 1996-07-04 |
US6944221B1 (en) | 2005-09-13 |
DE69517966T2 (en) | 2001-02-15 |
ATE194742T1 (en) | 2000-07-15 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US6944221B1 (en) | Buffer management in variable bit-rate compression systems | |
US5606369A (en) | Buffering for digital video signal encoders using joint bit-rate control | |
US5963256A (en) | Coding according to degree of coding difficulty in conformity with a target bit rate | |
US6157674A (en) | Audio and video data transmitting apparatus, system, and method thereof | |
US6034731A (en) | MPEG frame processing method and apparatus | |
EP0618730B1 (en) | Priority processing of encoded video signal | |
US6327421B1 (en) | Multiple speed fast forward/rewind compressed video delivery system | |
JP3168243B2 (en) | Video signal encoding device | |
US6188700B1 (en) | Method and apparatus for encoding MPEG signals using variable rate encoding and dynamically varying transmission buffers | |
US7433946B2 (en) | Mechanism for transmitting elementary streams in a broadcast environment | |
US20090190666A1 (en) | Hypothetical reference decoder with low start-up delays for compressed image and video | |
US6418122B1 (en) | Method and apparatus for assuring sufficient bandwidth of a statistical multiplexer | |
US6181712B1 (en) | Method and device for transmitting data packets | |
US7379497B2 (en) | Encoded data outputting apparatus and method | |
US5410355A (en) | Video signal processor including input codeword buffer for providing stored codewords to codeword priority analysis circuit | |
US5694332A (en) | MPEG audio decoding system with subframe input buffering | |
US6351564B1 (en) | Method of switching of coded video sequences and corresponding device | |
EP0933949B1 (en) | Transmitting system, transmitting apparatus, recording and reproducing apparatus | |
EP0826289B1 (en) | Data multiplexing apparatus | |
EP0868087A2 (en) | Multiplexing apparatus and method, transmitting apparatus and method, and recording medium | |
KR20020026250A (en) | Video signal encoding and buffer management | |
US6546013B1 (en) | Method and apparatus for delivering reference signal information within a specified time interval | |
EP2557786B1 (en) | Delay controlled decoding apparatus and method | |
Lu et al. | Mechanisms of MPEG stream synchronization |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
STCB | Information on status: application discontinuation |
Free format text: ABANDONED -- FAILURE TO RESPOND TO AN OFFICE ACTION |