+

WO2001080570A2 - Regulation de debit et protection de tampon destinees a des programmes video a debit binaire variable sur un canal a debit binaire constant - Google Patents

Regulation de debit et protection de tampon destinees a des programmes video a debit binaire variable sur un canal a debit binaire constant Download PDF

Info

Publication number
WO2001080570A2
WO2001080570A2 PCT/US2001/040497 US0140497W WO0180570A2 WO 2001080570 A2 WO2001080570 A2 WO 2001080570A2 US 0140497 W US0140497 W US 0140497W WO 0180570 A2 WO0180570 A2 WO 0180570A2
Authority
WO
WIPO (PCT)
Prior art keywords
frame
frames
rate
program
current frame
Prior art date
Application number
PCT/US2001/040497
Other languages
English (en)
Other versions
WO2001080570A3 (fr
Inventor
Limin Wang
Original Assignee
General Instrument Corporation
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by General Instrument Corporation filed Critical General Instrument Corporation
Priority to MXPA02010321A priority Critical patent/MXPA02010321A/es
Priority to CA002406251A priority patent/CA2406251A1/fr
Priority to EP01969065A priority patent/EP1279292A2/fr
Priority to AU2001293355A priority patent/AU2001293355A1/en
Publication of WO2001080570A2 publication Critical patent/WO2001080570A2/fr
Publication of WO2001080570A3 publication Critical patent/WO2001080570A3/fr

Links

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
    • H04N21/236—Assembling of a multiplex stream, e.g. transport stream, by combining a video stream with other content or additional data, e.g. inserting a URL [Uniform Resource Locator] into a video stream, multiplexing software data into a video stream; Remultiplexing of multiplex streams; Insertion of stuffing bits into the multiplex stream, e.g. to obtain a constant bit-rate; Assembling of a packetised elementary stream
    • H04N21/2365—Multiplexing of several video streams
    • H04N21/23655—Statistical multiplexing, e.g. by controlling the encoder to alter its bitrate to optimize the bandwidth utilization
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/102—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or selection affected or controlled by the adaptive coding
    • H04N19/103—Selection of coding mode or of prediction mode
    • H04N19/114—Adapting the group of pictures [GOP] structure, e.g. number of B-frames between two anchor frames
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/102—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or selection affected or controlled by the adaptive coding
    • H04N19/115—Selection of the code volume for a coding unit prior to coding
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/102—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or selection affected or controlled by the adaptive coding
    • H04N19/124—Quantisation
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/134—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or criterion affecting or controlling the adaptive coding
    • H04N19/146—Data rate or code amount at the encoder output
    • H04N19/152—Data rate or code amount at the encoder output by measuring the fullness of the transmission buffer
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/169—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding
    • H04N19/17—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object
    • H04N19/172—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object the region being a picture, frame or field
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/169—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding
    • H04N19/177—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being a group of pictures [GOP]
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/60—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using transform coding
    • H04N19/61—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using transform coding in combination with predictive coding
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
    • H04N21/236—Assembling of a multiplex stream, e.g. transport stream, by combining a video stream with other content or additional data, e.g. inserting a URL [Uniform Resource Locator] into a video stream, multiplexing software data into a video stream; Remultiplexing of multiplex streams; Insertion of stuffing bits into the multiplex stream, e.g. to obtain a constant bit-rate; Assembling of a packetised elementary stream
    • H04N21/2365—Multiplexing of several video streams
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
    • H04N21/24—Monitoring of processes or resources, e.g. monitoring of server load, available bandwidth, upstream requests
    • H04N21/2401—Monitoring of the client buffer

Definitions

  • the present invention relates to rate control and buffer management during coding of digital video programs.
  • the invention discusses rate control and buffer protection issues for transmitting multiple VBR (variable bit rate) video programs over a constant-rate channel.
  • VBR variable bit rate
  • several programs e.g., channels
  • the aggregate bit rate of the programs must be no greater than the communication channel rate. This can be achieved by controlling either each individual program bit rate using independent coding, or the aggregate bit rate using statistical multiplexing, also known as joint coding.
  • video materials such as films and the like may be pre-compressed and stored for subsequent transmission. This presents difficulties when the stat mux attempts to integrate the pre-compressed program bit streams with the raw, uncompressed digital video sequences. Additionally, it is necessary to ensure that the encoder and decoder buffers do not overflow or underflow.
  • the system should be compatible with dynamic bit allocation strategies for joint coding of multiple video programs which assign a target bit rate for each program on a frame-by-frame basis according to the program's relative complexity.
  • the system should pre-determine the transmission rates of future frames so that the average input rate of each individual video stream to the respective decoder buffer is equal to the average output rate, and the total transmission rate of all programs is equal to the channel rate.
  • the system should enable the upper and lower bonds of the encoder and decoder buffers to be measurable at the encoding end at the current frame instant .
  • the present invention provides a rate control and buffer protection system that provides the above and other advantages .
  • the present invention relates to rate control and buffer management during coding of digital video programs .
  • a system is presented for rate control and buffer management during coding of multiple variable bit rate digital video programs over a constant bit rate channel .
  • Buffer fullness is modeled on a frame-by-frame basis.
  • Buffer protection is achieved by applying additional constraints on the target rates.
  • For encoder buffer protection we set the upper and lower bounds for the aggregate rate of programs.
  • For decoder buffer protection we limit the dynamic range of each individual program rate . Both the upper and lower bounds are time-varying functions (i.e., on a frame-by- frame basis) .
  • the system is suitable for use in a hierarchical bit allocation scheme that includes a super group of pictures (GOP) level, a super frame level, and a frame level.
  • GOP super group of pictures
  • a particular method for coding a plurality L of variable bit rate video programs includes the step of allocating bits for coding the video programs according to a hierarchical scheme that includes at least: (a) a super group of pictures (GOP) level, wherein a super GOP comprises at least one GOP from each of the video programs, and has a length of N frames, and (b) a frame level .
  • a transmission rate is set for the respective current nth frame according to an average number of compressed bits for at least N previous frames, including a frame starting at N'+N-l frames before the current frame, a frame ending at N' frames before the current frame, and intermediate frames therebetween.
  • N' is a decoding delay of a modeled decoder that receives a respective video program.
  • the transmission rate may be set based on an average number of compressed bits for 45 previous frames, including a frame starting at 59 frames before the current frame, and a frame ending at 15 frames before the current frame .
  • FIG. 1 illustrates an encoder/decoder in accordance with the present invention.
  • FIG. 2 illustrates a super group-o -pictures (GOP) construct in accordance with the present invention.
  • FIG. 3 illustrates a super frame construct in accordance with the present invention.
  • FIG. 4 illustrates a plot of encoder buffer fullness vs. time in accordance with the present invention.
  • FIG. 5 illustrates a plot of decoder buffer fullness vs. time in accordance with the present invention.
  • FIG. 6 illustrates a window of N super frames in accordance with the present invention.
  • the present invention relates to rate control and buffer management during coding of digital video programs .
  • a dynamic bit allocation strategy for joint coding of multiple video programs has been discussed in L. Wang and A. Vincent, "Bit allocation and constrains for joint coding of multi-program transmission", IEEE Trans, on Circuits and Systems for Video technology, vol. 9, pp. 949-959, Oct. 1999.
  • This dynamic bit allocation strategy assigns a target rate for each program on a frame-by-frame basis according to the program relative complexity, which results in a relatively uniform quality among programs as well as within a program.
  • Buffer protection is provided for a dynamic bit allocation strategy for joint coding of multiple video programs by applying additional constraints on the target bit rates for the pictures.
  • decoder buffer protection requires control of transmission rates for future frames. These future transmission rates are predetermined so that the average input rate of each individual video stream to the respective decoder buffer is equal to the average output rate, and the total transmission rate of programs is equal to the channel rate. With the pre-settings on future transmission rates, the upper and lower bounds become measurable at the encoding end at the current frame instant . 1. INTRODUCTION
  • FIG. 1 shows an encoding end 100, a constant rate channel 160, and a decoding end 180, which may be a subscriber terminal (set-top box) , a personal computer, or other appliance at an end-user's location.
  • a number of uncompressed video programs program 1, program 2
  • program L one or more already-compressed bit streams, such as program L
  • transcoder 120 may be provided to respective transcoders, such as transcoder 120.
  • the terms coding, encoding and the like are used herein to refer to processing of both uncompressed and compressed video programs. Uncompressed programs are coded for the first time, while compressed programs are re-encoded, typically at a different bit rate.
  • the encoders 110, 115 and transcoders 120 encode the respective data according to a target bit rate assigned by a rate control function 105.
  • the encoded data is provided to a mux 125, and to a buffer 130 for transmission across the constant rate channel 160 to the decoding end 180.
  • the packets of a selected program are extracted and decoded.
  • the transmission is received at a demux 185 and provided to a buffer 190 at a data rate of R c 1/n+N ..
  • the buffer 190 outputs data at a rate R 1 ⁇ n to a decoder 195 to provide a decoded program, termed generically as program 1.
  • R c ⁇ ,n+N' denotes the number of coded bits received from the channel for program 1 during the (n+N')th frame period (i.e., between the frame instants of n+M' and n+N'+l - discussed further in connection with FIG.
  • n is a super frame index and N' is a decoding delay, e.g., the delay from the input to the encoder buffer to the output of the decoder buffer.
  • Rl,n denotes the number of bits for an nth frame period for an 1th program
  • the several video programs 1, . .. , L are squeezed into the single constant-rate channel 160, as shown in FIG. 1.
  • these programs will have to share the channel capacity. This can be achieved by controlling either each individual program rate (independent coding) or the aggregate rate (joint coding) .
  • independent coding independent coding
  • join coding extends the control to an additional dimension, that is, the program dimension. This gives more freedom in allocating the channel capacity over programs and, therefore, more control of the program quality.
  • joint coding is more efficient and effective than independent coding.
  • VBR video Joint coding controls only the aggregate rate while allowing each individual rate to vary. Hence, each individual video bit streams behaves more or less like VBR video.
  • the main merit of VBR video is constant quality. In fact, one of the necessary conditions for maximizing the overall quality is to have an equal quality for all the programs.
  • each encoder receives a target rate for each input frame from the rate control engine. The encoder then tries to meet the target rate by adjusting coding parameters, such as quantization parameter.
  • the resulting statistics such as the average quantization parameter used for a frame, the number of compressed bits generated for the frame, as well as buffer fullness, are then sent back to the rate control engine.
  • the rate control engine determines a new set of target rates for the upcoming, future frames.
  • buffers are inserted between the encoding end and the channel, and between the channel and the decoding end, as shown in FIG. 1. This bit allocation strategy results in relatively uniform quality among programs as well as within a program - a typical feature of VBR video . However, it is also the responsibility of the encoding/transmission end to prevent both the encoder and decoder buffers from overflowing or underflowing.
  • Buffer protection for VBR video is a much more challenging issue than for CBR (Constant Bit Rate) video.
  • CBR Constant Bit Rate
  • the decoder buffer is safe.
  • the same theory does not apply to VBR video.
  • buffer protection for VBR video is application-oriented.
  • the present invention provides buffer modeling and protection for transmitting multiple VBR videos over a constant-rate channel.
  • the fullness of encoder and decoder buffers is modeled on a frame-by-frame basis. Based on the models, we deduce the analytic upper and lower bounds for the target rates determined by the dynamic bit allocation.
  • the upper and lower bounds for encoder buffer protection apply to the aggregate rate only.
  • the average input rate of each individual video stream to the respective decoder buffer is equal to the average output rate
  • the total transmission rate of programs is equal to (or smaller than) the channel rate.
  • the first condition is for correct decoding
  • the second is for reliable transmission of the compressed bits.
  • the dynamic bit allocation scheme presented in the aforementioned paper by L. Wang et al . is of a hierarchical nature .
  • the input programs are conceptually divided into super GOPs with the same number of I-, P- and B- pictures.
  • the encoders in FIG. 1 are MPEG-2 encoders (ISO/MPEG II (DIS 13818-2) , "Generic Coding Of Moving Pictures And Associated Audio", March 1994) . Since the super GOPs contain the same number of I, P and B pictures, they are assigned the same nominal number of bits.
  • a super frame is then defined at each frame instant as a collection of frames, one from each of programs at the same frame instant .
  • a super frame is assigned a target rate according to the super frame relative complexity measures. The target rate of a super frame is then distributed over the frames within the super frame according to the frame complexities.
  • the three-step bit allocation strategy is summarized below.
  • FIG. 2 illustrates a super group-of-pictures (GOP) construct in accordance with the present invention.
  • the L programs are conceptually divided into super GOPs (i, N) , where L is the number of programs and N is the Least Common Multiple of program GOP lengths .
  • a first super GOP 200 includes data frames from program 1 (210) , program 2 (220) , . . . , through program L (290) .
  • Each program segment e.g., 210, 220, 290, contains a number of complete frames from one or more GOPs as discussed further in connection with FIG. 2.
  • a second super GOP 202 includes data frames from program 1 (212) , program 2 (222) , . . . , through program L (292) .
  • a third super GOP 204 includes data frames from program 1 (214) , program 2 (224) , . . . , through program L (294) .
  • N LCM(N X ,N 2 ,...,N L ) (1)
  • the super GOP length ⁇ 45. Since all super G0Ps (L, N) , with N defined in (1) , contain the same number of I, P and B pictures, they are assigned the same nominal number of bits, T LxN , i.e.,
  • FIG. 3 illustrates a super frame, which is a collection of L frames, one from each of L programs at the same time instant.
  • a super frame 300 which is a collection of L frames or pictures, one from each of the L programs taken at the same frame instant.
  • frame 310 from program 1, frame 320 from program 2, . . . , through frame 330 of program L are conceptually arranged in the super frame 300.
  • a super GOP consists of N super frames.
  • these L programs may have different GOP structures, the L frames in a super frame can have different picture types.
  • the target number of bits for super frame n is given as,
  • C ; is the complexity measure for frame n of program 1 with picture type t e ⁇ I,P,B ⁇ , and it can be either C u , C / P or C lJ3 , depending upon the associated picture type of I, P or B, respectively.
  • ⁇ l is the quality (or priority) weighting factor for program 1 , which is determined by the program provider .
  • ⁇ l n t is a constant factor used to compensate for the picture type t e ⁇ I,P,B ⁇ of frame n of program I. It can be either ⁇ t , ⁇ P or ⁇ B t depending upon the picture type I, P or B, respectively.
  • n l , n l p and n l B are, respectively, the remaining number of I, P and B pictures for program I in the current super GOP.
  • the numerator on the right side of equation (3) is the sum of complexity measures for all the frames in super frame n, and can be considered to be the complexity measure for the super frame .
  • the denominator is the sum of complexity measures for all the remaining frames in the current super GOP. Hence, a super frame is assigned a target rate proportional to the super frame's complexity measure.
  • T n l the target number of bits for (regular) frame n of program 2 within the super frame, T, , can be calculated as, ⁇ _ iPlYl,n,t Cl,n,t rp , . ,
  • a frame is assigned a target rate proportional to its complexity measure.
  • the bit allocation strategy assigns a regular frame a target rate based upon the frame complexity measure, the picture type, the program GOP structure, the program resolution, the program priority, as well as information from other programs. In general, more bits are allocated to higher complexity programs and fewer bits are allocated to lower complexity programs. Joint coding with dynamic bit allocation results in relatively uniform quality among programs as well as within program, as compared to independent coding.
  • R l n is the number of compressed bits for frame n of program 1.
  • R l n the encoding rate for program 2 as it is the rate generated for program 2 from the encoder.
  • B n e be the encoder buffer fullness at the frame instant n before the compressed bits of the nth frames, ⁇ R />B , are moved into the buffer 130, as shown in FIG. 4.
  • FIG. 4 shows a time-varying encoder buffer fullness.
  • the horizontal axis 400 is a frame or time index, while the vertical axis 410 shows the encoder buffer fullness B e (e.g., in units of bits) .
  • T. B' - B: ificillin > B ⁇ - B do;
  • T n refers otherwise
  • all the terms in the upper and lower bounds for T n are measurable at the frame instant of n at the encoding end.
  • FIG. 5 shows a time-varying decoder buffer fullness.
  • the horizontal axis 500 is a frame or time index, while the vertical axis 510 shows the decoder buffer fullness B d (e.g., in units of bits).
  • R l c n be the number of bits transmitted for program 1 during the nth frame period (between points 520 and
  • R ⁇ n the transmission rate for program 1 as it is the rate transmitted over the network for program 2.
  • the transmission rate for program 2 during the nth frame period may not be the same as the encoding rate for frame n, i.e. , R l n ⁇ R l n .
  • the decoder buffer will be filled up to ⁇ R ⁇ n , which does not necessarily equal B d raax , before any bits are moved out (see point 515) .
  • B d max has to hold the bits for N' frames before any bits are moved out the buffer.
  • the compressed bits for frame .n, R l n are moved out the decoder buffer (at point 530) and moved into the decoder instantaneously (to point 535) , and between the frame instants of n+N' and n+N' +l , the decoder buffer receives
  • R f ,n+N' bits from the network (FIGs 1 and 5) .
  • the transmission rates during the nth frame period and some other arbitrary mth frame period may not be the same, i.e., Rf n ⁇ Rf m for n ⁇ m .
  • Bf n+N be the decoder buffer fullness at the frame instant of n+N' after the compressed bits for frame n are moved out (point 535) .
  • Bf n+N is a local minimum and has to be equal to, or greater than, zero (or a non-zero minimum buffer fullness, if applicable), i.e., ⁇ B? ,n+N , (11)
  • the buffer fullness right before the frame instant of n+N'+l (point 540) is Bf N ,+R l c N ,. This is the local maximum and has to be equal to, or smaller than, the maximum decoder buffer size, R max , that is, ' +? ⁇ C ⁇ 12 >
  • B l e n is the fullness of a virtual encoder buffer for program 2 at the frame instant of n, defined in (15) , and it is available at the encoding end at the current frame instant of n .
  • the first condition is for correct decoding
  • the second is for reliable transmission of bits.
  • the transmission rate for frame n of program 1 equal to the average number of compressed bits for the N previous frames that are most recently moved out the decoder buffer (FIG. 5), i.e.,
  • N n" n'-N'-N+l where N is the super GOP length. Note that it may be possible to use other numbers of previous frames for the average, e.g., 2N, or averaging over other multiples of N, and so forth. Clearly, this setting of future transmission rates satisfies the first condition, that is, the average input rate to the decoder buffer is equal to the average output rate. It also makes the total transmission rate of L programs for any frame period of n, ⁇ ,_.êt > equal to the channel rate, i jR ⁇ n nel ⁇ bp f ) i that IS ,
  • FIG. 6 which is not necessarily to scale, shows a window of ⁇ (super) frames that contains the same number of I, P and B pictures.
  • ⁇ ' is the decoding delay set by the system
  • ⁇ is the super GOP length.
  • ⁇ ' can be greater than, equal to, or less than ⁇ .
  • ⁇ ' may be set to 15 frames, or 0.5 seconds (15 frames x 1 sec/30 frames).
  • N' is a constant no matter where the window is shifted.
  • n varies.
  • the window contains the same numbers of I, P and B pictures, just as a regular super GOP does.
  • the bits for the frames in the window should be equal to the nominal number for a super GOP, i.e., T LxN (see eqn. 1) .
  • T LxN the nominal number for a super GOP
  • R in + N ' — ( R !, n -N + ⁇ + — + R ⁇ ,n- ⁇ + ⁇ ,n) requires the information on
  • the present invention addresses buffer modeling and protection issues for transmitting multiple VBR video programs over a constant bit rate channel.
  • Buffer fullness is modeled on a frame-by-frame basis.
  • Buffer protection is achieved by applying additional constraints on the target rates.
  • For encoder buffer protection we set the upper and lower bounds for the aggregate rate of programs .
  • For decoder buffer protection we limit the dynamic range of each individual program rate. Both the upper and lower bounds are time-varying functions (i.e., on a frame-by- frame basis) .
  • We also pre-set the future transmission rates so that the following two conditions are met:
  • the average input rate of each individual video stream to the respective decoder buffer is equal to the average output rate (i.e., over a long time, the number of bits into the decoder buffer is equal to the number of bits out of the buffer, so there are no leftover bits in the buffer) , and
  • the total transmission rate of programs is equal to the channel rate.
  • the upper and lower bounds for decoder buffer protection become measurable at the current frame instant.
  • this allows decoder buffer protection to be managed at the encoding end.
  • Pre-compressed bitstreams may also be included in the rate control scheme .

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Compression Or Coding Systems Of Tv Signals (AREA)

Abstract

L'invention concerne un système de régulation de débit et de gestion de tampon au cours du codage de multiples programmes vidéos numériques à débit binaire variable sur un canal à débit binaire constant. Le système est bien adapté à une utilisation dans un schéma hiérarchique d'allocation binaire qui comprend un niveau (200, 202, 204) de super groupe d'images (GOP), un niveau de super trame (300), et un niveau de trame. Pour chaque super GOP d'une longueur de N trames, pour chaque programme vidéo (210, 220 290), le débit de transmission de la trame courante est établi selon le nombre moyen de bits comprimés pour au moins N trames précédentes, dont une trame commençant à N'+N-1 trames avant la trame courante, une trame se terminant à N' trames avant la trame courante, et des trames intermédiaires entre celles-ci. N' est un délai de décodage d'un décodeur modélisé qui reçoit un programme vidéo respectif. Les débits de transmission de trames futures sont, en outre, pré-établis de façon que le débit d'entrée moyen de chaque flux vidéo individuel vers le tampon de décodeur respectif (190) soit égal au débit de sortie moyen, et que le débit de transmission total de programmes soit égal au débit du canal.
PCT/US2001/040497 2000-04-19 2001-04-11 Regulation de debit et protection de tampon destinees a des programmes video a debit binaire variable sur un canal a debit binaire constant WO2001080570A2 (fr)

Priority Applications (4)

Application Number Priority Date Filing Date Title
MXPA02010321A MXPA02010321A (es) 2000-04-19 2001-04-11 Controlde velocidad y proteccion del circuito entermedio para programas de video de velocidad de bits variable sobre un canal de velocidad constante.
CA002406251A CA2406251A1 (fr) 2000-04-19 2001-04-11 Regulation de debit et protection de tampon destinees a des programmes video a debit binaire variable sur un canal a debit binaire constant
EP01969065A EP1279292A2 (fr) 2000-04-19 2001-04-11 Regulation de debit et protection de tampon destinees a des programmes video a debit binaire variable sur un canal a debit binaire constant
AU2001293355A AU2001293355A1 (en) 2000-04-19 2001-04-11 Rate control and buffer protection for variable bit rate video programs over a constant rate channel

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
US09/553,457 2000-04-19
US09/553,457 US6493388B1 (en) 2000-04-19 2000-04-19 Rate control and buffer protection for variable bit rate video programs over a constant rate channel

Publications (2)

Publication Number Publication Date
WO2001080570A2 true WO2001080570A2 (fr) 2001-10-25
WO2001080570A3 WO2001080570A3 (fr) 2002-08-15

Family

ID=24209474

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/US2001/040497 WO2001080570A2 (fr) 2000-04-19 2001-04-11 Regulation de debit et protection de tampon destinees a des programmes video a debit binaire variable sur un canal a debit binaire constant

Country Status (8)

Country Link
US (1) US6493388B1 (fr)
EP (1) EP1279292A2 (fr)
KR (1) KR20030005285A (fr)
CN (1) CN1215721C (fr)
AU (1) AU2001293355A1 (fr)
CA (1) CA2406251A1 (fr)
MX (1) MXPA02010321A (fr)
WO (1) WO2001080570A2 (fr)

Cited By (11)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2004052015A1 (fr) 2002-11-29 2004-06-17 Sony Corporation Codeur et son procede
WO2005041582A1 (fr) 2003-10-29 2005-05-06 Sony Corporation Codeur video et procede de commande de codage video
EP1912441A2 (fr) 2006-09-14 2008-04-16 OpenTV, Inc. Tamponnage et transmission des données vidéo à la demande
RU2389145C2 (ru) * 2005-04-11 2010-05-10 Телефонактиеболагет Лм Эрикссон (Пабл) Способ управления передачами пакетов данных для данных с переменным битрейтом
US8335873B2 (en) 2006-09-14 2012-12-18 Opentv, Inc. Method and systems for data transmission
US8594179B2 (en) 2005-07-14 2013-11-26 Intel Corporation Rate control method and apparatus
EP3562155A4 (fr) * 2016-12-21 2019-12-25 Hangzhou Hikvision Digital Technology Co., Ltd. Procédé et dispositif de contrôle du débit binaire
US11025958B2 (en) 2012-06-29 2021-06-01 Ge Video Compression, Llc Video data stream concept
US11122278B2 (en) 2012-04-13 2021-09-14 Ge Video Compression, Llc Low delay picture coding
US11303684B2 (en) 2006-09-14 2022-04-12 Opentv, Inc. Methods and systems for data transmission
RU2776357C1 (ru) * 2012-06-29 2022-07-19 ДжиИ Видео Компрешн, ЭлЭлСи Концепция потока видеоданных

Families Citing this family (38)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6754241B1 (en) 1999-01-06 2004-06-22 Sarnoff Corporation Computer system for statistical multiplexing of bitstreams
US6643327B1 (en) * 2000-05-05 2003-11-04 General Instrument Corporation Statistical multiplexer and remultiplexer that accommodates changes in structure of group of pictures
JP2001339460A (ja) * 2000-05-26 2001-12-07 Matsushita Electric Ind Co Ltd デジタル送受信装置
US6731685B1 (en) * 2000-09-20 2004-05-04 General Instrument Corporation Method and apparatus for determining a bit rate need parameter in a statistical multiplexer
US7418007B1 (en) 2000-09-20 2008-08-26 General Instrument Corporation Method and apparatus for determining a transmission bit rate in a statistical multiplexer
US7039115B1 (en) * 2000-09-20 2006-05-02 General Instrument Corporation Processor allocation for channels in a video multi-processor system
US6763067B2 (en) * 2000-10-10 2004-07-13 Sarnoff Corporation Rate control for bitstream re-encoding
DE60139632D1 (de) 2000-11-29 2009-10-01 British Telecomm Übertragen und empfangen von echtzeitdaten
US6694060B2 (en) * 2000-12-21 2004-02-17 General Instrument Corporation Frame bit-size allocation for seamlessly spliced, variable-encoding-rate, compressed digital video signals
EP1430706A4 (fr) * 2001-06-11 2011-05-18 Broadcom Corp Systeme et procede de codage video et audio multivoie sur une seule puce
EP1359722A1 (fr) 2002-03-27 2003-11-05 BRITISH TELECOMMUNICATIONS public limited company Système et procédé pour transmettre des flux de données
US7266133B2 (en) * 2002-11-13 2007-09-04 General Instrument Corporation Methods and apparatus for statistical multiplexing with distributed multiplexers
WO2004075554A1 (fr) * 2003-02-18 2004-09-02 Nokia Corporation Procede de decodage d'images
AU2004214313B2 (en) * 2003-02-18 2010-05-20 Nokia Technologies Oy Picture coding method
GB0306296D0 (en) 2003-03-19 2003-04-23 British Telecomm Data transmission
WO2004093404A1 (fr) * 2003-04-17 2004-10-28 Sharp Kabushiki Kaisha Emetteur, recepteur, systeme sans fil, procede de commande, programme de commande, et support d'enregistrement lisible par un ordinateur contenant le programme
US7343291B2 (en) 2003-07-18 2008-03-11 Microsoft Corporation Multi-pass variable bitrate media encoding
US7409097B2 (en) * 2003-11-14 2008-08-05 Vweb Corporation Video encoding using variable bit rates
US20050201471A1 (en) * 2004-02-13 2005-09-15 Nokia Corporation Picture decoding method
US7296205B2 (en) * 2004-02-18 2007-11-13 Nokia Corporation Data repair
CN100442796C (zh) * 2004-09-09 2008-12-10 上海川海信息科技有限公司 一种流媒体传输系统中的速率控制方法
US9124907B2 (en) * 2004-10-04 2015-09-01 Nokia Technologies Oy Picture buffering method
US7839948B2 (en) * 2005-12-02 2010-11-23 Qualcomm Incorporated Time slicing techniques for variable data rate encoding
US7864717B2 (en) * 2006-01-09 2011-01-04 Flextronics Automotive Inc. Modem for communicating data over a voice channel of a communications system
US9113194B2 (en) * 2007-12-19 2015-08-18 Arris Technology, Inc. Method and system for interleaving video and data for transmission over a network at a selected bit rate
US8325800B2 (en) * 2008-05-07 2012-12-04 Microsoft Corporation Encoding streaming media as a high bit rate layer, a low bit rate layer, and one or more intermediate bit rate layers
US8379851B2 (en) 2008-05-12 2013-02-19 Microsoft Corporation Optimized client side rate control and indexed file layout for streaming media
JP5250824B2 (ja) * 2008-05-30 2013-07-31 株式会社メガチップス トランスコーダ
US7925774B2 (en) 2008-05-30 2011-04-12 Microsoft Corporation Media streaming using an index file
CN102119486A (zh) * 2008-06-11 2011-07-06 新加坡国立大学 具有集成可调带通功能的cmos放大器
US8265140B2 (en) 2008-09-30 2012-09-11 Microsoft Corporation Fine-grained client-side control of scalable media delivery
WO2011025502A1 (fr) * 2009-08-31 2011-03-03 Hewlett-Packard Development Company, L.P. Réduction du retard de communication de données vidéo
US8340140B2 (en) * 2010-01-15 2012-12-25 General Instrument Corporation Statistical multiplexing using a plurality of encoders
US20110255594A1 (en) * 2010-04-15 2011-10-20 Soyeb Nagori Rate Control in Video Coding
US8630412B2 (en) 2010-08-25 2014-01-14 Motorola Mobility Llc Transport of partially encrypted media
US9167256B2 (en) * 2010-08-31 2015-10-20 Arris Technology, Inc. Method and apparatus for encoding
TWI505262B (zh) 2012-05-15 2015-10-21 Dolby Int Ab 具多重子流之多通道音頻信號的有效編碼與解碼
KR102543444B1 (ko) * 2017-08-29 2023-06-13 삼성전자주식회사 영상 부호화 장치

Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5986712A (en) 1998-01-08 1999-11-16 Thomson Consumer Electronics, Inc. Hybrid global/local bit rate control
WO2000013419A2 (fr) 1998-08-27 2000-03-09 General Instrument Corporation Affectation dynamique de bits pour le multiplexage statistique de signaux video numeriques comprimes et non comprimes

Family Cites Families (11)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5216503A (en) 1991-12-24 1993-06-01 General Instrument Corporation Statistical multiplexer for a multichannel image compression system
US5398072A (en) * 1993-10-25 1995-03-14 Lsi Logic Corporation Management of channel buffer in video decoders
US5506844A (en) 1994-05-20 1996-04-09 Compression Labs, Inc. Method for configuring a statistical multiplexer to dynamically allocate communication channel bandwidth
WO1996026608A2 (fr) 1995-02-22 1996-08-29 Philips Electronics N.V. Systeme de transmission simultanee d'une pluralite de programmes video sur une voie de transmission
GB9517130D0 (en) 1995-08-22 1995-10-25 Nat Transcommunications Ltd Statistical multiplexing
GB2307613B (en) * 1995-08-31 2000-03-22 British Broadcasting Corp Switching bit-rate reduced signals
US5963256A (en) 1996-01-11 1999-10-05 Sony Corporation Coding according to degree of coding difficulty in conformity with a target bit rate
GB9611511D0 (en) 1996-06-03 1996-08-07 Digi Media Vision Ltd Improvements in or relating to the bit-rate of a signal
US6243417B1 (en) * 1996-12-12 2001-06-05 Sony Corporation Device and method for encoding image data, and image data transmission method
US6038256A (en) 1996-12-31 2000-03-14 C-Cube Microsystems Inc. Statistical multiplexed video encoding using pre-encoding a priori statistics and a priori and a posteriori statistics
US6151362A (en) * 1998-10-30 2000-11-21 Motorola, Inc. Joint rate control for stereoscopic video coding

Patent Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5986712A (en) 1998-01-08 1999-11-16 Thomson Consumer Electronics, Inc. Hybrid global/local bit rate control
WO2000013419A2 (fr) 1998-08-27 2000-03-09 General Instrument Corporation Affectation dynamique de bits pour le multiplexage statistique de signaux video numeriques comprimes et non comprimes

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
See also references of EP1279292A2

Cited By (36)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US9654812B2 (en) 2002-11-29 2017-05-16 Sony Corporation Encoding apparatus and the method
EP2557787A1 (fr) * 2002-11-29 2013-02-13 Sony Corporation Appareil de codage et procédé
WO2004052015A1 (fr) 2002-11-29 2004-06-17 Sony Corporation Codeur et son procede
US9516361B2 (en) 2002-11-29 2016-12-06 Sony Corporation Encoding apparatus and the method
EP1581004A4 (fr) * 2002-11-29 2010-02-24 Sony Corp Codeur et son procede
US8798167B2 (en) 2002-11-29 2014-08-05 Sony Corporation Encoder and its method
EP2557786A1 (fr) * 2002-11-29 2013-02-13 Sony Corporation Procédé et appareil de décodage contrôlé par retard
EP2557788A1 (fr) * 2002-11-29 2013-02-13 Sony Corporation Appareil de codage et procédé
EP2557785A1 (fr) * 2002-11-29 2013-02-13 Sony Corporation Procédé et appareil de décodage contrôlé par retard
WO2005041582A1 (fr) 2003-10-29 2005-05-06 Sony Corporation Codeur video et procede de commande de codage video
EP1583365A4 (fr) * 2003-10-29 2011-11-30 Sony Corp Codeur video et procede de commande de codage video
RU2389145C2 (ru) * 2005-04-11 2010-05-10 Телефонактиеболагет Лм Эрикссон (Пабл) Способ управления передачами пакетов данных для данных с переменным битрейтом
US8594179B2 (en) 2005-07-14 2013-11-26 Intel Corporation Rate control method and apparatus
EP1912441A2 (fr) 2006-09-14 2008-04-16 OpenTV, Inc. Tamponnage et transmission des données vidéo à la demande
US8782305B2 (en) 2006-09-14 2014-07-15 Opentv, Inc. Methods and systems for data transmission
US7930449B2 (en) 2006-09-14 2011-04-19 Opentv Inc. Method and system for data transmission
EP1912441A3 (fr) * 2006-09-14 2008-04-23 OpenTV, Inc. Tamponnage et transmission des données vidéo à la demande
US9344470B2 (en) 2006-09-14 2016-05-17 Opentv, Inc. Methods and systems for data transmission
US12184711B2 (en) 2006-09-14 2024-12-31 Opentv, Inc. Methods and systems for data transmission
US9712581B2 (en) 2006-09-14 2017-07-18 Opentv, Inc. Methods and systems for data transmission
US11870829B2 (en) 2006-09-14 2024-01-09 Opentv, Inc. Methods and systems for data transmission
US10681097B2 (en) 2006-09-14 2020-06-09 Opentv, Inc. Methods and systems for data transmission
US8335873B2 (en) 2006-09-14 2012-12-18 Opentv, Inc. Method and systems for data transmission
US11303684B2 (en) 2006-09-14 2022-04-12 Opentv, Inc. Methods and systems for data transmission
US11122278B2 (en) 2012-04-13 2021-09-14 Ge Video Compression, Llc Low delay picture coding
US11259034B2 (en) 2012-04-13 2022-02-22 Ge Video Compression, Llc Scalable data stream and network entity
US11876985B2 (en) 2012-04-13 2024-01-16 Ge Video Compression, Llc Scalable data stream and network entity
US11343517B2 (en) 2012-04-13 2022-05-24 Ge Video Compression, Llc Low delay picture coding
US12192492B2 (en) 2012-04-13 2025-01-07 Ge Video Compression, Llc Low delay picture coding
RU2766882C2 (ru) * 2012-06-29 2022-03-16 ДжиИ Видео Компрешн, ЭлЭлСи Концепция потока видеоданных
US11025958B2 (en) 2012-06-29 2021-06-01 Ge Video Compression, Llc Video data stream concept
RU2776357C1 (ru) * 2012-06-29 2022-07-19 ДжиИ Видео Компрешн, ЭлЭлСи Концепция потока видеоданных
US11856229B2 (en) 2012-06-29 2023-12-26 Ge Video Compression, Llc Video data stream concept
US11956472B2 (en) 2012-06-29 2024-04-09 Ge Video Compression, Llc Video data stream concept
US10735740B2 (en) 2016-12-21 2020-08-04 Hangzhou Hikvision Digital Technology Co., Ltd. Bit rate control method and device
EP3562155A4 (fr) * 2016-12-21 2019-12-25 Hangzhou Hikvision Digital Technology Co., Ltd. Procédé et dispositif de contrôle du débit binaire

Also Published As

Publication number Publication date
US6493388B1 (en) 2002-12-10
AU2001293355A1 (en) 2001-10-30
MXPA02010321A (es) 2003-05-23
KR20030005285A (ko) 2003-01-17
CA2406251A1 (fr) 2001-10-25
WO2001080570A3 (fr) 2002-08-15
CN1215721C (zh) 2005-08-17
EP1279292A2 (fr) 2003-01-29
CN1436428A (zh) 2003-08-13

Similar Documents

Publication Publication Date Title
US6493388B1 (en) Rate control and buffer protection for variable bit rate video programs over a constant rate channel
US6643327B1 (en) Statistical multiplexer and remultiplexer that accommodates changes in structure of group of pictures
AU695550B2 (en) Buffering for digital video signal encoders using joint bit-rate control
TW519834B (en) Method and apparatus for determining a transmission bit rate in a statistical multiplexer
US5619341A (en) Method and apparatus for preventing overflow and underflow of an encoder buffer in a video compression system
JP3756346B2 (ja) ビデオ・フレームの多重ストリームを処理する方法及びシステム
TW454422B (en) Dynamic bit allocation for statistical multiplexing of compressed and uncompressed digital video signals
EP1149498B1 (fr) Procede de detection et de prevention de saturation par exces de largeur de bande dans un multiplexeur statistique
KR100777486B1 (ko) 압축된 이미지 및 비디오를 위한 낮은 기동 지연을 갖는가상의 표준 디코더
WO1998043376A1 (fr) Utilisation d'un modele de recepteur pour multiplexer des trains binaires a debit variable presentant des contraintes temporelles
KR20030061809A (ko) 다른 트랜스코딩 채널 사이에 대역폭 할당을 갖는 통계적리멀티플렉싱
GB2309611A (en) A motion video compression system with buffer empty/fill look-ahead bit allocation
GB2337392A (en) Encoder and encoding method
US8340140B2 (en) Statistical multiplexing using a plurality of encoders
KR100314329B1 (ko) 일정비트율엔코더를이용하는멀티플렉서
WO2000003548A9 (fr) Ensemble de compression de donnees comportant plusieurs canaux de compression de donnees
Hoang et al. A lexicographic framework for MPEG rate control
KR100233835B1 (ko) 분할화면 부호화를 위한 비트율 제어방법
AU678926C (en) Method and apparatus for preventing overflow and underflow of an encoder buffer in a video compression system

Legal Events

Date Code Title Description
AK Designated states

Kind code of ref document: A2

Designated state(s): AE AG AL AM AT AU AZ BA BB BG BR BY BZ CA CH CN CO CR CU CZ DE DK DM DZ EE ES FI GB GD GE GH GM HR HU ID IL IN IS JP KE KG KP KR KZ LC LK LR LS LT LU LV MA MD MG MK MN MW MX MZ NO NZ PL PT RO RU SD SE SG SI SK SL TJ TM TR TT TZ UA UG UZ VN YU ZA ZW

AL Designated countries for regional patents

Kind code of ref document: A2

Designated state(s): GH GM KE LS MW MZ SD SL SZ TZ UG ZW AM AZ BY KG KZ MD RU TJ TM AT BE CH CY DE DK ES FI FR GB GR IE IT LU MC NL PT SE TR BF BJ CF CG CI CM GA GN GW ML MR NE SN TD TG

121 Ep: the epo has been informed by wipo that ep was designated in this application
DFPE Request for preliminary examination filed prior to expiration of 19th month from priority date (pct application filed before 20040101)
WWE Wipo information: entry into national phase

Ref document number: 2406251

Country of ref document: CA

WWE Wipo information: entry into national phase

Ref document number: 1020027013918

Country of ref document: KR

WWE Wipo information: entry into national phase

Ref document number: PA/a/2002/010321

Country of ref document: MX

WWE Wipo information: entry into national phase

Ref document number: 2001969065

Country of ref document: EP

WWE Wipo information: entry into national phase

Ref document number: 018112986

Country of ref document: CN

WWP Wipo information: published in national office

Ref document number: 1020027013918

Country of ref document: KR

WWP Wipo information: published in national office

Ref document number: 2001969065

Country of ref document: EP

NENP Non-entry into the national phase

Ref country code: JP

WWW Wipo information: withdrawn in national office

Ref document number: 1020027013918

Country of ref document: KR

点击 这是indexloc提供的php浏览器服务，不要输入任何密码和下载