+

WO2008007717A1 - Dispositif de décodage d'image dynamique et dispositif de codage d'image dynamique - Google Patents

Dispositif de décodage d'image dynamique et dispositif de codage d'image dynamique Download PDF

Info

Publication number
WO2008007717A1
WO2008007717A1 PCT/JP2007/063860 JP2007063860W WO2008007717A1 WO 2008007717 A1 WO2008007717 A1 WO 2008007717A1 JP 2007063860 W JP2007063860 W JP 2007063860W WO 2008007717 A1 WO2008007717 A1 WO 2008007717A1
Authority
WO
WIPO (PCT)
Prior art keywords
block
pixel value
image
correction
average pixel
Prior art date
Application number
PCT/JP2007/063860
Other languages
English (en)
Japanese (ja)
Inventor
Tomoyuki Yamamoto
Maki Takahashi
Original Assignee
Sharp Kabushiki Kaisha
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Sharp Kabushiki Kaisha filed Critical Sharp Kabushiki Kaisha
Publication of WO2008007717A1 publication Critical patent/WO2008007717A1/fr

Links

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/85—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using pre-processing or post-processing specially adapted for video compression
    • H04N19/86—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using pre-processing or post-processing specially adapted for video compression involving reduction of coding artifacts, e.g. of blockiness
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/102—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or selection affected or controlled by the adaptive coding
    • H04N19/117—Filters, e.g. for pre-processing or post-processing
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/169—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding
    • H04N19/17—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object
    • H04N19/176—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object the region being a block, e.g. a macroblock
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/60—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using transform coding
    • H04N19/61—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using transform coding in combination with predictive coding
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/80—Details of filtering operations specially adapted for video compression, e.g. for pixel interpolation

Definitions

  • the present invention relates to a moving picture coding apparatus that divides and encodes a quantization target picture into a plurality of blocks, and a moving picture decoding apparatus corresponding to such a moving picture coding apparatus.
  • FIG. 18 is a functional block diagram showing a schematic configuration of a moving picture encoding apparatus 100 that encodes a moving picture by the H.264 / AVC moving picture encoding method.
  • the moving image coding apparatus 100 includes a DCT unit 1, a quantization unit 2, a variable length coding unit 3, an inverse quantization unit 4, an I DCT unit 5, a deblocking filter processing unit 6, A frame memory 7, a predicted image derivation unit 8, and an encoding control unit 10 that controls each of the above units are provided.
  • the DCT unit 1 divides a difference image obtained by subtracting a prediction image, which will be described later, from an original image into blocks each consisting of 4 ⁇ 4 pixels or 8 ⁇ 8 pixels, and orthogonally transforms the image signal of each block ( Integer precision DCT).
  • the transform coefficient obtained by the orthogonal transform (corresponding to the DCT coefficient in the discrete cosine transform) is sent to the quantization unit 2.
  • the quantization unit 2 quantizes the transform coefficient of each block according to the quantization parameter supplied from the encoding control unit 10. amount
  • the quantized representative value obtained as a result of the child quantization is sent to the variable length coding unit 3 and the inverse quantization unit 4.
  • variable length encoding unit 3 is based on the various encoding parameters supplied from the encoding control unit 10 and the quantization parameters (quantization representative values supplied from the quantization unit 3). The conversion coefficient of each block) is subjected to variable length coding. The encoded data obtained as a result of encoding by the variable length encoding unit 3 is sent to the moving picture decoding apparatus 200 described later.
  • the inverse quantization unit 4 inverts the quantization representative value (transform coefficient of each quantized block) supplied from the quantization unit 3 according to the quantization parameter supplied from the encoding control unit 10. Quantify. That is, the inverse quantization unit 4 restores the transform coefficient of each block from the quantized representative value by the reverse operation of the quantization operation by the quantization unit 2. The transform coefficient of each block restored by inverse quantization is sent to the IDCT unit 5.
  • the IDCT unit 5 converts the transform coefficient of each block obtained by inverse quantization into an image signal in the spatial domain, and restores the difference image.
  • the inverse orthogonal transform applied to the transform coefficient by the IDCT unit 5 is the inverse transform (integer precision IDCT) of the orthogonal transform applied by the DCT unit 1.
  • the local decoded image obtained by adding the difference image restored by the IDCT unit 5 and the predicted image is sent to the deblocking filter processing unit 6.
  • the deblocking filter processing unit 6 performs adaptive filtering on the local decoded image in order to remove block distortion in the local decoded image obtained by adding the prediction image and the difference image. Details of adaptive filter processing by the deblocking filter processing unit 6 will be described in detail later.
  • the locally decoded image from which block distortion has been removed by the deblocking filter processing unit 6 is temporarily stored in the frame memory 7.
  • the frame memory 7 can store a plurality of locally decoded images.
  • the locally decoded image stored in the frame memory 7 is referred to by the predicted image deriving unit 8 as a reference image.
  • the predicted image deriving unit 8 generates a predicted image from the reference image recorded in the frame memory 7 by performing intra prediction or inter prediction.
  • Intra prediction is a process for generating a predicted image by performing intra-frame prediction.
  • the predicted image derivation unit 8 is defined in the H.264 / AVC video coding standard. Intraframe prediction can be performed in multiple prediction modes (prediction algorithms). When intra prediction is performed, intraframe prediction is performed using the prediction mode specified by the encoding control unit 10.
  • Inter prediction is a process of generating a prediction image by inter-frame prediction (motion compensation prediction) based on the motion vector determined by the encoding control unit 10 and the reference image stored in the frame memory 7. is there.
  • the predicted image derivation unit 8 uses the block of the size specified by the encoding control unit 10 and also uses inter-frame prediction using a plurality of reference images specified by the encoding control unit 10. I do.
  • the encoding control unit 10 determines which prediction method is used to generate a prediction image among intra prediction and inter prediction, and designates the prediction method to the prediction image deriving unit 8. At this time, the encoding control unit 10 determines various encoding parameters according to the prediction method.
  • the coding parameters for performing intra prediction include information for specifying a prediction mode in intra prediction.
  • the coding parameters for performing inter prediction include information specifying a motion vector, a block size, and a reference image.
  • the encoding control unit 10 designates quantization parameters for the quantization unit 2 and the inverse quantization unit 4.
  • the moving image encoding apparatus 100 performs encoding of a moving image by repeating the following steps;!
  • Step 1 The encoding control unit 10 determines whether intra prediction or inter prediction is performed, and determines an encoding parameter and a quantization parameter necessary for encoding.
  • Step 2 According to the determination result in step 1, the predicted image generation unit 8 uses the prediction method specified by the encoding control unit 10 to predict the predicted image based on the reference image stored in the frame memory 7. Is generated.
  • Step 3 A difference image between the predicted image generated in Step 2 and the input original image is generated and supplied to the DCT unit 1.
  • Step 4 DCT unit 1, quantization unit 2 and force
  • the image signal of the difference image obtained in step 3 is orthogonally transformed for each block, and the obtained transform coefficient is quantized.
  • the obtained quantization representative value is variable-length encoded by the variable-length encoding unit 3 and output as encoded data.
  • the inverse quantization unit 4, the IDCT unit 5, the force S, and the quantized representative value obtained in step 4 are inversely quantized to restore the difference image.
  • Step 5 The difference image restored in Step 4 and the predicted image generated in Step 2 are added, and the obtained locally decoded image is supplied to the deblocking filter processing unit 6.
  • Step 6 The deblocking filter processing unit 6 removes block distortion from the local decoded image obtained in step 5, and the local decoded image with reduced block distortion is stored in the frame memory 7 as a reference image. Accumulated.
  • FIG. 19 is a functional block diagram showing a schematic configuration of a moving picture decoding apparatus 200 that decodes a moving picture by the H.264 / AVC moving picture coding method.
  • the moving picture decoding apparatus 200 includes an inverse quantization unit 4, an IDCT unit 5, a deblocking filter processing unit 6, a frame memory 7, a predicted image derivation unit 8, and a variable length decoding unit 20. It has.
  • variable length decoding unit 20 has a function of variable length decoding the encoding parameter and the quantized representative value (quantized transform coefficient).
  • the moving picture decoding apparatus 200 shown in FIG. 19 decodes encoded data by repeating the following steps;! To 6.
  • Step 1 From the encoded data acquired by the variable length decoding unit 20, the encoding parameter and the quantized representative value (quantized transform coefficient) are variable length decoded.
  • Step 2 The predicted image derivation unit 8 generates a predicted image based on the reference image stored in the frame memory 7 according to the decoded encoding parameter.
  • Step 3 Inverse quantization unit 4, IDCT unit 5, force S, quantization representative value obtained in step 1 Is dequantized to restore the difference image.
  • Step 4 The difference image restored in Step 3 and the predicted image generated in Step 2 are added, and the obtained decoded image is supplied to the deblocking filter processing unit 6.
  • Step 5 The deblocking filter processing unit 6 removes block distortion from the decoded image obtained in step 4, and stores the decoded image with reduced block distortion in the frame memory 7.
  • the decoded image stored in the frame memory 7 can be read at an arbitrary timing and used as a reference image or a display image.
  • Step 6 The decoded image stored in the frame memory is output to an image projection means such as a display at an appropriate timing as a display image.
  • both the moving picture coding apparatus 100 and the moving picture decoding apparatus 200 use the common deblocking filter processing unit 6! Block distortion that occurs during the quantization / inverse quantization process of moving images is reduced.
  • the deblocking filter processing unit 6 will be described in a little more detail with reference to FIGS.
  • FIG. 20 is an explanatory diagram showing a block division pattern of a quantization target image (difference image between an original image and a predicted image) in a moving image encoding process using the H.264 / AVC moving image encoding method. is there.
  • the quantization target image is divided into W X H rectangular blocks.
  • WX H blocks include B ⁇ in order from the upper left corner of the image to be quantized.
  • FIG. 21 is a diagram showing two adjacent blocks, block B and block B, in the quantization target image shown in FIG. As shown in FIG. 21, each of block B and block B is composed of a total of 16 pixels arranged in 4 rows and 4 columns. As with block B, all blocks B to B making up the quantization target image in Fig. 20 are arranged in 4 rows and 4 mm.
  • Each pixel constituting the quantization target image is a combination of a variable n that specifies a block including the pixel and variables u and V that specify the position of the pixel in the block B (n, u, v) Can be specified. That is, the pixel (n, u, v) is a pixel in the u-th column and the v-th row of the block B n .
  • the attribute value of the pixel (n, u, v) is expressed as X (n, u, v).
  • the pixel value of the pixel (n, u, v) in the quantization target image is expressed as P (n, u, v).
  • Transformation 'Quantization' Dequantization 'Inverse orthogonal transformation is a processing unit of a series of processing.
  • the image data of the quantization target image is converted into a conversion coefficient for each of the blocks B to B, and the amount is converted.
  • the deblocking filter processing unit 6 used in the H.264 / AVC moving image coding system includes a filter process between blocks (B, B) adjacent in the horizontal direction and a block (B , B) are performed independently of each other. Deblocky n n + W
  • the filter strength of the filter processing performed by the filtering filter processing unit 6 is adaptively set according to conditions such as the prediction mode applied to each block.
  • P (n, u, v) is a pixel in the processing target image (local decoded image in the moving image encoding device 100 or decoded image in the moving image decoding device 200) of the deblocking filter processing.
  • the pixel value (n, u, v) and P ′ (n, u, v) represent the pixel value of the pixel (n, u, v) in the filter output image output from the deblocking filter 6.
  • ⁇ '( ⁇ , 3, ⁇ ) _ ( ⁇ ( ⁇ , 1, ⁇ ) + 2 ⁇ ( ⁇ , 2, ⁇ ) + 2 0,3, ⁇ ) + 2 ⁇ ( ⁇ + 1,0, ⁇ ) + ⁇ ( ⁇ + 1,1, ⁇ )
  • ⁇ '0 + 1,0, upper [ ⁇ ( ⁇ , 2, ⁇ ) + 2 ⁇ ( ⁇ , 3, ⁇ ) + 2 ⁇ ( ⁇ + 1,0, ⁇ ) + 2 ⁇ ( ⁇ + 1,1, ⁇ ) + ⁇ ( ⁇ + 1,2, ⁇
  • ⁇ '( ⁇ + 1,1, ⁇ ) _ ( ⁇ ⁇ , ⁇ ⁇ ) + ⁇ ( ⁇ + 1,0, ⁇ ) + ⁇ ( ⁇ + 1,1,) + ("+ 1, 2, ⁇
  • ⁇ '( ⁇ + 1,2, ⁇ ) -(P (w, 3, ⁇ ) + ⁇ ⁇ + 1,0, ⁇ ) + Pin + 1,1, ⁇ ) + 3 ⁇ ( ⁇ + 1,2 , ⁇ ) + 2 ⁇ ( ⁇ + 1,3, ⁇ )
  • FIG. 22 is a graph showing pixel direct p (n, u, v) of the original image in block B and block B.
  • FIG. 22 (b) is a graph showing the pixel values P (n, u, v) of the decoded image to be processed by the deblocking filter processing unit 6 in block B and block B. As shown in (b) of FIG. 22, in the decoded image, discontinuous changes in pixel values at block boundaries, that is, block distortion occurs.
  • (c) of FIG. 22 is a graph showing pixel values (n, u, v) in block B and block B of the image after filtering the decoded image by the deblocking filter 6 Therefore, discontinuous changes in pixel values in the restored image to be encoded are smoothed, and block distortion is reduced.
  • Non-Patent Literature iTU_r Recommendation H.2D4: Advanced Video and oding for generic audiovisual services "(2003)
  • the average pixel value in each block is different before and after the filter processing. Therefore, when the conventional deblocking filter is used, the average pixel value in each block is not saved before and after the filter processing! /, So the average pixel value between the encoding target image and the decoded image is obtained by the filter processing. The difference can be enlarged.
  • the prediction image is generated in the moving image encoding apparatus using the local decoded image having a difference in average pixel values as compared to the encoding target image as a reference image.
  • a decoded image having an average pixel value difference with respect to the encoding target image is generated as a reference image or a display image. For this reason, blurring or flickering of the image in the moving image occurs.
  • the applicant applies a filtering process in Japanese Patent Application "Japanese Patent Application No. 2006-0756 85" to remove frequency components that generate block distortion from an encoding target image.
  • a moving picture encoding apparatus provided with filter processing means and a moving picture decoding apparatus provided with inverse filter processing means corresponding to the inverse transformation of the filter processing have been proposed.
  • the frequency component that generates block distortion is removed from the encoding target image by the filter processing unit, and the frequency component removed by the inverse filter processing unit is restored in the decoded image.
  • the filter processing means can be configured to keep the average value of the pixel values unchanged before and after the filter processing. Accordingly, it is possible to provide a moving image encoding apparatus and a moving image decoding apparatus that can reduce block distortion in a decoded moving image and that do not cause side effects such as blurring and flickering of the image.
  • the quantization process is an irreversible process
  • the output image of the filter processing means and the input image of the inverse filter processing means have a discrepancy at least for the quantization error. Therefore, the frequency component restored by the inverse filter processing unit cannot accurately reproduce the frequency component removed from the encoding target image by the filter processing unit.
  • the present invention has been made in view of the above-described problems, and an object of the present invention is to reduce block distortion in a decoded moving image and to prevent side effects such as image blur and flicker. It is a moving image encoding device and a moving image decoding device, and is to realize a moving image encoding device and a moving image decoding device that can restore more accurately the frequency components that generate the removed block distortion. .
  • the moving image encoding apparatus of the present invention quantizes a quantization target image subjected to a filter process for removing a frequency component that generates block distortion for each block.
  • a video decoding device that inverse-quantizes the quantized representative value obtained by the above, and for at least one block, the restoration value restored by the inverse quantization
  • the pixel value of each pixel of the quantization target image A restored quantization target image correcting means for performing correction by adding an approximate average pixel value approximating the average pixel value of the quantization target image in the block to which the pixel belongs, and the restored quantization target image subjected to the correction
  • an inverse filter processing means for performing an inverse filter process corresponding to an inverse transformation of the filter process.
  • a moving image encoding apparatus that divides a quantization target image subjected to filter processing to remove a frequency component that generates block distortion into a plurality of blocks, and quantizes the quantization target image for each block.
  • the average pixel value of each block of the quantization target image is preferably as small as possible. This is because by reducing the average pixel value of the quantization target image, the quantization level interval in the quantization can be set small, and the quantization error caused by the quantization can be reduced. is there.
  • the approximate average pixel value that approximates the average value of the quantization target image in the block to which the pixel belongs is subtracted from the pixel value of each pixel of the quantization target image. It is preferable to perform correction. This is because the average pixel value of each block of the corrected quantization target image can be reduced by performing the above correction. By using the approximate average pixel value that better approximates the average pixel value of the quantization target image, the average pixel value of each block of the corrected quantization target image is further reduced by the force S.
  • the same approximate average pixel value that is subtracted from the quantization target image by the moving image encoding device is used as the restored quantization target image by the moving image decoding device. Can be added. For this reason, the difference between the quantization target image after the filtering process and the restored quantization target image before the inverse filtering process is determined as only the quantization error that occurs during the quantization process. It becomes possible to do.
  • the average pixel value of each block of the quantization target image is gradually reduced by the correction performed on the moving image encoding device side, so that it is generated in the quantization process.
  • the amount of quantization error to be made is smaller than when the above correction is not performed.
  • the quantization target image may be the encoding target image itself encoded by the moving image encoding device, or a difference obtained by subtracting a predicted image from the encoding target image. It may be an image.
  • examples of the predicted image include a predicted image generated by using an intra-frame prediction process, an inter-frame prediction process, or the like using a locally decoded image as a reference image.
  • the inverse filter processing performed by the inverse filter processing means may correspond to a strict inverse transformation or an approximate inverse transformation with respect to the filter processing of the filter processing means. It may be what you do. In other words, the inverse filtering process is sufficient if it approximates a strict inverse transform within a range that does not adversely affect the quality of the final moving image. For example, the calculation accuracy of the filtering process (for example, integer precision) A degree of error is acceptable.
  • correction block designation information acquisition means for acquiring correction block designation information for designating a block to be corrected from the moving picture encoding apparatus for performing the quantization.
  • the restored quantization target image correcting unit performs the above correction on a block specified by the correction block specifying information.
  • the video decoding device acquires the correction block designation information from the video coding device, and performs the correction on the block designated by the correction block designation information.
  • the moving picture coding apparatus designates the corrected block designation information as a block that has been corrected to subtract the approximate average pixel value from the quantization target image, so that the moving picture decoding apparatus It is possible to perform correction by adding the approximate average value to the same block of the image to be converted.
  • correction block designation information may be encoded and provided from the moving picture coding apparatus, for example.
  • the correction block designation information acquisition procedure The stage can be configured to decode the encoded data and obtain the correction block designation information.
  • the moving picture decoding apparatus includes an average pixel value before correction obtained by averaging pixel values of each block of the restored quantization target image, and the approximate average pixel of the block from the average pixel value before correction.
  • a comparison estimation unit that estimates a magnitude relationship with a corrected average pixel value obtained by subtracting a value, and the restored quantization target image correction unit uses the comparison estimation unit to change the corrected average pixel value to the average pixel before correction. It is preferable that the correction is performed for blocks estimated to be smaller than the value.
  • the comparative estimation means estimates the magnitude relationship between the magnitude of the average pixel value before correction and the magnitude of the average pixel value after correction, and determines the magnitude of the average pixel value after correction. For the block estimated to be smaller, the correction is performed by the restored quantization target image correcting means. Therefore, the moving picture coding apparatus that performs the quantization performs correction for subtracting the approximate average pixel value for a block in which the size of the average pixel value after correction is smaller than the size of the average pixel value before correction. As the accuracy of the estimation increases, the quantization target image after the filtering process and the restored quantization target image before the inverse filtering process can be matched more accurately. Become possible
  • the comparison estimation means estimates, for example, that the average pixel value before correction matches the average pixel value after correction for a block in which the value of the approximate average pixel value is zero.
  • the approximate average pixel value is larger than a predetermined threshold value, it can be estimated that the corrected average pixel value is larger than the pre-correction average pixel value.
  • the approximate average pixel value is derived from the restored quantization target image! /.
  • the approximate average pixel value is derived from the restoration quantization target. Therefore, the moving image decoding apparatus performs the approximation without referring to the quantization target image. An average pixel value can be derived.
  • the moving image coding apparatus that performs the quantization also performs the inverse quantization on the quantization representative value obtained by the quantization so that the same image as the restored quantization target image is stored in the local apparatus. And the approximate average pixel value can be derived. Therefore, the moving picture decoding apparatus and the moving picture encoding apparatus can share the same approximate average pixel value. For this reason, there is an additional effect that the quantization target image after the filtering process and the restored quantization target image before the inverse filtering process can be matched more accurately. .
  • the video decoding device converts the approximate average pixel value of each block to the pixel value of the restored quantization target image in the adjacent block for which the approximate average pixel value is derived adjacent to the block.
  • the average pixel value of the quantization target image is the approximate average pixel value of the block and the correction is performed for the adjacent block
  • the average pixel value of the restored quantization target image in the adjacent block and the adjacent pixel It is preferable that the difference value from the approximate average pixel value of the block is the approximate average pixel value of the block.
  • the approximate average pixel value that closely approximates the quantization target image can be obtained based on the restored quantization target image. For this reason, it is possible to more accurately match the quantization target image after the filtering process and the restored quantization target image before the inverse filtering process. Play.
  • the video decoding device may derive the approximate average pixel value based on the pixel value of the restored quantization target image in one adjacent block! /, The approximate average pixel value may be derived based on the pixel values of the restored quantization target image in a plurality of adjacent blocks.
  • the average pixel value in a certain block of the restored quantization target image is obtained by, for example, inverse quantization of the restored quantization target image in the frequency domain in the block (the quantization representative value). It is possible to calculate from the DC component (corresponding to the DCT coefficient).
  • the moving picture decoding apparatus provides an approximation that correlates the approximate average pixel value of each block with the block selected by referring to a quantization parameter that specifies the quantization method.
  • Approximate average pixel value deriving means for deriving based on the pixel value of the restored quantization target image in the correlation block for which the average pixel value has already been derived, wherein the approximate average pixel value deriving means performs the correction for the correlation block.
  • the restoration in the correlation block is performed.
  • the difference value between the average pixel value of the quantization target image and the approximate average pixel value of the correlation block is used as the approximate average pixel value of the block. Arbitrariness is preferred.
  • the moving image decoding apparatus can accurately derive the approximate average pixel value of each block with reference to, for example, a prediction mode used for intra prediction. More specifically, a block whose prediction mode matches the prediction mode in the block is selected from among the blocks close to each block, and approximated as the average pixel value of the restored quantization target image in the selected block. An average pixel value can be derived.
  • a video encoding device is a video encoding device that divides a quantization target image into a plurality of blocks and quantizes each block.
  • Filter processing means for performing a filtering process on the quantization target image to remove a frequency component that generates block distortion, and each of the quantization target images on which at least one block has been subjected to the finer processing.
  • Quantization target image correction means for performing correction by subtracting an approximate average pixel value that approximates the average pixel value of the quantization target image in the block to which the pixel belongs from the pixel value of the pixel; It is characterized by.
  • the filter processing means removes a frequency component that generates block distortion from the encoding target image before quantization. Therefore, the quantization target image to be quantized above The frequency components that generate block distortion are removed in advance. Therefore, the restored quantization target image obtained by quantizing and dequantizing the quantization target image subjected to the filtering process by the filter processing means has reduced block distortion. Moreover, the frequency component previously removed by the filter processing means can be restored by inverse filter processing corresponding to the inverse transformation of the filter processing of the filter processing means. In other words, the moving picture coding apparatus having the above-described configuration can generate coded data that can restore a decoded image with reduced block distortion without losing a specific frequency component. And! /, Has the effect.
  • the average power of the quantization target image in the block to which the pixel belongs is calculated from the pixel value of each pixel of the quantization target image for at least one block. Since correction for subtracting the approximate average pixel value that approximates the value is performed, it is possible to reduce the average pixel value of each block of the quantization target image below the original average pixel value of the block. Therefore, the quantization level interval in the quantization can be set small, and the quantization error caused by the quantization can be reduced. For this reason, the quantization error generated in the quantization process can be further reduced. Therefore, the quantization target image after the filtering process can be more accurately matched with the restored quantization target image before the inverse filtering process.
  • the moving image encoding apparatus includes, for each block of the quantization target image, an average pixel value before correction obtained by averaging pixel values of the quantization target image in the block, and the average pixel before correction.
  • Average pixel value calculating means for calculating a corrected average pixel value obtained by subtracting the approximate average pixel value of the block from the value, and the average pixel value before correction for each block of the quantization target image!
  • a correction evaluation unit that compares the average pixel value after correction with the magnitude of the average pixel value after correction.
  • the quantization target image correction unit includes a correction evaluation unit that causes the average pixel value after correction to be greater than the average pixel value before correction.
  • the block determined to be small It is preferable that the above correction is performed for the lock.
  • the average pixel value before correction and the average pixel value after correction are compared in magnitude, and the block for which the average pixel value after correction is smaller than the average pixel value before correction Correction is performed. For this reason, the average pixel value of each block of the quantization target image can be reliably made equal to or less than the original average pixel value of the block. Therefore, the quantization level interval in the above quantization can be set smaller, and the quantization error generated by the quantization can be reduced. For this reason, it is possible to more accurately match the quantization target image after the filtering process and the restored quantization target image before the inverse filtering process. That is, there is an additional effect that encoded data that can restore a decoded image that more faithfully reproduces the encoding target image can be generated.
  • the quantization target image correcting unit corrects the moving image decoding device that inversely quantizes the quantized representative value obtained by the quantization. It is preferable that a correction block designation information providing unit for providing correction block designation information for designating a block is further provided.
  • the moving picture decoding apparatus with corrected block designation information for designating the block subjected to the correction in the moving picture encoding apparatus.
  • the video decoding device can perform correction complementary to the correction on the same block as the block on which the video encoding device has performed the correction based on the correction block designation information.
  • the moving picture decoding apparatus quantizes a quantization target image subjected to a filter process for removing a frequency component that generates block distortion for each block.
  • a video decoding device that inversely quantizes the obtained quantized representative value, wherein at least one block is restored by the above inverse quantization
  • a restored quantization target image correction unit that performs correction by subtracting an approximate quantization error that approximates a quantization error in a block to which the pixel belongs from the pixel value of each pixel of the quantization target image;
  • an inverse filter processing means for performing an inverse filter process corresponding to the inverse transform of the filter process on the restored quantization target image.
  • the moving picture decoding apparatus quantizes the quantization target image that has been subjected to the filter processing for removing the frequency component that generates block distortion.
  • the quantization target image is obtained by removing the frequency component that generates the block distortion in advance, the block distortion in the restored quantization target image restored by inverse quantization is suppressed.
  • the restored quantized image is restored by the inverse filter processing means with the frequency component removed during the encoding process. Therefore, the restored quantization target image that has been subjected to the above inverse filter processing is an image that has a reduced block distortion and does not lack a specific frequency component, that is, closely approximates the quantization target image. It becomes an image.
  • the moving picture decoding apparatus includes a decoded image correcting unit that subtracts an approximate quantization error that approximates a quantification error from the restored quantization target image, and is restored to the inverse filter processing means.
  • the quantization error in the quantization target image is reduced.
  • the restored quantization target image that is the processing target of the above inverse filtering process is a better approximation of the quantization target image that has been subjected to the filtering process. Therefore, the inverse filter processing means can more accurately restore the frequency component removed during the encoding process. That is, according to the above configuration, it is possible to obtain a decoded image in which the encoding target image is reproduced more faithfully.
  • the moving picture decoding apparatus obtains correction block designation information acquisition means for acquiring correction block designation information for designating a block to be corrected from the moving picture encoding apparatus that performs the quantization. It is preferable that the restored quantization target image correcting unit performs the correction on the block specified by the correction block specifying information.
  • the moving picture decoding apparatus acquires the correction block designation information from the moving picture encoding apparatus, and assigns the corrected block designation information to the block designated by the correction block designation information.
  • the above correction is performed.
  • the moving picture encoding apparatus can designate the block to be corrected to the moving picture encoding apparatus.
  • correction block designation information may be encoded and provided from the moving picture coding apparatus, for example.
  • the correction block designation information acquisition means can be configured to decode the encoded data and acquire the correction block designation information.
  • the approximate quantization error in each block is a weighted average value obtained by weighted average of the average pixel values of the restored quantization target image in each of the blocks in the vicinity of the block. And the difference value from the average pixel value of the restored quantization target image in the block!
  • the weighted average value is a good approximation of the restored quantization target image having no quantization error in each block. That is, the approximate quantization error obtained by subtracting the weighted average value from the average pixel value of the restored quantization target image is a good approximation of the true quantization error. Therefore, according to the above configuration, there is a further effect that it is possible to effectively reduce the quantization error in the restored quantization target image passed to the inverse filter processing means.
  • the moving picture encoding apparatus provides a plurality of encoding target images to which a filtering process for removing a frequency component that generates block distortion is performed by a filtering process.
  • a moving picture coding apparatus that divides into blocks and codes each block, local decoding means for decoding the coded data obtained by the above coding to obtain local decoded images, and for each block, Any one of the weighted average value obtained by weighted averaging the average pixel value of the local decoded image in each block adjacent to the block and the average pixel value of the local decoded image in the block is the value in the block.
  • Correction block instruction information that provides correction block instruction information for indicating a block that is determined to have a value that is closer to the average pixel value of the image to be encoded! / As a block that should be corrected.
  • the moving picture decoding apparatus performs, for example, correction for subtracting the approximate quantization error in the block to which the pixel belongs from the pixel value of each pixel of the decoded image for at least one or more blocks. If the approximate quantization error in each block is, for example, a value obtained by subtracting the weighted average value from the average pixel value of the decoded image in the block, the video decoding device The quantization error can be effectively reduced by the correction based on the correction block instruction information.
  • FIG. 1 is a functional block diagram showing a configuration of a video decoding device according to a first embodiment of the present invention.
  • FIG. 2 is a functional block diagram showing a basic form of a moving picture coding apparatus according to an embodiment of the present invention.
  • FIG. 3 is a functional block diagram showing a basic form of a video decoding apparatus according to an embodiment of the present invention.
  • FIG. 4 is a flowchart showing an outline of filter processing by a filter processing unit included in the video encoding device according to the embodiment of the present invention.
  • FIG. 5 is a graph showing the effect of the filter processing shown in FIG. (A) is a graph showing pixel values of the processing target image to be filtered, (b) is a graph showing average pixel values for each block of the processing target image, and (c) is a graph. Lines using average pixel values shown in (b) (D) is the pixel value of the filter output image.
  • FIG. 6 is a flowchart showing an overview of inverse filter processing by an inverse filter processing unit included in a video encoding device and video decoding device according to an embodiment of the present invention.
  • FIG. 7 is a graph showing the operation of the inverse filter processing shown in FIG.
  • A is a graph showing the pixel value of the processing target image to be subjected to the inverse filter processing
  • (b) is a graph showing the average pixel value for each block of the processing target image
  • (c) is a graph.
  • (B) is a graph showing the predicted value obtained by linear interpolation using the average pixel value shown in (b)
  • (d) is a graph showing the pixel value of the inverse filter output image.
  • FIG. 8 is a functional block diagram showing a configuration of a video encoding device according to the first embodiment of the present invention.
  • FIG. 9 shows an embodiment of the present invention, and is a functional block diagram showing a configuration of a correction determination unit in the moving picture encoding apparatus shown in FIG.
  • FIG. 10 An embodiment of the present invention, showing a configuration of a moving image encoding device shown in FIG. 8 and a corrected image candidate deriving unit in the moving image decoding device shown in FIG. FIG.
  • FIG. 11 A flowchart showing an embodiment of the present invention, and showing a flow of a corrected image candidate derivation process in the moving picture encoding apparatus shown in FIG. 8 and the moving picture decoding apparatus shown in FIG. It is.
  • FIG. 12 is a functional block diagram showing a configuration of a video encoding device according to a second embodiment of the present invention.
  • FIG. 13 is a functional block diagram showing a configuration of a video decoding device according to a second embodiment of the present invention.
  • FIG. 14 is a flowchart showing a flow of correction method determination processing in the video encoding apparatus shown in FIG. 12.
  • FIG. 15 is a graph showing the operation of the moving picture encoding apparatus and moving picture decoding apparatus according to the second embodiment of the present invention, and showing the pixel value of each pixel.
  • FIG. 14 is a flowchart showing a flow of inverse filter input correction processing in the video decoding apparatus shown in FIG.
  • FIG. 17 is a graph for explaining distortion in a decoded image caused by a quantization error in the video encoding device shown in FIG. 2 and the video decoding device shown in FIG. 3.
  • FIG. 18 is a functional block diagram showing a conventional technique and showing a configuration of a moving image encoding device including a deblocking filter.
  • Fig. 19 is a functional block diagram showing a conventional technique and showing a configuration of a video decoding device corresponding to the video encoding device shown in Fig. 18.
  • FIG. 20 is an explanatory diagram showing an image division pattern in a quantization target image to be quantized or a processing target image to be filtered.
  • the basic configuration of the video encoding device and the video decoding device will be described with reference to FIGS. Then, after pointing out the problems in the basic configuration, the video encoding device and the video decoding device according to the present embodiment realized by modifying the basic configuration will be described. .
  • FIG. 2 is a functional block diagram showing a main configuration of the moving picture coding apparatus 300.
  • the moving picture coding apparatus 300 includes a DCT unit 1, a quantization unit 2, a variable length coding unit 3, an inverse quantization unit 4, an IDCT unit 5, a frame memory 7, and a predicted image derivation unit. 8, an encoding control unit 21, a filter processing unit 11, and an inverse filter processing unit 12 are provided.
  • FIG. 2 Main Phases of the Video Encoding Device 300 in Fig. 2 and the Conventional Video Encoding Device 100 (Fig. 18)
  • the moving picture coding apparatus 300 includes a filter processing unit 11 and an inverse filter processing unit 12 instead of the conventional deblocking filter 6, and instead of the conventional coding control unit 10.
  • the encoding control unit 21 is provided.
  • blocks having the same functions as those of the conventional moving image encoding apparatus 100 are denoted by the same names and reference numerals as those in FIG. 18, and description thereof is omitted.
  • the encoding control unit 21 instructs the inverse filter processing unit 12 to execute the inverse filter processing.
  • the control signal is transmitted every predetermined encoding processing unit (for example, every block or every frame).
  • the filter processing unit 11 performs filter processing to remove a specific frequency component FL that generates block distortion from the processing target image.
  • the processing target image to be processed by the filter processing unit 11 is an encoding target image.
  • a differential image obtained by subtracting the prediction image generated by the prediction image deriving unit 8 from the encoding target image (filter output image) subjected to the filter processing by the filter processing unit 11 is quantized. Supplied as a target image.
  • the inverse filter processing unit 12 acquires a locally decoded image recorded in the frame memory 7 at the timing indicated by the control signal supplied from the encoding control unit 21.
  • the inverse filter processing unit 12 uses the locally decoded image as a processing target image, and performs an inverse filtering process corresponding to the inverse transformation of the filter processing performed by the filter processing unit 11 on the processing target image.
  • the locally decoded image (inverse filter output image) that has been subjected to the inverse filter processing by the inverse filter processing unit 12 is stored in the frame memory 7 as a reference image, and is used by the predicted image deriving unit 8 to generate the next predicted image. .
  • the DCT unit 1 and the quantization unit 2 divide the quantization target image into a plurality of blocks and quantize the image data of each block. Accordingly, block distortion may be included in a decoded image or a local decoded image obtained by adding a predicted image to a restored quantization target image restored by inverse quantization of the quantization representative value obtained by the quantization. That is, a locally decoded image generated inside the video encoding device 300 to generate a predicted image, and a video to be described later.
  • the decoded image generated by the image decoding device 400 may include block distortion.
  • the quantization target image supplied to the DCT unit 1 is a difference image between the filter output image subjected to the filter processing by the filter processing unit 11 and the predicted image.
  • the filter processing unit 11 acts on the processing target image so as to remove the frequency component FL that generates block distortion, it is possible to effectively reduce block distortion generated in the process of quantization and dequantization. .
  • the spatial frequency component lost in the quantization process in the conventional video encoding device 100 is temporarily removed by the filter processing unit 11 in the video encoding device 300, and the inverse filter is used.
  • the processing unit 12 By restoring by the processing unit 12, it is possible to avoid the influence of the quantization process and suppress the occurrence of block distortion.
  • the filter processing unit 11 and the inverse filter processing unit 12 are provided with a conventional moving picture encoding device.
  • the deblocking filter processing unit 6 in 100 can be configured to maintain the average pixel value (for example, average luminance level) before and after processing in each block. Therefore, it is possible to avoid problems such as image blurring and flickering during moving image playback caused by the deblocking filter processing.
  • the average pixel value for example, average luminance level
  • FIG. 3 is a functional block diagram showing a schematic configuration of a moving picture decoding apparatus 400 corresponding to the moving picture encoding apparatus 300 shown in FIG.
  • the video decoding device 400 includes an inverse quantization unit 4, an IDCT unit 5, a frame memory 7, a predicted image derivation unit 8, a variable length decoding unit 20, and an inverse filter processing unit 12. ing.
  • the encoded data decoded by the video decoding device 400 is generated by the video encoding device 300 based on the image from which the frequency component FL that generates block distortion is removed! /. is there.
  • the variable length decoding unit 20 of the video decoding device 400 decodes this encoded data. To do.
  • the inverse quantization unit 4 and the IDCT unit 5 perform inverse quantization on the value obtained by the decoding.
  • the restored quantization target image restored by inverse quantization corresponds to a difference image obtained by subtracting the predicted image from the original image.
  • the moving picture decoding apparatus 400 generates a decoded image by adding the predicted image generated by the predicted image deriving unit 8 to the restored difference image.
  • the inverse filter processing unit 12 included in the video decoding device 400 performs the same inverse filter processing as the inverse filter processing unit 12 included in the video encoding device 300. That is, the inverse filter processing unit 12 acts on the decoded image lacking the frequency component FL that generates block distortion to restore the frequency component FL removed by the filter processing.
  • the inverse filter output image that has been subjected to the inverse filter processing by the inverse filter processing unit 12 is referred to by the prediction image deriving unit 8 as a reference image for generating a prediction image, and is output to a display or the like as a reproduction image.
  • the frequency component FL removed from the encoding target image by the operation of the inverse filter processing unit 12 is restored in the reproduced image or the reference image. That is, the moving picture decoding apparatus 400 can output a reproduced picture in which a specific frequency component is not lost at the same time that the block distortion is reduced.
  • the predicted image can be generated by the predicted image deriving unit 8 based on a reference image in which specific frequency components are not lost at the same time that block distortion is reduced.
  • the filter processing unit 11 performs horizontal filter processing and vertical filter processing by dividing a processing target image to be filtered into a plurality of blocks.
  • the division pattern in which the filter processing unit 11 divides the processing target image is as shown in FIGS. 20 and 21, and the DCT unit 1 and the quantization unit 2 perform the quantization target image for quantization. This is the same as the division pattern for dividing.
  • the filter processing unit 11 uses the image data of the block B in the filter output image output from the filter processing unit 11 as the image data of the block B in the processing target image. It is calculated from the image data of the block adjacent to the block. In horizontal finisher processing, the image data of block B is calculated with reference to the image data of block B adjacent to the right side of the block B. In vertical filtering, the image data of block B is calculated. Is the image data n n + W of block B adjacent to the lower side of the block.
  • the force filter processing unit 11 for describing the filter processing calculation for calculating the pixel value (for example, the luminance level) of one block B performs the filter processing calculation described below for all adjacent two blocks. Repeating the lock completes the horizontal filtering process. Note that the above repetitions are the odd and odd numbers adjacent to each other, such as (B, B), (B, B), (B, B)
  • a pair of several blocks may be paired, and the above filtering processing may be executed for all of these pairs. (B, B), (B, B), (B, B) So that all the blocks
  • the above filtering processing calculation may be executed with reference to the next block.
  • a pair of non-adjacent blocks for example, block B (k is an integer) at the right end of the image and the next program k XW-1 located at the lower left end of the block
  • the above filter processing is not performed for the pair consisting of ACK B.
  • FIG. 4 is a flowchart for schematically explaining the filter processing calculation executed by the filter processing unit 11.
  • the filter processing calculation by the filter processing unit 11 includes step S1 for calculating the average pixel value, step S2 for calculating the predicted value, and step S3 for calculating the filter output image. It is out.
  • Steps S1 to S3 will be described in more detail as follows.
  • the filter processing operation for calculating the pixel value of the 4 pixels arranged in the Vth row out of the 16 pixels arranged in 4 rows and 4 columns belonging to the block B will be described as! / .
  • the filter processing unit 1 1 performs the filtering processing described below on the first row force of block B and the fourth row in order or in parallel, so that all the pixels belonging to block B are processed. Calculate the value.
  • Step S1 The filter processing unit 11 performs processing on the Vth row of the block B in the processing target image.
  • the average pixel value p> of the four pixels arranged in the self-sequence and the average pixel value p> of the four pixels arranged in the Vth row of the block B + ⁇ in the processing target image are calculated.
  • the calculation formula for calculating the force s and the average pixel value is as follows.
  • p (n, u, v) is a pixel value in the pixel (n, u, v) of the processing target image.
  • A) of FIG. 5 is a graph showing pixel values of the processing target image.
  • B) of FIG. 5 is a graph showing the average pixel value obtained by! / In step S1.
  • Step S2 The filter processing unit 11 determines that the average pixel value obtained in Step S 1 ⁇ p
  • the filter processing unit 11 calculates the predicted values p (1, 11,) and (n + l, u, v) pred pred
  • the calculation formula for calculating is as follows.
  • (c) of FIG. 5 is a graph showing the predicted value obtained in step S2.
  • Step S3 The filter processing unit 11 calculates the predicted value p (n, u, v pred obtained in Step S2
  • FIG. 5 is a graph showing pixel values of the filter output image obtained in step S3.
  • the average pixel value of block B in the filter output image matches the average pixel value of block B in the processing target image, that is, the filter processing unit 11 processes the average pixel value of each block. Please note that it is something that remains unchanged before and after. For this reason, it is possible to prevent blurring and flickering of moving images due to the filter processing.
  • the filter processing unit 11 performs the filtering process in the vertical direction after performing the filtering process in the horizontal direction as described above.
  • the vertical filter processing operation is a force that calculates the image data of block B with reference to block B adjacent to the lower side of block Bn.
  • the calculation method is the same as the horizontal filtering process, so the explanation is omitted.
  • the inverse filter processing performed by the inverse filter processing unit 12 included in the moving image encoding device 300 and the moving image decoding device 400 will be described.
  • the inverse filter process is executed every time encoding or decoding process is performed for one screen. That is, when the inverse filter process is executed, a decoded image obtained as the sum of the difference image restored by the IDCT unit 5 and the predicted image is recorded in the frame memory 7 for one screen.
  • the inverse filter processing unit 12 executes the horizontal direction reverse filter processing and the vertical direction reverse filter processing by dividing the processing target image into a plurality of blocks.
  • the division pattern in which the inverse filter processing unit 12 divides the processing target image is the same as the division pattern in which the filter processing unit 11 divides the processing target image.
  • the inverse filter processing unit 12 calculates the image data of the block B from the image data of the block B in the processing target image and the image data of the block adjacent to the block B. Specifically, in horizontal filtering, the image data of block B Is calculated by referring to the block + 1 image data adjacent to the right side of the block and the image data of block B in the vertical filter processing. Calculated by referring to the image data of block B adjacent below B n n + W
  • FIG. 6 the inverse filter processing calculation executed by the inverse filter processing unit 12 in the horizontal inverse filter processing will be described with reference to FIGS. 6 and 7.
  • FIG. 6 the inverse filter processing calculation for calculating the pixel value (for example, the luminance level) of one block B will be described.
  • the inverse filter processing unit 12 performs all the filtering processing operations described below. Repeat for two adjacent blocks to complete horizontal filtering
  • FIG. 6 is a flowchart for schematically explaining the inverse filter processing calculation executed by the inverse filter processing unit 12.
  • the filtering process by the inverse filter processing unit 12 includes a step T1 for calculating an average pixel value, a step T2 for calculating a predicted value, and a step T3 for calculating an inverse filter output image. Is included.
  • Steps T1 to T3 will be described in more detail as follows.
  • the inverse filter processing unit 12 performs the inverse filter processing operation described below on the first row of the block ⁇ , the fourth row, in sequence or in parallel, so that all the pixels belonging to the block ⁇ are processed.
  • the pixel value is calculated.
  • Step T1 The inverse filter processing unit 12 calculates the average pixel value ⁇ > of the four pixels arranged in the V row of the block ⁇ ⁇ ⁇ ⁇ in the processing target image and the V row of the block ⁇ ⁇ ⁇ ⁇ in the processing target image. Calculate the average pixel value ⁇ > of the arranged four pixels.
  • Part 12 displays the average pixel values ⁇ > and ⁇ ?
  • the following formula is used to calculate ⁇ and ⁇ + 1,
  • P (n, u, v) is a pixel value in the pixel (n, u, v) of the processing target image.
  • (A) in FIG. 7 is a graph showing the pixel values of the image to be processed, and (b) in FIG. 7 is a graph showing the average pixel values obtained by! / In step T1 above. .
  • Step T2 The inverse filter processor 12 determines that the average pixel value obtained in Step T1 ⁇ P
  • pred n + 1 1 pred l, u, v) is calculated.
  • the inverse filter processing unit 12 predicts the predicted value P (n, u, v P (n + l, u
  • (c) of FIG. 7 is a graph showing the predicted value obtained in step T2.
  • the inverse filter processing unit 12 calculates the predicted value P (n, u, v) obtained in step T2 and the step pred
  • the difference from the average pixel value ⁇ P> of block B obtained in T1 is set as an additional component to be added to the processing target image, and the additional component is added to the pixel value P (n, u, v) of the processing target image.
  • the pixel value P ′ (n, u, V) of the filter output image is calculated.
  • the calculation formula used by the inverse filter processing unit 12 to calculate the pixel value P ′ (n, u, v) of the inverse filter output image is as follows.
  • FIG. 7 is a graph showing pixel values of the inverse filter output image obtained in step T3. Note that the average pixel value of block B in the inverse filter output image matches the average pixel value of block B in the processing target image. This Therefore, occurrence of blurring and flickering of moving images is effectively prevented.
  • the inverse filter processing unit 12 performs the inverse filter processing in the horizontal direction as described above, and then performs the inverse filter processing in the vertical direction.
  • the vertical inverse filtering calculation is to calculate the image data of block B with reference to block B adjacent to the lower side of block B n n + W
  • the average pixel value of the prediction value and the average pixel value of the input image are used as the filter output. It is preferable to make a correction so that the average pixel value of the filter input and filter output is maintained.
  • the moving picture coding apparatus 300 removes the specific frequency component FL that causes block distortion by performing the filtering process on the coding target image by the filter processing unit 11. Then, the video decoding device 400 restores the removed frequency component FL by the inverse filter processing unit 12. Thereby, block distortion in the inverse filter output image in the moving picture decoding apparatus 400 is reduced.
  • the filter output image in moving picture coding apparatus 300 and the decoded picture in moving picture decoding apparatus 400 are different from each other by a quantization error.
  • This is achieved by quantization in the video encoding device 300 by the DCT unit 1 and the quantization unit 2 and inverse quantization in the video decoding device 400 by the inverse quantization unit 4 and the IDCT unit 5.
  • This is because a quantization error occurs between the quantization target image and the restored quantization target image. For this reason, the restoration of the frequency component FL by the inverse filter processing unit 12 is approximate. Further, the same can be said for the inverse filter processing performed for generating the reference image inside the moving image coding apparatus 300.
  • FIG. 17 is a graph showing the pixel values of the decoded image and the inverse filter output image output from the inverse filter processing unit 12.
  • FIG. 17D is a graph of the inverse filter output image in FIG. 17D, which is the result of applying the inverse filter process to the decoded image including the quantization error.
  • the inverse filter output image does not accurately reproduce the encoding target image. That is, the frequency component reconstructed by the inverse finisher processing unit 12 has an error with respect to the frequency component FL removed by the filter processing unit 11.
  • FIG. 8 is a functional block diagram showing a schematic configuration of the moving picture coding apparatus 300a according to the present embodiment.
  • the moving picture coding apparatus 300a includes a DCT unit 1 and a quantization unit. 2, variable length encoding unit 3, inverse quantization unit 4, IDCT unit 5, frame memory 7, prediction image derivation unit 8, encoding control unit 21, filter processing unit 11, inverse filter processing unit 12, correction determination unit 13 A corrected image candidate derivation unit 14 and a corrected image determination unit 15 are provided.
  • blocks having the same functions as those in the moving picture coding apparatus in FIG. 2 are denoted by the same names and symbols as in FIG.
  • a feature of the moving image coding apparatus 300a is that it includes a correction determination unit 13, a corrected image candidate derivation unit 14, and a corrected image determination unit 15.
  • the corrected image determination unit 15 performs correction for subtracting the corrected image from the quantization target image for at least one block. As shown in FIG. 8, the corrected image determining unit 15 may subtract the corrected image from the quantization target image by adding the corrected image to the predicted image.
  • the correction determination unit 13 determines a block on which the correction image determination unit 15 should perform the correction. Specifically, a block in which the average pixel value of the quantization target image after the correction is performed is smaller than the average pixel value of the quantization target image before the correction is performed should be corrected. Judge as a block. The corrected image determination unit 15 performs the above correction on the blocks that are determined to be corrected by the correction determination unit 13.
  • the corrected image candidate derivation unit 14 derives correction image candidates used by the corrected image determination unit 15 for the correction. More specifically, a corrected image candidate having an approximate average pixel value that approximates the average pixel value of the quantization target image in each block as a pixel value is derived as a corrected image candidate.
  • the corrected image determination unit 15 makes the average pixel value of the quantization target image after the correction is smaller than the average pixel value of the quantization target image before the correction is performed.
  • correction is performed by subtracting the approximate average pixel value that approximates the average pixel value of the quantization target image in the block to which the pixel belongs from the pixel value of each pixel of the quantization target image.
  • the average pixel size of each block of the quantization target image can be reduced to be equal to or less than the original average pixel value of the block. Therefore, the quantization level interval in the above quantization can be set small, and is generated by quantization. Quantization error can be reduced. For this reason, it is possible to reduce the quantization error generated in the quantization process. Therefore, the quantization target image after the filtering process and the restored quantization target image before the inverse filtering process can be matched more accurately. For this reason, the frequency component removed by the filtering process can be restored more accurately during the inverse quantization.
  • FIG. 1 is a functional block diagram illustrating a schematic configuration of a video decoding device 400a corresponding to the video encoding device 300a shown in FIG.
  • the video decoding device 400a includes an inverse quantization unit 4, an IDCT unit 5, a frame memory 7, a predicted image derivation unit 8, an inverse filter processing unit 12, a variable length decoding unit 20a, and a corrected image candidate.
  • a derivation unit 14 and a corrected image determination unit 15 are provided.
  • the moving picture decoding apparatus 400a includes a corrected image candidate deriving unit 14 and a corrected image determining unit 15. is there.
  • the variable-length decoding unit 2 Oa provided instead of the variable-length decoding unit 20 of the video decoding device 400 provides information on whether or not to correct the predicted image. That is, the correction determination result is decoded and supplied to the corrected image candidate deriving unit 14 and the corrected image determining unit 15.
  • the corrected image candidate derivation unit 14 and the corrected image determination unit 15 in the moving image decoding device 400a have the same functions as those indicated by attaching the same reference numerals to the moving image encoding device 300a, respectively. .
  • the moving picture decoding apparatus 400a can decode the encoded data encoded by the moving picture encoding apparatus 300a. Since the above-described correction is used at the time of encoding in the moving image encoding device 300a, the quantization error in the input image to the inverse filter in the moving image decoding device 400a is reduced. Therefore, since the removed frequency component FL can be accurately restored by the inverse filter processing, the block distortion in the inverse filter output image of the inverse filter processing, which is also the output image of the video decoding device 400a, is reduced. That's the power S.
  • the correction determination process is executed in the correction determination unit 13. First, the correction determination unit 13 that can be suitably used for the moving image encoding device 30 Oa will be described.
  • the correction determination unit 13 includes a filter output image output from the filter processing unit 11, a predicted image output from the predicted image derivation unit 8, and a corrected image candidate output from the correction image candidate derivation unit 14. And are supplied. Based on these, the correction determination unit 13 executes a correction determination process described later. The determination result is sent as a correction determination result to the corrected image candidate deriving unit 14, the corrected image determining unit 15, and the variable length encoding unit 3. The variable length encoding unit 3 encodes the correction determination result and sends it to the moving image encoding apparatus 400a.
  • FIG. 9 is a functional block diagram showing a schematic configuration of the correction determination unit 13. As shown in FIG. 9, the correction determination unit 13 includes an average pixel value calculation unit 50 and a corrected image candidate evaluation unit 51.
  • the average pixel value calculation unit 50 a difference image between each pixel of the encoding target image (filter output image) subjected to the filter process and the prediction image supplied from the prediction image derivation unit 8 is stored. Entered.
  • the average pixel value calculation unit 50 calculates an average pixel value for each block of the input difference image.
  • the difference image corresponds to the quantization target image when the correction is not performed on the currently focused block. Therefore, the calculated average pixel value is obtained when the correction is not performed. Note that this corresponds to the average pixel value of the quantization target image.
  • the average pixel value of the difference image calculated by the average pixel value calculation unit 50 is sent to the corrected image candidate evaluation unit 51.
  • the corrected image candidate evaluation unit 51 subtracts the average pixel value of the difference image supplied from the average pixel value calculation unit 50 and the correction image candidate supplied from the correction image candidate derivation unit 14 from the difference image.
  • the average pixel value of the obtained image is compared, and it is determined whether or not correction is to be performed in the block. Specifically, when the average pixel value of the image obtained by subtracting the corrected image candidate from the difference image is smaller, correction is performed on the block B currently being processed. Judge that.
  • the image obtained by subtracting the corrected image candidate supplied from the corrected image candidate deriving unit 14 from the difference image corresponds to the quantization target image when correction is performed.
  • the corrected image candidate evaluation unit 51 determines that a block that can reduce the average pixel value of the quantization target image as a block to be corrected by performing the correction.
  • the determination result in the corrected image candidate evaluation unit 51 is supplied to the corrected image determination unit 15 and the variable length coding unit 3 as a correction determination result.
  • the procedure of the correction determination process includes two steps: a step of calculating an average pixel value of a difference image that is a difference between the encoding target image and the predicted image, and a step of determining whether or not to perform correction.
  • Step 1 The average pixel value calculation unit 50 calculates the pixel value P (n, u) of the predicted image from the pixel value p (n, u, v) of the encoding target image after the filtering process. , v) subtraction image est
  • Step 2 The corrected image candidate evaluation unit 51 adds sub to the average pixel value ⁇ P> calculated in Step 1 and the average pixel value of the corrected image candidate supplied from the corrected image candidate derivation unit 14. n
  • a comparison is made with the corresponding correction amount a ′ to determine whether or not the correction is performed in the block B. Specifically, the determination is made by comparing a and 0 represented by the following mathematical formula.
  • ⁇ is smaller than / 3, it is determined to perform correction. In other cases (when ⁇ is greater than / 3, or when ⁇ and / 3 are equal), it is determined that correction is not performed.
  • ⁇ is an amount corresponding to the average pixel value of the quantization target image when correction is performed
  • ⁇ is an amount corresponding to the average pixel value when correction is not performed. Therefore, by comparing the magnitudes of ⁇ and / 3, it is possible to determine whether or not the average pixel value of the quantization target image can be reduced when correction is performed.
  • the corrected image candidate derivation unit 14 is based on the correction determination result and the conversion coefficient supplied from the inverse quantization unit 4, and is a corrected image candidate that is a correction image candidate used for correcting the block. Is derived.
  • the derived corrected image candidates are sent to the correction determination unit 13 and the corrected image determination unit 15.
  • the correction image determination unit 15 determines and transmits a correction image in the block.
  • FIG. 10 is a functional block diagram showing a schematic configuration of the corrected image candidate derivation unit 14.
  • Figure 1
  • the corrected image candidate derivation unit 14 includes a prediction error amount storage memory 52, a correction amount derivation unit 53, a corrected image candidate generation unit 54, and a prediction error amount derivation unit 55.
  • the prediction error amount storage memory 52 stores the prediction error amount corresponding to the quantized / inverse quantized block (for example, block B) processed before the block B currently being processed. .
  • the correction amount deriving unit 53 refers to the prediction error amount recorded in the prediction error amount storage memory 52 and derives the correction amount in the block.
  • the derived correction amount is sent to the corrected image candidate generation unit 54.
  • the corrected image candidate generating unit 54 generates and sends a corrected image candidate based on the correction amount supplied from the correction amount deriving unit 53.
  • the prediction error amount deriving unit 55 is based on the correction determination result supplied from the correction determining unit 13, the correction amount supplied from the correction amount deriving unit 53, and the transform coefficient supplied from the inverse quantization unit 4. ! The prediction error amount in the block currently being processed is calculated and recorded in the prediction error amount storage memory 52.
  • FIG. 11 is a flowchart showing the flow of the corrected image derivation process.
  • the corrected image derivation process includes a step U 1 for deriving a correction amount applicable to the block B, a step U 2 for generating a corrected image candidate based on the derived correction amount value, and a correction determination.
  • Step U3 for making a determination based on the result
  • Step U4 for sending a corrected image candidate as a correction amount
  • Step U5 for sending an image with all pixel values being zero as a correction amount.
  • Step U1 The correction amount deriving unit 53 sets the prediction error amount d corresponding to the block B ⁇ adjacent to the left side of the block B currently being processed as the correction amount of the block B. However, if the block B is located at the left edge of the image, the value zero is set as the correction amount for the block.
  • the reason for setting the prediction error amount d of block B to the correction amount of the block B is that the prediction image is corrected by using the correlation of the prediction error amount between adjacent blocks. This is because the accuracy of the image can be increased.
  • the corrected image candidate generation unit 54 generates a corrected image candidate based on the correction amount a ′ derived in Step U1. Specifically, an image in which the pixel values of all the pixels are a ′ is generated, and the image is set as a corrected image candidate.
  • Step U3 The corrected image determination unit 15 is based on the correction determination result supplied from the outside (the correction determination unit 13 in FIG. 8 or the variable length decoding unit 20a in FIG. 1)! /, Determine the corrected image
  • step U4 If the determination result indicates that correction is performed in the block, the process proceeds to step U4.
  • the correction determination result used for the determination in this step is the same as that in the encoding process. Is supplied from the correction determination unit 13 and is supplied from the variable length decoding unit 20a during the decoding process.
  • Step U4 This step is executed when it is determined that correction is performed on the block currently being processed as a result of the prediction determination in step U3.
  • the corrected image candidate generation unit 54 sends out the corrected image candidate derived in step U2 as a corrected image of the block.
  • Step U5 This step is executed when it is determined that correction is not performed as a result of the prediction determination in step U3.
  • the corrected image candidate generation unit 54 generates an image in which the pixel values of all the pixels are zero, and sends the image as a corrected image candidate.
  • a corrected image candidate necessary for performing correction in the block currently being processed can be derived.
  • correction is performed by adding the derived corrected image to the predicted image transmitted from the predicted image deriving unit 8.
  • the prediction error amount d of block B- is referred to in deriving the correction amount of block B currently being processed. Therefore, the prediction error amount d of the block B may also be used for derivation of a correction amount in a block to be processed later (for example, block B). Therefore, the prediction error amount d is derived and recorded in the prediction error amount recording memory 52. It is necessary to keep it.
  • the procedure for deriving the prediction error amount d is as follows.
  • the prediction error amount deriving unit 55 includes the correction amount value derived in step U1 of the corrected image deriving process, the correction determination result supplied from the correction determination unit 13, and the inverse quantization unit 4
  • the prediction error amount d is calculated on the basis of the transform coefficient after inverse quantization supplied from the above.
  • the calculation formula used for calculation is as follows.
  • r is a DC component in the transform coefficient after inverse quantization
  • r X ⁇ corresponds to the average pixel of the quantization target image in block ⁇ .
  • ⁇ is a constant for converting the unit of the conversion coefficient r after inverse quantization to the unit of the pixel value.
  • the quantization before correction is performed until r X y + a This corresponds to the average pixel value of the target image (difference image obtained by subtracting the predicted image from the target image to be encoded). That is, the prediction error amount d corresponds to the average pixel value of the quantization target image regardless of whether correction is performed in block B or correction is performed.
  • Step V2 The prediction error amount deriving unit 55 records the prediction error amount d derived in step VI in the prediction error amount recording memory 52. At this time, a prediction error amount that is not used in a block processed after the block may be deleted from the prediction error amount storage memory 52.
  • the correction determination result for all blocks is not necessarily required on the decoding side.
  • encoding of the correction determination result is omitted.
  • a configuration is also possible. By omitting the encoding of the correction determination result for the block on which the correction determination result can be estimated on the decoding side, the code amount of the encoded data can be reduced.
  • correction is not always performed for a block in which the derived correction amount compensation value is zero. Therefore, it is possible to estimate (determine) the correction determination result on the decoding side by referring to the correction amount. Also, for example, correction tends to be difficult to apply to blocks that have a certain amount of correction value. Therefore, when the value of the correction amount is larger than a predetermined threshold value, it can be estimated that correction is not performed. Therefore, the encoding side can be configured to omit encoding for such blocks.
  • Correction amount deriving section 53 A power that explains the configuration that uses the prediction error amount d corresponding to block B- adjacent to the left side of block B to derive the correction amount.
  • Akira is not limited to this. Specifically, for example, a prediction error amount corresponding to another processed block existing in the vicinity of the block may be used together.
  • the prediction error amount d corresponding to the block B adjacent above the block B and the block B The correction amount can be derived by using the prediction error d corresponding to block B- adjacent on the left side.
  • the prediction error amount can be reduced by one. As a result, more appropriate correction can be made.
  • this example will be described in more detail.
  • step U1 in the correction image derivation process described above may be replaced with the next step ur.
  • Step UD correction amount deriving unit 53 determines, based on prediction error amount d corresponding to block ⁇ adjacent to the left side of block ⁇ and prediction error amount d corresponding to block B adjacent to the upper side, Calculate the correction amount, which is determined by the following equation.
  • the correction amount a 'can be calculated using the following formula: n-2W n
  • the correction amount is derived based only on the prediction error amount.
  • the correction amount may be derived using a coding parameter correlated with the prediction error amount.
  • the ability to seek S Predictive images are often similar in blocks with the same prediction mode, so the amount of prediction error is often near and low. Therefore, a more preferable correction amount can be obtained by using the prediction error amount of the block having the same prediction mode.
  • Coding parameters correlated with the prediction error amount include, in addition to the prediction mode, a block size for intra prediction, a motion vector in inter prediction, a reference image, and the like.
  • a preferable correction amount can be obtained by selecting a block having the encoding parameter closest to the block from the neighboring blocks of the block and obtaining the value of the correction amount a ′ from the prediction error amount of the selected block. Can be sought.
  • FIG. 12 is a functional block diagram showing a schematic configuration of the moving picture coding apparatus 300b according to the present embodiment.
  • the moving picture coding apparatus 300b includes a DCT unit 1, a quantization unit 2, a variable length coding unit 3, an inverse quantization unit 4, an IDCT unit 5, a frame memory 7, and a prediction Image deriving unit 8, coding control unit 21, filter processing unit 1 1, inverse filter processing unit 12, inverse filter input correction unit 16, And a correction method determination unit 17.
  • the difference between the moving picture coding apparatus 300b and the moving picture coding apparatus 300 is that the moving picture coding apparatus 300b uses an inverse filter that corrects a local decoded image to be subjected to inverse filter processing. This is the point that a correction unit 16 is provided.
  • the moving picture coding apparatus 300b includes a correction method determination unit 17 that determines a correction method to be applied in the inverse filter input correction unit 16.
  • the inverse filter input correction unit 16 acquires the local decoded image recorded in the frame memory 7, and corrects the local decoded image according to the correction method supplied from the correction method determination unit 17.
  • the corrected local decoded image is sent to the inverse filter processing unit 12.
  • the correction method determination unit 17 is applied by the inverse filter input correction unit 16 based on the input image data that is an input image to the video encoding device 300a and the local decoded image acquired from the frame memory 7. Determine how to fix. The determined correction method is sent to the inverse filter input correction unit 16 and the variable length coding unit 3 as a correction method determination result.
  • the local decoded image has a reduced quantization error by correcting the local decoded image (Fig. 15 (b)) including the quantization error.
  • (c) Find When inverse filtering is applied to a locally decoded image that includes quantization errors, the frequency component FL that has been removed! / Cannot be accurately restored, so the image obtained as a result of inverse filtering contains block distortion (see Fig. 2). 15 (d)).
  • the inverse filter process is applied to a locally decoded image with a reduced quantization error, the frequency component FL can be restored more accurately, so that the block distortion is reduced in the image obtained as a result of the inverse filter process. / !, ru (Fig. 15 (e)).
  • the correction method determination unit 17 determines the power that can reduce the quantization error in the locally decoded image by a predetermined correction method, and encodes the determination result. .
  • the quantization error of the local decoded image can be reduced by correcting the local decoded image according to the determination result. Therefore, the video encoding device 300b can generate encoded data that can be used to decode an image with reduced block distortion.
  • FIG. 13 is a functional block diagram showing a schematic configuration of a video decoding device 400b corresponding to the video encoding device 300b shown in FIG.
  • the video decoding device 400b includes an inverse quantization unit 4, an IDCT unit 5, a frame memory 7, a predicted image derivation unit 8, an inverse filter processing unit 12, an inverse filter input correction unit 16, and A variable length decoding unit 20b is provided.
  • the difference between the moving image decoding apparatus 400b and the moving image decoding apparatus 400 is that the moving image decoding apparatus 400b has a function of decoding the correction method determination result applied by the inverse filter input correction unit.
  • the variable length decoding unit 20b is provided.
  • the moving picture decoding apparatus 400b includes an inverse filter input correction unit 16 that reduces a prediction error by correcting a local decoded picture based on the correction method determination result.
  • the moving picture decoding apparatus 400b includes the inverse filter input correction unit 16, it is possible to reduce the quantization error occurring in the local decoded picture. Therefore, in the inverse filter process, the specific frequency component FL that causes the block distortion removed by the filter process at the time of encoding can be reproduced more accurately than the moving picture decoding apparatus 400b. An image with reduced block distortion can be decoded.
  • the correction method determination process which is a characteristic process in the video encoding device 300b
  • the inverse filter input correction process which is a characteristic process in the moving picture coding apparatus 300b and the moving picture decoding apparatus 400b
  • correction method determination processing and inverse filter input are performed with a local decoded image equivalent to one screen of input image data recorded in the frame memory 7. It is assumed that the correction process is activated.
  • Steps W;! To W6 represent processing for determining a correction method for the block of interest B in the locally decoded image.
  • Step Wl The correction method determination unit 17 calculates the average pixel value P> of the encoding target image in the block of interest Bn.
  • FIG. 15 (a) is a diagram schematically showing the average pixel value P> of the encoding target image obtained by this step.
  • Step W2 A locally decoded image is acquired from the frame memory 7, and an average pixel value P> of the locally decoded image in the target block B is calculated.
  • (B) of Fig. 15 is a diagram schematically representing the average pixel value P> of the locally decoded image obtained in step W2.
  • Step W3 In order to correct the pixel value of the locally decoded image in the target block B, a corrected value ⁇ P> is calculated from the pixel value of the locally decoded image. First, the left of the attention block
  • Step W4 The average pixel value ⁇ p> of the encoding target image, the average pixel value ⁇ P> of the local decoded image, and the step W3, respectively, derived in Step W1 and Step W2, respectively. Based on the corrected value ⁇ '>, it is determined whether or not to correct the pixel value in the target block ⁇ . If the value of the modified value ⁇ ′> is closer to the value of ⁇ > of the encoding target image than the average pixel value ⁇ > of the local decoded image, the process proceeds to step W5. Otherwise go to step W6.
  • Step W5 It is determined that the target block ⁇ is to be corrected, and this determination result is sent as a correction method determination result to the inverse filter input correction unit 16 and the image encoding unit 3 to be corrected. The decision process is terminated.
  • Step W6 the target block ⁇ is determined not to be corrected! /, And the determination result is sent to the inverse filter input correction unit 16 and the image encoding unit 3 as a correction method determination result. Then, the correction method determination process ends.
  • the correction method to be applied to the block ⁇ ⁇ by the inverse filter input correction unit 16 is determined, and the correction method is transmitted as the correction method determination result.
  • correction can be made only when the quantization error of the block of interest can be reduced according to the determination result.
  • Steps X;! To X7 represent processing for calculating the pixel value of the target block Bn in the input image to the inverse filter.
  • Step XI A locally decoded image is acquired from the frame memory 7.
  • Step X2 The correction method determination result derived in the correction method determination process and supplied from the correction method determination unit 17 or the variable length decoding unit 20b is the! If you indicate that you want to make corrections, go to step X3. The judgment result is Proceed to Step X7 to indicate that the local block image is to be corrected for eye block Bn! /.
  • Step X3 The average pixel value ⁇ P> of the locally decoded image in the target block Bn obtained in Step XI is calculated.
  • Step X5 Using the average pixel value P> obtained in Step X3 and the modified value ⁇ P> obtained in Step X4, the pixel value P ( n, u, V)
  • the correction corresponds to a process of removing the approximate quantization error from the pixel value of each pixel of the locally decoded image.
  • the average pixel value Pn of the locally decoded image in block B is replaced with the modified average pixel value ⁇ P> niod, n obtained in step X2.
  • Step X6 The corrected local decoded image obtained in Step X5 is sent to the inverse filter processing unit 12, and the inverse filter input correction process is terminated.
  • Step X7 The local decoded image acquired in Step XI is sent as it is to the inverse filter processing unit 12, and the inverse filter input correction process is terminated.
  • the locally decoded image can be corrected and the quantization error can be reduced.
  • the inverse filter process By applying the inverse filter process to the locally decoded image that has been modified and the quantization error is reduced, it is corrected and removed by filtering as compared to the case of inputting the locally decoded image.
  • the force S can be restored more accurately to restore the frequency component.
  • the correction method determination unit 17 is assumed to send the correction method determination result to the variable length encoding unit 3. However, it is not always necessary to encode the correction method determination results for all the blocks. If the correction method determination results can be estimated at the time of decoding, the encoding may be omitted.
  • the inverse filter input correction unit 16 does not perform correction.
  • the determination result can be easily estimated at the time of decoding, it is not necessary to encode the determination result! /. Therefore, the code amount of encoded data can be reduced.
  • the threshold T1 for example, a value represented by the following formula can be used.
  • the step width, ⁇ is used to convert the value of r from frequency domain units to spatial domain units.
  • the threshold T1 is determined as described above due to the fact that the difference between the average pixel value P> and the average pixel value P> of the input image data is basically less than r X ⁇ .
  • quantization representative value To determine whether or not the target block is a flat region. If it is determined that the target block is a flat region, the correction method determination result is not encoded and the correction method determination result is not encoded. The amount can be reduced.
  • the left and right sides of the target block are used to derive the average pixel value ⁇ P> in the corrected local decoded image.
  • n may be derived.
  • the average pixel value ⁇ P> can be derived by smoothing using four blocks adjacent to each of the top, bottom, left, and right of the block of interest.
  • the present invention is not limited to the above-described embodiments, and various modifications are possible within the scope shown in the claims, and the technical means disclosed in the different embodiments are applied appropriately. Embodiments obtained by appropriate combinations are also included in the technical scope of the present invention.
  • the present invention can be configured as follows.
  • the video decoding device is a video decoding device that decodes encoded data obtained by encoding image data from which frequency components that generate block distortion have been removed.
  • Variable length decoding means for decoding the encoded data
  • An inverse filter processing means for performing an inverse filter process for restoring the removed frequency component on the image data obtained by decoding
  • Prediction image generation means for generating a prediction image based on pixel values of a reference image
  • prediction error amount derivation means for deriving a prediction error amount approximating the difference between the image data from which the frequency component has been removed and the prediction image
  • Correction means for correcting the predicted image based on the prediction error amount
  • variable length decoding means decodes the correction judgment result indicating whether or not to correct the correction means!
  • the correction means switches whether to correct the predicted image based on the prediction error amount according to the correction determination result.
  • the correction means estimates whether or not the predicted image can be corrected based on the prediction error amount! /, Based on the prediction error amount in the processing target block, and when the estimation is possible, Depending on the result of the estimation, based on the prediction error amount! /, It is switched whether to correct the predicted image.
  • the correction means corrects the prediction image based on the prediction error amount corresponding to at least one decoded block! It may be configured as follows.
  • the decoded block includes at least one block adjacent to the processing target block,
  • the correction means corrects the prediction image based on the prediction error amount and an encoding parameter correlated with the prediction error amount.
  • the moving image decoding apparatus divides an image into a plurality of blocks, quantizes the image data of each block, and encodes a quantized representative value obtained by the quantization.
  • Encoding device
  • Filter processing means for performing filter processing for removing frequency components that generate block distortion on the image data before quantization
  • a predicted image generating unit that generates a predicted image based on a pixel value of a reference image; a prediction error amount deriving unit that derives a prediction error amount that approximates a difference between the image data subjected to the filtering process and the predicted image;
  • Correction means for correcting the predicted image based on the prediction error amount
  • a video decoding device is a video decoding device that decodes encoded data obtained by encoding image data from which frequency components that generate block distortion have been removed.
  • Variable length decoding means for decoding the encoded data
  • Inverse filter processing means for performing inverse filter processing to restore the removed frequency component
  • An inverse filter input correcting means for reducing a quantization error occurring in the local decoded image input to the inverse filter processing means
  • variable length decoding means decodes a correction method determination result for controlling the correction process of the local decoded image in the inverse filter processing means
  • the inverse filter input correction means switches whether to correct the processing target block according to the correction method determination result
  • the inverse filter input correction means calculates a correction value based on an average pixel value of each of at least one block adjacent to the processing target block, and calculates the correction value and the average pixel value of the processing target block. Switch whether to modify the processing target block according to the comparison result of
  • the inverse filter input correction means calculates a correction value based on an average pixel value of each of at least one block adjacent to the processing target block so that the average pixel value of the processing target block matches the correction value.
  • the processing target block may be corrected.
  • the video encoding apparatus divides an image into a plurality of blocks, quantizes the image data of each block, and encodes the quantized representative value obtained by the quantization. Device.
  • variable-length encoding unit that encodes information necessary for decoding image data
  • filter processing unit that performs filter processing for removing frequency components that generate block distortion on the image data before quantization.
  • variable length encoding means encodes a correction method determination result which is a determination result in the correction method determination means
  • the above-described blocks of the moving image encoding devices 300a and 300b of the present invention and the moving image decoding devices 400a and 400b of the present invention may be configured by hardware logic. It may be realized by software using a CPU as follows.
  • the moving picture encoding apparatus and moving picture decoding apparatus include a CPU (central processing unit) that executes instructions of a control program that realizes each function, a ROM (read only memory) that stores the program, and the above It is equipped with RAM (random access memory) for expanding the program, and storage devices (recording media) such as memory for storing the program and various data.
  • An object of the present invention is to compile program codes (execution format program, intermediate code program, source program) of the control program for the video encoding device and the video decoding device, which are software that realizes the above-described functions.
  • a recording medium recorded so as to be readable by a computer is supplied to the moving picture encoding apparatus and the moving picture decoding apparatus, and the computer or CPU or MPU) reads out and executes the program code recorded on the recording medium. This is also achievable.
  • Examples of the recording medium include magnetic tapes such as magnetic tapes and cassette tapes, magnetic disks such as floppy (registered trademark) disks / hard disks, and CD-ROM / MO / MD / DVD / CD-R.
  • the moving image encoding device and the moving image decoding device may be configured to be connectable to a communication network, and the program code may be supplied via the communication network.
  • the communication network is not particularly limited.
  • the Internet intranet, extranet, LAN, ISDN, VAN, CATV communication network, virtual private network (virtual private network), telephone line network, mobile communication network Satellite communication networks can be used.
  • the transmission medium constituting the communication network is not particularly limited.
  • infrared rays such as IrDA remote control, Bluetooth (registered trademark), 802.11 wireless, HDR, mobile phone network, satellite line, terrestrial digital network, etc.
  • the present invention is not limited to the above. It can also be realized in the form of a converter data signal embedded in a carrier wave, in which the program code is embodied by electronic transmission.
  • the moving picture decoding apparatus divides a quantization target image subjected to filter processing for removing a frequency component that generates block distortion into a plurality of blocks, and the quantization target image is divided into blocks.
  • a video decoding device that inversely quantizes a quantized representative value obtained by quantization, wherein each pixel of a restored quantization target image restored by the above inverse quantization for at least one block
  • a restored quantization target image correcting unit that performs correction by adding an approximate average pixel value that approximates the average pixel value of the quantization target image in the block to which the pixel belongs, and the correction is performed.
  • an inverse filter processing means for performing an inverse filter process corresponding to the inverse transform of the filter process on the restored quantization target image.
  • the moving picture decoding apparatus divides a quantization target image, which has been subjected to filter processing for removing frequency components that generate block distortion, into a plurality of blocks, and quantizes each block for quantization.
  • the image decoding apparatus includes a pixel value of each pixel of the restored quantization target image restored by dequantizing the quantization representative value obtained by the quantization for at least one block.
  • an inverse filter processing means for performing an inverse filter process corresponding to the inverse transform of the filter process and restoring the removed frequency component.
  • the block distortion in the decoded moving image can be reduced, and the moving image decoding apparatus does not cause side effects such as blurring of the image, and further generates the removed block distortion.
  • the present invention is suitable as a moving image storage device that encodes and stores moving images, a moving image transmission device that encodes and transmits moving images, or a moving image reproducing device that decodes and reproduces moving images.
  • a moving image storage device that encodes and stores moving images
  • a moving image transmission device that encodes and transmits moving images
  • a moving image reproducing device that decodes and reproduces moving images.

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Compression Or Coding Systems Of Tv Signals (AREA)

Abstract

La présente invention concerne un dispositif de décodage d'image dynamique (400a) comportant une unité de décision de correction d'image (15) et une unité de traitement par déconvolution (12). Pour au moins un bloc, l'unité de décision de correction d'image (15) effectue une correction comme suit. Une valeur de pixel de chacun des pixels d'image objet de quantification de restitution restituée par une quantification inverse est ajoutée par une approximation pour l'approximation d'une valeur moyenne de pixel d'une image objet de quantification dans un bloc auquel le pixel appartient. L'unité de traitement par déconvolution (12) effectue un traitement de déconvolution équivalente à une conversion inverse d'un procédé de filtrage pour éliminer une composante de fréquence afin de générer une distorsion de bloc. Ainsi, le dispositif de décodage d'image dynamique (440a) peut réduire la distorsion de bloc dans une image dynamique décodée sans entraîner d'effet nuisible tel que le flou ou le papillotement d'une image. Le dispositif de décodage d'image dynamique (400a) peut effectuer une restitution précise d'une composante de fréquence générant un bloc de distorsion éliminé.
PCT/JP2007/063860 2006-07-11 2007-07-11 Dispositif de décodage d'image dynamique et dispositif de codage d'image dynamique WO2008007717A1 (fr)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
JP2006190888 2006-07-11
JP2006-190888 2006-07-11

Publications (1)

Publication Number Publication Date
WO2008007717A1 true WO2008007717A1 (fr) 2008-01-17

Family

ID=38923273

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/JP2007/063860 WO2008007717A1 (fr) 2006-07-11 2007-07-11 Dispositif de décodage d'image dynamique et dispositif de codage d'image dynamique

Country Status (1)

Country Link
WO (1) WO2008007717A1 (fr)

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2010093608A (ja) * 2008-10-09 2010-04-22 Akuseru:Kk 画像処理システムおよび画像処理プログラム
JP2010245734A (ja) * 2009-04-03 2010-10-28 Oki Electric Ind Co Ltd 映像圧縮符号化データの復号装置
JP2011041014A (ja) * 2009-08-11 2011-02-24 Canon Inc 動画像符号化装置、動画像符号化装置の制御方法及びプログラム
US8135233B2 (en) 2008-05-22 2012-03-13 Aptina Imaging Corporation Method and apparatus for the restoration of degraded multi-channel images

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPH0319488A (ja) * 1989-06-15 1991-01-28 Matsushita Electric Ind Co Ltd ブロック符号化装置と復号化装置
JPH08181984A (ja) * 1994-12-26 1996-07-12 Sharp Corp 画像圧縮装置および画像圧縮方法
JPH11501472A (ja) * 1995-03-02 1999-02-02 ソニー エレクトロニクス インク ブロック効果を補償する前処理を有する画像データ圧縮方法及び装置

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPH0319488A (ja) * 1989-06-15 1991-01-28 Matsushita Electric Ind Co Ltd ブロック符号化装置と復号化装置
JPH08181984A (ja) * 1994-12-26 1996-07-12 Sharp Corp 画像圧縮装置および画像圧縮方法
JPH11501472A (ja) * 1995-03-02 1999-02-02 ソニー エレクトロニクス インク ブロック効果を補償する前処理を有する画像データ圧縮方法及び装置

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
YAMAMOTO T.: "Catmull-Rom Spline Hokan ni Motozuku Block Hizumi Teigen Shuho no Kiso Kento (A STUDY OF A DEBLOCKING METHOD BASED ON CATMULL-ROM SPLINE INTERPOLATION)", INFORMATION AND COMMUNICATION ENGINEERS, ENGINEERING SCIENCES SOCIETY TAIKAI KOEN RONBUNSHU, vol. A-4-10, 7 September 2006 (2006-09-07), pages 77, XP003017840 *

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US8135233B2 (en) 2008-05-22 2012-03-13 Aptina Imaging Corporation Method and apparatus for the restoration of degraded multi-channel images
JP2010093608A (ja) * 2008-10-09 2010-04-22 Akuseru:Kk 画像処理システムおよび画像処理プログラム
JP2010245734A (ja) * 2009-04-03 2010-10-28 Oki Electric Ind Co Ltd 映像圧縮符号化データの復号装置
JP2011041014A (ja) * 2009-08-11 2011-02-24 Canon Inc 動画像符号化装置、動画像符号化装置の制御方法及びプログラム

Similar Documents

Publication Publication Date Title
CN101911705B (zh) 运动图像编码装置及运动图像解码装置
RU2479938C2 (ru) Устройство обработки изображения, способ и программа
JP5283628B2 (ja) 映像復号方法及び映像符号化方法
JP5216070B2 (ja) 符号化装置及び符号化方法
JP5133135B2 (ja) インターカラー補償を利用した映像の符号化方法及び装置、復号化方法及び装置
KR100853336B1 (ko) 화상 부호화 장치 및 화상 복호화 장치
US20100254450A1 (en) Video coding method, video decoding method, video coding apparatus, video decoding apparatus, and corresponding program and integrated circuit
US20130028322A1 (en) Moving image prediction encoder, moving image prediction decoder, moving image prediction encoding method, and moving image prediction decoding method
JP5454584B2 (ja) 映像符号化装置および映像復号装置
US8675979B2 (en) Transcoder, method of transcoding, and digital recorder
JPWO2010001999A1 (ja) 動画像符号化／復号化方法及び装置
JP2007166522A (ja) 復号化装置及び復号化方法及びプログラム
JP2007336468A (ja) 再符号化装置、再符号化方法およびプログラム
WO2008007717A1 (fr) Dispositif de décodage d'image dynamique et dispositif de codage d'image dynamique
JPWO2009133845A1 (ja) 動画像符号化／復号化装置及び方法
CN103069798B (zh) 用于在实施变换域估计过程中对至少一个图像进行编码和解码的方法和装置
JP5516842B2 (ja) 動画像処理装置、動画像処理方法、および動画像処理プログラム
CN102057679A (zh) 压缩图像噪声去除装置和再现装置
JP4643437B2 (ja) 情報処理装置
JP2012134632A (ja) 画像復号化装置、画像復号化方法およびプログラム
JP4768011B2 (ja) 動画像符号化装置、及び、動画像復号装置
JP6200220B2 (ja) 画像処理装置、符号化装置、復号装置、及びプログラム
US20230007311A1 (en) Image encoding device, image encoding method and storage medium, image decoding device, and image decoding method and storage medium
WO2009133938A1 (fr) Dispositif de codage et de décodage d'image variable dans le temps
JP4510696B2 (ja) 画像処理装置及び画像処理方法

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 07790664

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

NENP Non-entry into the national phase

Ref country code: RU

122 Ep: pct application non-entry in european phase

Ref document number: 07790664

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: JP

点击 这是indexloc提供的php浏览器服务，不要输入任何密码和下载