+

WO2011111372A1 - Video image coding device and video image coding method - Google Patents

Video image coding device and video image coding method Download PDF

Info

Publication number
WO2011111372A1
WO2011111372A1 PCT/JP2011/001344 JP2011001344W WO2011111372A1 WO 2011111372 A1 WO2011111372 A1 WO 2011111372A1 JP 2011001344 W JP2011001344 W JP 2011001344W WO 2011111372 A1 WO2011111372 A1 WO 2011111372A1
Authority
WO
WIPO (PCT)
Prior art keywords
picture type
picture
image
coding
encoding
Prior art date
Application number
PCT/JP2011/001344
Other languages
French (fr)
Japanese (ja)
Inventor
秀之 大古瀬
Original Assignee
パナソニック株式会社
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by パナソニック株式会社 filed Critical パナソニック株式会社
Publication of WO2011111372A1 publication Critical patent/WO2011111372A1/en

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/102—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or selection affected or controlled by the adaptive coding
    • H04N19/103—Selection of coding mode or of prediction mode
    • H04N19/107—Selection of coding mode or of prediction mode between spatial and temporal predictive coding, e.g. picture refresh
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/102—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or selection affected or controlled by the adaptive coding
    • H04N19/103—Selection of coding mode or of prediction mode
    • H04N19/109—Selection of coding mode or of prediction mode among a plurality of temporal predictive coding modes
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/102—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or selection affected or controlled by the adaptive coding
    • H04N19/103—Selection of coding mode or of prediction mode
    • H04N19/112—Selection of coding mode or of prediction mode according to a given display mode, e.g. for interlaced or progressive display mode

Definitions

  • the present invention relates to a moving image encoding apparatus and a moving image encoding method.
  • the present invention relates to a moving image encoding apparatus and a moving image encoding method for encoding a moving image according to a moving image compression standard such as H.264.
  • H.264 has a higher encoding efficiency than the conventional MPEG-2 as a moving image compression standard. Recording using the H.264 standard is becoming mainstream.
  • Non-Patent Document 1 describes processing when PicAFF or MBAFF is applied.
  • MB coding modes that can be used for B pictures include a Direct mode and a Skip mode.
  • an image having the smallest reference number among reference images for performing L1 prediction is set as colPic, and encoding information of a block (hereinafter referred to as an anchor block) in the same spatial position as the block of the encoding target MB is used.
  • mvCol motion vector (hereinafter referred to as mvCol) of each partition of the anchor block is ⁇ 1 pixel or less in both horizontal and vertical directions and the reference number of the reference image of the anchor block satisfies a condition such as 0, the L0 prediction and the L1 In both prediction and reference images, the reference image with the smallest reference number is set as the predicted image and the motion vector is set to 0.
  • a prediction vector is generated from the motion vectors of the MBs around the encoding target MB, and is used as a motion vector for L0 prediction and L1 prediction according to the condition.
  • colPic information such as the MB address of the anchor block, the pixel space position of the block, and mvCol is corrected for each anchor block according to the combination.
  • colPic information a coding structure switching method for each frame image is disclosed (for example, Patent Document 1 and Patent Document 2).
  • Patent Document 1 discloses a method of performing provisional encoding for each encoding mode and determining whether the encoding structure is a frame or a field based on the encoding cost.
  • Patent Document 2 discloses a method for obtaining a difference value between two fields constituting a frame image and determining a coding structure according to the magnitude of the difference value.
  • the coding structure is switched for each input image, which causes an increase in circuit scale or software processing amount.
  • the present invention has been made in view of the above circumstances, and is a moving picture coding apparatus capable of adaptively switching coding structures without complicating coding information correction processing and access to reference images. And to provide a method.
  • an aspect of the moving picture coding apparatus is an interlace method that is an image that is input continuously and includes two fields, a top field and a bottom field.
  • a moving picture encoding apparatus that encodes an image of the image and generates an encoded stream, wherein the two fields constituting the image are collectively treated as one picture with respect to the continuously input images.
  • a coding structure setting unit that sets one of a scheme of a first coding structure to be converted and a second coding structure that codes the two fields constituting the image as independent pictures;
  • a first picture type that is encoded using only pixel data included in a picture to be encoded, and an image included in an image positioned forward in the encoding order Any one of the second picture type that is encoded using data and the third picture type that is encoded using pixel data included in an image that is bidirectionally positioned in the encoding order is the image.
  • a picture type setting unit that is set as a picture type of the image, a coding structure method set by the coding structure setting unit, and a picture type set by the picture type setting unit.
  • An encoding unit that generates a stream, and the encoded stream generated by the encoding unit includes at least the following in the encoding order from an image in which the first picture type or the second picture type is set A method of coding structure in which the first picture type or the picture with the second picture type set up to the previous picture is the same A.
  • FIG. 1 is a block diagram showing a configuration of a moving picture coding apparatus according to Embodiments 1 to 3 of the present invention.
  • FIG. 2 is a diagram illustrating an example of processing of the temporary picture type determination unit.
  • FIG. 3 is a diagram illustrating an example of timing for switching the coding structure.
  • FIG. 4 is a diagram illustrating an example of timing for switching the coding structure.
  • FIG. 5 is a block diagram showing the configuration of the moving picture coding apparatus according to Embodiment 4 of the present invention.
  • FIG. 6 is a block diagram showing the configuration of the moving picture coding apparatus according to Embodiment 5 of the present invention.
  • FIG. 2 is a diagram illustrating an example of a reference relationship of picture types in the H.264 video compression standard.
  • FIG. 7B is a diagram illustrating another example of a reference relationship of picture types to be encoded using a pixel correlation with a reference picture only in front.
  • FIG. 8 is a diagram showing an example of a display device using the moving image encoding device of the present invention.
  • FIG. 1 is a block diagram showing the configuration of the moving picture encoding apparatus according to the first embodiment.
  • FIG. 2 is a diagram illustrating an example of processing of the temporary picture type determination unit.
  • 1 includes a coding structure setting unit 102, a picture type setting unit 106, and a coding unit 107.
  • the moving image encoding apparatus 100 encodes a plurality of input images 101 that are continuous in time order and outputs an encoded stream 108.
  • H H. It is assumed that encoding is performed based on the H.264 standard.
  • the reference relationship of motion compensation is equivalent to MPEG2
  • the P frame (picture) is the immediately preceding I frame (picture) or P frame (picture) in the coding order
  • the B frame (picture) is immediately preceding and following in the coding order. Only I frames (pictures) or P frames (pictures) are referred to.
  • field coding it is assumed that a P picture is a P picture included in the same frame image, and a temporally subsequent field can refer to a temporally previous field.
  • the present invention is not limited to these assumptions.
  • the input image 101 is an interlaced image.
  • the unit of encoding is based on frame encoding, and is premised on switching to field encoding depending on the pictures constituting the frame image.
  • the interlaced image is an interlaced image composed of two fields, a top field and a bottom field.
  • the encoding structure setting unit 102 includes a provisional picture type determination unit 103 and an encoding structure determination unit 104, and determines (sets) an encoding structure when the input image 101 is encoded.
  • the coding structure setting unit 102 is a first coding structure method that performs coding by treating two consecutive images as a single picture with respect to continuously input images. One of the methods of the second coding structure for coding the two fields constituting the image as independent pictures is set. Also, the coding structure setting unit 102 sets the first coding unit included in the top field and the first coding unit included in the bottom field when the first coding structure method is set for the input image 101.
  • a coding structure method is set, in which corresponding coding units are collectively coded as one coding unit.
  • the scheme of the first coding structure corresponds to, for example, a frame coding scheme
  • the scheme of the second coding structure corresponds to, for example, a field coding scheme.
  • the coding structure setting unit 102 performs frame coding on a coding structure to be applied to each of the plurality of input images 101 to be coded by the temporary picture type determination unit 103 and the coding structure determination unit 104. Or set to field encoding.
  • the coding structure setting unit 102 is a frame image immediately preceding a frame image including an I picture or a P picture in the encoding order from a frame image including an I picture or a P picture in a plurality of continuous input images 101.
  • the encoding structure is determined so that the frame image group up to the same encoding structure is obtained, and the encoding structure to be applied to each of the plurality of input images 101 to be encoded is set according to the determined encoding structure. .
  • the coding structure setting unit 102 sets the coding set to an image of the first picture type (for example, I picture type) or the second picture type (for example, P picture type) among the images in the frame image group.
  • the structure (the first coding structure or the second coding structure) is set for all the images in the frame image group. That is, for example, the first picture type corresponds to an I picture type or the like, and the second picture type corresponds to a P picture type or the like.
  • the provisional picture type determination unit 103 determines whether images that are continuously input according to an encoding condition including an interval between first picture type images or an interval between second picture type images.
  • the picture type is determined as a temporary picture type for each of the continuously input images. That is, the provisional picture type determination unit 103 sets one of the first picture type, the second picture type, and the third picture type as a provisional picture type for continuously input images.
  • each of the plurality of input images to be encoded is frame-encoded according to an encoding condition including an interval of I frames (pictures) or an interval of P frames (pictures) in the plurality of input images to be encoded.
  • the picture type applied in this case is determined as a temporary picture type for each of a plurality of input images to be encoded. That is, the provisional picture type determination unit 103 determines the picture type for encoding the input image 101 to be encoded from the I frame (picture) interval or the P frame (picture) interval in the plurality of input images 101 to be encoded. The provisional decision is made to be the provisional picture type.
  • the provisional picture type determination unit 103 assigns (determines) provisional picture types to the plurality of input images 101 in the input order (display order) as shown in FIG.
  • the temporary picture type determination unit 103 may further assign a number to the plurality of input images 101 in the input order (display order).
  • the provisional picture type determination unit 103 assigns numbers and provisional picture types to the plurality of input images 101 in the input order (display order).
  • the coding structure determination unit 104 determines a coding structure to be applied to each of the plurality of input images 101 to be encoded according to at least the temporary picture type determined by the temporary picture type determination unit 103.
  • the coding structure determination unit 104 uses a plurality of coding structure information 105 and the temporary picture type determined by the temporary picture type determination unit 103 so as to have the same coding structure in units of the frame image group.
  • the encoding structure of each input image 101 is determined.
  • the coding structure information 105 indicates whether to encode each of a plurality of input images 101 to be encoded, that is, a plurality of input images 101 to be encoded, using frame encoding or field encoding. Information.
  • the picture type setting unit 106 encodes using a first picture type that is encoded using only pixel data included in a picture to be encoded, and pixel data included in an image positioned forward in the encoding order.
  • the picture type of any one of the second picture type to be encoded and the third picture type to be encoded using the pixel data included in the image bidirectionally positioned in the encoding order is set as the picture type of the image .
  • the third picture type corresponds to a B picture type.
  • the picture type setting unit 106 sets (determines) the picture type of each of the plurality of input images 101 to be encoded according to the temporary picture type and the encoding structure set by the encoding structure setting unit 102. To do.
  • the picture type setting unit 106 temporarily sets the input image 101 to be coded.
  • the provisional picture type provisionally determined by the picture type determination unit 103 is set as the picture type.
  • the picture type setting unit 106 temporarily sets the input image 101 to be coded. If the provisional picture type provisionally determined by the picture type determination unit 103 is P frame or B frame, the same picture type as the provisional picture type is set as the picture type of the field constituting the frame image.
  • the picture type setting unit 106 has the encoding structure of the input image 101 to be encoded determined by the encoding structure setting unit 102 as field encoding, and applies to the input image 101 to be encoded.
  • the provisional picture type provisionally determined by the provisional picture type determination unit 103 is an I frame
  • the top field of the field constituting the frame image is set to an I picture
  • the bottom field is set to an I picture or a P picture. Note that setting the bottom field to an I picture or a P picture depends on the above encoding condition.
  • the encoding unit 107 encodes an image based on the scheme set by the encoding structure setting unit 102 and the picture type set by the picture type setting unit 106, and generates an encoded stream.
  • the encoding unit 107 includes a plurality of input images 101 to be encoded according to the encoding structure set by the encoding structure setting unit 102 and the picture type set by the picture type setting unit 106, respectively. Are encoded and an encoded stream 108 is output.
  • the encoded stream generated by the encoding unit 107 is set with at least the first and second picture types in the encoding order from the image in which the first picture type or the second picture type is set.
  • the system with the same coding structure is used up to the previous image.
  • the moving image encoding apparatus 100 is configured.
  • FIG. 3 is a diagram illustrating an example of timing for switching the coding structure.
  • a plurality of input images 101 are input to the encoding unit 107.
  • the provisional picture type determination unit 103 assigns numbers and provisional picture types to the plurality of input images 101 in the input order (display order). For example, as shown in FIG. 3A, since the first image and the next image that are input are B-picture frame images, numbers and provisional picture types are assigned as B0 and B1. . In this way, the first to ninth images of the input image 101 that have been input are assigned numbers and provisional picture types such as B0, B1, I2, B3, B4, P5, B6, B7, and P8. ing.
  • the coding structure determination unit 104 receives coding structure information 105 indicating that the coding structure applied when coding the P5 frame is field coding.
  • FIG. 3B is a diagram in which a plurality of input images 101 shown in FIG. As shown in FIG. 3B, images with P5 frame as colPic are B3 frame and B4 frame.
  • the encoding structure applied when encoding the P5 frame is field encoding
  • the encoding structure applied when encoding the B3 frame and the B4 frame is frame encoding.
  • the colPic information necessary for each MB of each picture requires complicated processing as described above in the conventional technique.
  • the coding structure determination unit 104 switches not only the P5 frame but also the B3 frame and the B4 frame to field coding.
  • the coding structure determination unit 104 determines the coding structure of each of the plurality of input images 101 using the coding structure information 105 and the temporary picture type determined by the temporary picture type determination unit 103. .
  • the coding structure determination unit 104 determines the first frame image and the last frame image in the plurality of input images 101 to be encoded, which are indicated to apply the same coding structure, in display order. After that, the temporary picture determined by the temporary picture type determination unit 103 among the frame images of the input image 101 to be encoded that is encoded before the first frame image or the first frame image in the encoding order.
  • the encoding unit 107 performs encoding information correction processing and access to the reference image according to the encoding structure set by the encoding structure setting unit 102 and the picture type set by the picture type setting unit 106.
  • Each of the plurality of input images 101 to be encoded can be encoded by adaptively switching the encoding structure without complication.
  • a moving picture coding apparatus capable of adaptively switching coding structures without complicating coding information correction processing and access to a reference image is realized. can do.
  • the coding structure is switched from an I picture or a P picture in the coding order.
  • the encoding structures of Current B and ColPic are the same, there is no need to correct the colPic information, and the process is simplified.
  • the coding structure of the B picture and the P picture corresponding to ColPic can be matched by switching the coding structure from the P picture in the coding order. There is an effect that the processing becomes simple.
  • the coding structure determination unit 104 uses the coding structure information 105 and the temporary picture type determined by the temporary picture type determination unit 103 to perform P frame (picture) to P frame (picture) in the coding order. What is necessary is just to determine to the B frame (picture) immediately before of the same encoding structure.
  • the first embodiment describes a switching method in which the coding structure determination unit 104 uses the same coding structure from the P frame (picture) to the B frame (picture) immediately before the P frame (picture) in the coding order. However, it is not limited to that.
  • a switching method different from the above switching method will be described using the configuration described in the first embodiment.
  • the precondition is the same as in the first embodiment.
  • the coding structure determining unit 104 uses the coding structure information 105 and the temporary picture type determined by the temporary picture type determining unit 103 as a unit of P (I) BB frames (pictures) in the coding order.
  • Switch coding structure For example, the coding structure determination unit 104 may switch the coding structure with three frames P5, B3, and B4 as one unit in the coding order as shown in FIG. 3B.
  • the encoding unit 107 reorders the plurality of input images 101 input from the input order to the encoding order until the encoding process is performed. It is possible to determine whether it is necessary to switch the coding structure between the B3 frame and the B4 frame before encoding. For example, when the B4 frame is switched to the field encoding, the encoding structure indicating that the PBB frame including the B4 frame (picture) P5 frame, B3 frame, and B4 frame is switched to the field encoding is the encoding structure. Set by the setting unit 102.
  • the encoding unit 107 complicates encoding information correction processing and access to the reference image according to the encoding structure set by the encoding structure setting unit 102 and the picture type set by the picture type setting unit 106.
  • the encoding structure can be adaptively switched without encoding, and each of the plurality of input images 101 to be encoded can be encoded.
  • the coding structure determination unit 104 includes a plurality of input images 101 to be encoded, and a frame image in which the temporary picture type determined by the temporary picture type determination unit 103 includes an I picture or a P picture.
  • a moving picture coding apparatus capable of adaptively switching coding structures without complicating coding information correction processing and access to reference images is realized. can do.
  • the encoding structure applied when encoding may extend over a plurality of frames and exceed one PBB frame (picture) unit.
  • PBB frame picture
  • the P8, B6, and B7 frames are also used for field encoding. What is necessary is just to switch.
  • the coding structure may be switched using one frame from the I frame (picture) to the frame image (picture) immediately before the next I frame (picture) in the coding order corresponding to the GOP unit in MPEG2. Good.
  • FIG. 4 is a diagram illustrating an example of timing for switching the coding structure. 4 (a) and 4 (b) are the same as FIGS. 3 (a) and 3 (b), and detailed description thereof is omitted.
  • the coding structure determining unit 104 performs coding indicating that the coding structure applied at the time of coding is frame coding up to the B4 frame in the display order, and field coding after the P5 frame. Structure information 105 is input.
  • the coding structure information 105 input to the picture type setting unit 106 coding structure determining unit 104 and the temporary picture type determined by the temporary picture type determining unit 103 are directly encoded. In this case, complicated processing is required to generate colPic information for B3 and B4 frames.
  • the picture type setting unit 106 changes the picture type of the B4 frame immediately before the image (P5 frame) whose coding structure is switched in the display order as shown in FIG. That is, it is changed to P frame).
  • the colPic of the B3 frame becomes the P4 frame and has the same coding structure, so the generation of colPic information is simplified.
  • the picture types of the plurality of input images 101 to be coded are simplified so that the colPic information can be easily generated. Is set (determined).
  • the encoding structure determination unit 104 sets the provisional picture type of the immediately preceding frame image in the display order as the P picture, which is a frame image in the plurality of input images 101 to be encoded, which is indicated to switch the encoding structure to be applied.
  • the immediately preceding frame image is switched to the first frame image of the frame image group, and the coding structure is determined so that one of the switched frame image groups has the same coding structure.
  • the picture type setting unit 106 sets the picture type of the immediately preceding frame image to P according to the temporary picture type determined by the temporary picture type determination unit 103 and the coding structure determined by the coding structure determination unit 104.
  • a picture type to be applied to each of a plurality of input images 101 to be encoded is set by changing to a picture and setting a temporary picture type other than the immediately preceding frame image as a picture type.
  • a moving picture coding apparatus capable of adaptively switching coding structures without complicating coding information correction processing and access to a reference image is realized. can do.
  • FIG. 5 is a block diagram showing a configuration of the moving picture coding apparatus according to the fourth embodiment. 5 encodes a plurality of input images 101 that are continuous in time order and outputs an encoded stream 108.
  • the encoding structure setting unit 401, the picture type setting unit 106, and the encoding Unit 107 Elements similar to those in FIG. 1 are denoted by the same reference numerals, and detailed description thereof is omitted.
  • FIG. 5 is different from the video encoding device 100 according to Embodiment 1 in the configuration of the encoding structure setting unit 401.
  • the video encoding device 200 illustrated in FIG. As described above, the configuration of FIG. 5 is substantially the same as that of FIG. 1 of the first embodiment, and therefore, different parts will be mainly described below.
  • the coding structure setting unit 401 includes a temporary picture type determination unit 103, an information extraction unit 402, and a coding structure determination unit 403.
  • the coding structure setting unit 401 detects the motion of an image using information of the input image 101, and determines the motion amount and the temporary motion.
  • An encoding structure for encoding the input image 101 is determined (set) from the temporary picture type temporarily determined by the picture type determination unit 103.
  • the information extraction unit 402 detects the movement of the input image 101. For example, there is a sum of absolute values of differences between lines as a representative example. This is the same as the sum of absolute differences between the screens of the top field and the bottom field constituting the frame image, and becomes a small value when there is no motion in the input image.
  • the coding structure determination unit 403 compares the above sum of absolute values with a threshold value, and determines whether there is motion between fields. Then, the coding structure determination unit 403 determines a coding structure for coding each image (each of the plurality of input images 101) from the motion determination result and the temporary picture type. Note that the switching method at this time is the same as that described in the first to third embodiments. That is, including the frame image (picture) for switching the coding structure, the same coding structure is used from the P frame (picture) to the B frame (picture) immediately before the P frame (picture) in the coding order. Alternatively, the coding structure may be switched in units of PBB frames (pictures) or may be switched in units of GOPs.
  • the coding structure determination unit 403 uses the amount of motion of the input image 101 detected by the information extraction unit 402 and the provisional picture type determined by the provisional picture type determination unit 103 to generate each image (multiple images).
  • the input image 101) is determined.
  • the encoding unit 107 encodes each of the plurality of input images 101 to be encoded by adaptively switching the encoding structure without complicating encoding information correction processing and access to the reference image. be able to.
  • a moving picture coding apparatus capable of adaptively switching coding structures without complicating coding information correction processing and access to a reference image is realized. can do.
  • the inter-line difference is exemplified as the motion information detected by the information extraction unit 402.
  • motion detection may be performed using pixels on the entire screen or a reduced image, and the result may be used as the motion amount.
  • the amount of motion may be obtained from the difference between the input image 101 and the previous frame image in time.
  • FIG. 6 is a block diagram showing a configuration of the moving picture coding apparatus according to the fifth embodiment. 6 encodes a plurality of input images 101 that are continuous in time order and outputs an encoded stream 108, and includes an encoding structure setting unit 501, a picture type setting unit 106, and an encoding Unit 107.
  • FIG. 6 is different from the video encoding device 100 according to Embodiment 1 in the configuration of the encoding structure setting unit 501.
  • the video encoding device 300 illustrated in FIG. As described above, the configuration of FIG. 6 is substantially the same as that of FIG. 1 of the first embodiment, and therefore, different portions will be mainly described below.
  • the coding structure setting unit 501 includes a provisional picture type determination unit 103 and a coding structure determination unit 502, and uses the motion vector information that is the result of coding the picture that has already been coded by the coding unit 107 to perform image motion. And a coding structure for coding the input image 101 is determined (set) from the amount of motion and the temporary picture type temporarily determined by the temporary picture type determination unit 103.
  • the encoding structure determination unit 502 determines a motion using the encoded motion vector information. For example, statistical processing is performed on the past several pictures of information such as the average, variance, maximum and minimum values of the motion vectors of all MBs, or the dynamic range of the vector size, and the value of the statistical processing result is compared with the threshold To determine whether there is movement. Then, the coding structure determining unit 502 determines a coding structure for encoding each image (each of the plurality of input images 101) from the motion determination result and the temporarily determined temporary picture type. Note that the switching method at this time is the same as that described in the first to third embodiments.
  • the same coding structure is used from the P frame (picture) to the B frame (picture) immediately before the P frame (picture) in the coding order.
  • the coding structure may be switched in units of PBB frames (pictures), or may be switched in units of GOPs.
  • the coding structure determining unit 502 is based on the amount of motion of the input image 101 determined using the motion vector information from the encoding unit 107 and the temporary picture type determined by the temporary picture type determining unit 103.
  • the coding structure of each image is determined. Accordingly, the encoding unit 107 encodes each of the plurality of input images 101 to be encoded by adaptively switching the encoding structure without complicating encoding information correction processing and access to the reference image. be able to.
  • a moving picture coding apparatus capable of adaptively switching coding structures without complicating coding information correction processing and access to reference images is realized. can do.
  • the present invention is not limited to this embodiment. Unless it deviates from the meaning of this invention, the form which carried out the various deformation
  • the scope of the present invention is the above-described H.264.
  • the present invention is not limited to encoding using PicAFF or MBAFF based on the H.264 standard.
  • frame coding that treats two fields constituting the interlaced image as one frame image (picture) and two fields constituting the interlaced image are independent (individually) If it is a case where the field coding treated as two pictures is switched and coded for each frame image, it is included in the scope of the present invention.
  • FIG. H As shown in 7A.
  • the I picture type (I0 in the figure) and the P picture type (P3, P6 in the figure) in the H.264 standard have been described as examples, but not limited thereto.
  • the B picture type (B1, B2, B4, B5 in the figure) in the H.264 standard has been described as an example, but is not limited thereto.
  • FIG. 7B is a diagram illustrating an example of a reference relationship of picture types in the H.264 video compression standard
  • FIG. 7B is another example of a reference relationship of picture types to be encoded using a pixel correlation with a reference picture only in front.
  • the moving image coding apparatus and the moving image coding method of the present invention are used. Is included in the scope of the present invention.
  • the present invention can be used for a moving picture coding apparatus and a moving picture coding method.
  • Moving images used for display devices, videos, movie cameras, digital cameras (DSC), mobile phones, portable devices, portable tablets, etc. that can encode and broadcast and record moving images according to the H.264 standard.
  • the present invention can be used for an image encoding device and a moving image encoding method.

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Compression Or Coding Systems Of Tv Signals (AREA)

Abstract

Disclosed is a video image coding device, comprising a coding structure setting unit (102) that sets either a frame coding scheme or a field coding scheme for interlace scheme images that are inputted contiguously; a picture type setting unit (106) that sets the picture type of the images to any of an I picture type, a P picture type, or a B picture type; and a coding unit (107) that codes the images, and generates a coding stream, on the basis of the scheme set with the coding structure setting unit (102) and the picture type set with the picture type setting unit (106). The coding structure setting unit (102) sets a set of images to a common scheme, said set of images starting from an image that is set to either the I picture type or the P picture type and ending with the image immediately prior to the image that is at least the next I picture type or the P picture type or thereafter in coding order.

Description

動画像符号化装置および動画像符号化方法Moving picture coding apparatus and moving picture coding method
　本発明は、動画像符号化装置および動画像符号化方法に関し、特に、Ｈ．２６４等の動画像圧縮規格に従って動画像を符号化する動画像符号化装置および動画像符号化方法に関するものである。 The present invention relates to a moving image encoding apparatus and a moving image encoding method. The present invention relates to a moving image encoding apparatus and a moving image encoding method for encoding a moving image according to a moving image compression standard such as H.264.
　近年、ＢＤ／ＤＶＤレコーダ等の録画機器やカムコーダなどの撮像機器でハイビジョン動画像を記録する際、動画像圧縮規格として、従来のＭＰＥＧ－２よりも符号化効率が高いＨ．２６４規格を用いて記録されることが主流となりつつある。 In recent years, when recording high-definition moving images with a recording device such as a BD / DVD recorder or an imaging device such as a camcorder, H.264 has a higher encoding efficiency than the conventional MPEG-2 as a moving image compression standard. Recording using the H.264 standard is becoming mainstream.
　このＨ．２６４規格では、例えば非特許文献１に記載されているように、ＰｉｃＡＦＦ（Ｐｉｃｔｕｒｅ　Ａｄａｐｔｉｖｅ　Ｆｒａｍｅ　Ｆｉｅｌｄ）とＭＢＡＦＦ（ＭａｃｒｏＢｌｏｃｋ　Ａｄａｐｔｉｖｅ　Ｆｒａｍｅ　Ｆｉｅｌｄ）とが定義されている。すなわち、Ｈ．２６４規格では、ＰｉｃＡＦＦにより、インタレース画像を符号化する際に、インタレース画像を構成する２つのフィールドをまとめて１つのフレーム画像（ピクチャ）として扱うフレーム符号化と、インタレース画像を構成する２つのフィールドを独立（個別）に２つのピクチャとして扱うフィールド符号化とをフレーム画像毎に切り替えて符号化することが可能である。ここで、インタレース画像とは、トップフィールドおよびボトムフィールドの２つのフィールドから構成されるインタレース方式の画像である。また、フレーム符号化の場合、ＭＢＡＦＦにより、マクロブロック（以下、ＭＢ）ペア単位でフレーム符号化とフィールド符号化とを切り替えることが可能である。 This H. In the H.264 standard, for example, as described in Non-Patent Literature 1, PicAFF (Picture Adaptive Frame Field) and MBAFF (MacroBlock Adaptive Frame Field) are defined. That is, H.I. In the H.264 standard, when encoding an interlaced image using PicAFF, two fields constituting the interlaced image are collectively treated as one frame image (picture), and an interlaced image is formed 2 It is possible to perform encoding by switching field encoding for handling two fields independently (individually) as two pictures for each frame image. Here, the interlaced image is an interlaced image composed of two fields, a top field and a bottom field. In the case of frame encoding, it is possible to switch between frame encoding and field encoding in units of macroblock (hereinafter referred to as MB) by MBAFF.
　また、非特許文献１において、ＰｉｃＡＦＦやＭＢＡＦＦを適用した場合の処理が記載されている。Ｂピクチャで使用できるＭＢの符号化モードには、ＤｉｒｅｃｔモードとＳｋｉｐモードとがある。これらのモードでは、Ｌ１予測を行う参照画像で参照番号が最も小さい画像をｃｏｌＰｉｃとして、符号化対象ＭＢのブロックと同じ空間位置にあるブロック（以下、アンカーブロックという）の符号化情報を利用する。具体的には、アンカーブロックの各パーティションの動きベクトル（以下、ｍｖＣｏｌ）が水平・垂直とも±１画素以下で、アンカーブロックの参照画像の参照番号が０等の条件を満たせば、Ｌ０予測とＬ１予測とも参照画像のうち、最も小さな参照番号の参照画像を予測画像として、かつ動きベクトルを０とする。上記条件から外れた場合は符号化対象ＭＢの周辺ＭＢの動きベクトルから予測ベクトルを生成し、条件に応じてＬ０予測、Ｌ１予測の動きベクトルとする。 Further, Non-Patent Document 1 describes processing when PicAFF or MBAFF is applied. MB coding modes that can be used for B pictures include a Direct mode and a Skip mode. In these modes, an image having the smallest reference number among reference images for performing L1 prediction is set as colPic, and encoding information of a block (hereinafter referred to as an anchor block) in the same spatial position as the block of the encoding target MB is used. Specifically, if the motion vector (hereinafter referred to as mvCol) of each partition of the anchor block is ± 1 pixel or less in both horizontal and vertical directions and the reference number of the reference image of the anchor block satisfies a condition such as 0, the L0 prediction and the L1 In both prediction and reference images, the reference image with the smallest reference number is set as the predicted image and the motion vector is set to 0. When the above condition is not satisfied, a prediction vector is generated from the motion vectors of the MBs around the encoding target MB, and is used as a motion vector for L0 prediction and L1 prediction according to the condition.
　ＰｉｃＡＦＦによって符号化対象画像と参照画像との符号化構造が異なる場合、その組み合わせに従って、アンカーブロックのＭＢアドレス、ブロックの画素空間位置、ｍｖＣｏｌ等の情報（以下、ｃｏｌＰｉｃ情報）をアンカーブロック毎に補正する必要がある。そして、それに対する技術として、フレーム画像毎の符号化構造切り替え方法が開示されている（例えば特許文献１、特許文献２）。 When the encoding structure of the encoding target image differs from that of the reference image depending on PicAFF, the information (hereinafter referred to as colPic information) such as the MB address of the anchor block, the pixel space position of the block, and mvCol is corrected for each anchor block according to the combination. There is a need to. As a technique for that, a coding structure switching method for each frame image is disclosed (for example, Patent Document 1 and Patent Document 2).
　特許文献１では、符号化モード毎に仮符号化を行い、符号化コストに基づいて符号化構造をフレームとフィールドとの何れにするかを決定する方法が開示されている。また、特許文献２では、フレーム画像を構成する２フィールド間の差分値を求め、差分値の大きさに従って符号化構造を決定する方法が開示されている。 Patent Document 1 discloses a method of performing provisional encoding for each encoding mode and determining whether the encoding structure is a frame or a field based on the encoding cost. Patent Document 2 discloses a method for obtaining a difference value between two fields constituting a frame image and determining a coding structure according to the magnitude of the difference value.
特開２００６－８０９２５号公報JP 2006-80925 A 特開２０００－１０２０１７号公報JP 2000-102017 A
　しかしながら、入力画像毎に符号化構造を適応的に切り替える場合、符号化対象画像と参照画像の符号化構造とが異なると、動きベクトルの垂直成分を補正するだけではなく、ＤｉｒｅｃｔモードとＳｋｉｐモードとで必要なｃｏｌＰｉｃ情報を補正するというような複雑な処理が必要となる。さらに、参照画像へのアクセス方法が複雑になるという課題がある。 However, when the coding structure is adaptively switched for each input image, if the coding target image and the coding structure of the reference image are different, not only the vertical component of the motion vector is corrected, but also the Direct mode and the Skip mode. In such a case, a complicated process such as correcting colPic information that is necessary is required. Furthermore, there is a problem that the access method to the reference image becomes complicated.
　また、上記従来の方法では、入力画像毎に符号化構造を切り替えるため、回路規模、またはソフトウェアの処理量の増大を引き起こす事になる。 In the conventional method, the coding structure is switched for each input image, which causes an increase in circuit scale or software processing amount.
　本発明は上記の事情に鑑みてなされたものであり、符号化情報の補正処理や参照画像へのアクセスを複雑にすることなく符号化構造を適応的に切り替えることが可能な動画像符号化装置および方法を提供することを目的とする。 The present invention has been made in view of the above circumstances, and is a moving picture coding apparatus capable of adaptively switching coding structures without complicating coding information correction processing and access to reference images. And to provide a method.
　上記の課題を解決するために、本発明に係る動画像符号化装置の一形態は、連続して入力される画像であって、トップフィールドおよびボトムフィールドの２つのフィールドから構成されるインタレース方式の画像を符号化し、符号化ストリームを生成する動画像符号化装置であって、前記連続して入力される画像に対して、当該画像を構成する２つのフィールドをまとめて１つのピクチャとして扱い符号化する第１符号化構造の方式および当該画像を構成する２つのフィールドを独立したピクチャとして扱い符号化する第２符号化構造の方式のうちいずれかの方式を設定する符号化構造設定部と、符号化対象のピクチャ内に含まれる画素データのみを利用して符号化する第１ピクチャタイプ、符号化順で前方に位置する画像に含まれる画素データを利用して符号化する第２ピクチャタイプおよび符号化順で双方向に位置する画像に含まれる画素データを利用して符号化する第３ピクチャタイプのうちいずれかのピクチャタイプを、前記画像のピクチャタイプとして設定するピクチャタイプ設定部と、前記符号化構造設定部で設定された符号化構造の方式および前記ピクチャタイプ設定部で設定されたピクチャタイプに基づいて前記画像を符号化し、符号化ストリームを生成する符号化部と、を備え、前記符号化部が生成する符号化ストリームは、前記第１ピクチャタイプまたは前記第２ピクチャタイプが設定された画像から、少なくとも符号化順で次以降の前記第１ピクチャタイプまたは前記第２ピクチャタイプが設定された画像の１つ前の画像までが同一の符号化構造の方式である。 In order to solve the above-described problem, an aspect of the moving picture coding apparatus according to the present invention is an interlace method that is an image that is input continuously and includes two fields, a top field and a bottom field. Is a moving picture encoding apparatus that encodes an image of the image and generates an encoded stream, wherein the two fields constituting the image are collectively treated as one picture with respect to the continuously input images. A coding structure setting unit that sets one of a scheme of a first coding structure to be converted and a second coding structure that codes the two fields constituting the image as independent pictures; A first picture type that is encoded using only pixel data included in a picture to be encoded, and an image included in an image positioned forward in the encoding order Any one of the second picture type that is encoded using data and the third picture type that is encoded using pixel data included in an image that is bidirectionally positioned in the encoding order is the image. A picture type setting unit that is set as a picture type of the image, a coding structure method set by the coding structure setting unit, and a picture type set by the picture type setting unit. An encoding unit that generates a stream, and the encoded stream generated by the encoding unit includes at least the following in the encoding order from an image in which the first picture type or the second picture type is set A method of coding structure in which the first picture type or the picture with the second picture type set up to the previous picture is the same A.
　本発明によれば、符号化情報の補正処理や参照画像へのアクセスを複雑にすることなく符号化構造を適応的に切り替えることが可能となる動画像符号化装置および方法を実現することができる。 According to the present invention, it is possible to realize a moving picture coding apparatus and method that can adaptively switch coding structures without complicating coding information correction processing and access to a reference image. .
図１は、本発明の実施の形態１から３に係る動画像符号化装置の構成を示すブロック図である。FIG. 1 is a block diagram showing a configuration of a moving picture coding apparatus according to Embodiments 1 to 3 of the present invention. 図２は、仮ピクチャタイプ決定部の処理の一例を示す図である。FIG. 2 is a diagram illustrating an example of processing of the temporary picture type determination unit. 図３は、符号化構造を切り替えるタイミングの一例を示す図である。FIG. 3 is a diagram illustrating an example of timing for switching the coding structure. 図４は、符号化構造を切り替えるタイミングの一例を示す図である。FIG. 4 is a diagram illustrating an example of timing for switching the coding structure. 図５は、本発明の実施の形態４に係る動画像符号化装置の構成を示すブロック図である。FIG. 5 is a block diagram showing the configuration of the moving picture coding apparatus according to Embodiment 4 of the present invention. 図６は、本発明の実施の形態５に係る動画像符号化装置の構成を示すブロック図である。FIG. 6 is a block diagram showing the configuration of the moving picture coding apparatus according to Embodiment 5 of the present invention. 図７Ａは、Ｈ．２６４の動画像圧縮規格におけるピクチャタイプの参照関係の例を示す図である。FIG. 2 is a diagram illustrating an example of a reference relationship of picture types in the H.264 video compression standard. FIG. 図７Ｂは、前方のみの参照ピクチャとの画素の相関を用いて符号化するピクチャタイプの参照関係の別の例を示す図である。FIG. 7B is a diagram illustrating another example of a reference relationship of picture types to be encoded using a pixel correlation with a reference picture only in front. 図８は、本発明の動画像符号化装置を用いた表示装置の一例を示す図である。FIG. 8 is a diagram showing an example of a display device using the moving image encoding device of the present invention.
　以下、本発明の実施形態について、図面を用いて説明する。なお、本発明について、以下の実施の形態および添付の図面を用いて説明を行うが、これは例示を目的としており、本発明がこれらに限定されることを意図しない。 Hereinafter, embodiments of the present invention will be described with reference to the drawings. In addition, although this invention is demonstrated using the following embodiment and attached drawing, this is for the purpose of illustration and this invention is not intended to be limited to these.
　（実施の形態１）
　図１は、本実施の形態１に係る動画像符号化装置の構成を示すブロック図である。図２は、仮ピクチャタイプ決定部の処理の一例を示す図である。 (Embodiment 1)
FIG. 1 is a block diagram showing the configuration of the moving picture encoding apparatus according to the first embodiment. FIG. 2 is a diagram illustrating an example of processing of the temporary picture type determination unit.
　図１に示す動画像符号化装置１００は、符号化構造設定部１０２と、ピクチャタイプ設定部１０６と、符号化部１０７とを備える。 1 includes a coding structure setting unit 102, a picture type setting unit 106, and a coding unit 107.
　動画像符号化装置１００は、時間順に連続する複数の入力画像１０１を符号化して符号化ストリーム１０８を出力する。 The moving image encoding apparatus 100 encodes a plurality of input images 101 that are continuous in time order and outputs an encoded stream 108.
　以下、本実施の形態の説明において、説明を簡単にするために、Ｈ．２６４規格に基づいて符号化することを前提とする。また、動き補償の参照関係はＭＰＥＧ２と同等でＰフレーム（ピクチャ）は符号化順で直前のＩフレーム（ピクチャ）またはＰフレーム（ピクチャ）、Ｂフレーム（ピクチャ）は符号化順で直前と直後のＩフレーム（ピクチャ）またはＰフレーム（ピクチャ）のみを参照するものとする。また、フィールド符号化の場合、Ｐピクチャは同一フレーム画像に含まれるＰピクチャで時間的に後のフィールドが時間的に前のフィールドを参照することができるものとする。また、符号化順に連続するフレームにおいてＰフレーム間のＢフレーム枚数は２枚であるものとする。また、符号化順に連続するフレームにおいてＩフレーム間のフレーム数は固定フレーム数とし、そのフレーム数は１５であることを前提とする。もちろん、本発明はこれら前提に縛られるものではない。 In the following description of the present embodiment, in order to simplify the description, H. It is assumed that encoding is performed based on the H.264 standard. In addition, the reference relationship of motion compensation is equivalent to MPEG2, and the P frame (picture) is the immediately preceding I frame (picture) or P frame (picture) in the coding order, and the B frame (picture) is immediately preceding and following in the coding order. Only I frames (pictures) or P frames (pictures) are referred to. In the case of field coding, it is assumed that a P picture is a P picture included in the same frame image, and a temporally subsequent field can refer to a temporally previous field. Further, it is assumed that the number of B frames between P frames in frames consecutive in the encoding order is two. In addition, it is assumed that the number of frames between I frames in frames that are consecutive in the encoding order is a fixed number of frames, and the number of frames is 15. Of course, the present invention is not limited to these assumptions.
　また、入力画像１０１はインタレース画像であることを前提とする。また、符号化の単位はフレーム符号化を基本として、フレーム画像を構成するピクチャによってフィールド符号化に切り替えることを前提とする。上述したように、ここで、インタレース画像とは、トップフィールドおよびボトムフィールドの２つのフィールドから構成されるインタレース方式の画像である。 Suppose that the input image 101 is an interlaced image. The unit of encoding is based on frame encoding, and is premised on switching to field encoding depending on the pictures constituting the frame image. As described above, the interlaced image is an interlaced image composed of two fields, a top field and a bottom field.
　符号化構造設定部１０２は、仮ピクチャタイプ決定部１０３と符号化構造決定部１０４とを備え、入力画像１０１を符号化する際の符号化構造を決定（設定）する。具体的には、符号化構造設定部１０２は、連続して入力される画像に対して、当該画像を構成する２つのフィールドをまとめて１つのピクチャとして扱い符号化する第１符号化構造の方式および当該画像を構成する２つのフィールドを独立したピクチャとして扱い符号化する第２符号化構造の方式のうちいずれかの方式を設定する。また、符号化構造設定部１０２は、入力画像１０１に対して第１符号化構造の方式を設定した場合、トップフィールドに含まれる第１符号化単位とボトムフィールドに含まれる第１符号化単位に対応する符号化単位をまとめて１つの符号化単位として符号化する符号化構造方式を設定する。ここで、第１符号化構造の方式とは、例えば、フレーム符号化の方式に相当し、第２符号化構造の方式とは、例えば、フィールド符号化の方式に相当する。 The encoding structure setting unit 102 includes a provisional picture type determination unit 103 and an encoding structure determination unit 104, and determines (sets) an encoding structure when the input image 101 is encoded. Specifically, the coding structure setting unit 102 is a first coding structure method that performs coding by treating two consecutive images as a single picture with respect to continuously input images. One of the methods of the second coding structure for coding the two fields constituting the image as independent pictures is set. Also, the coding structure setting unit 102 sets the first coding unit included in the top field and the first coding unit included in the bottom field when the first coding structure method is set for the input image 101. A coding structure method is set, in which corresponding coding units are collectively coded as one coding unit. Here, the scheme of the first coding structure corresponds to, for example, a frame coding scheme, and the scheme of the second coding structure corresponds to, for example, a field coding scheme.
　さらに具体的には、符号化構造設定部１０２は、仮ピクチャタイプ決定部１０３と符号化構造決定部１０４とにより、符号化対象の複数の入力画像１０１それぞれに適用する符号化構造をフレーム符号化またはフィールド符号化に設定する。符号化構造設定部１０２は、連続する複数の入力画像１０１におけるＩピクチャまたはＰピクチャを含むフレーム画像から、符号化順で次以降のＩピクチャもしくはＰピクチャを含むフレーム画像より一つ前のフレーム画像までのフレーム画像群を単位として同一の符号化構造になるように符号化構造を決定し、決定した符号化構造に従って、符号化対象の複数の入力画像１０１それぞれに適用する符号化構造を設定する。 More specifically, the coding structure setting unit 102 performs frame coding on a coding structure to be applied to each of the plurality of input images 101 to be coded by the temporary picture type determination unit 103 and the coding structure determination unit 104. Or set to field encoding. The coding structure setting unit 102 is a frame image immediately preceding a frame image including an I picture or a P picture in the encoding order from a frame image including an I picture or a P picture in a plurality of continuous input images 101. The encoding structure is determined so that the frame image group up to the same encoding structure is obtained, and the encoding structure to be applied to each of the plurality of input images 101 to be encoded is set according to the determined encoding structure. .
　換言すると、符号化構造設定部１０２は、フレーム画像群内の画像のうち、第１ピクチャタイプ（例えばＩピクチャタイプ）または第２ピクチャタイプ（例えばＰピクチャタイプ）である画像に設定された符号化構造（第１符号化構造もしくは第２符号化構造）を、フレーム画像群の全ての画像に設定する。つまり、例えば第１ピクチャタイプは、Ｉピクチャタイプなどに相当し、第２ピクチャタイプは、Ｐピクチャタイプなどに相当する。 In other words, the coding structure setting unit 102 sets the coding set to an image of the first picture type (for example, I picture type) or the second picture type (for example, P picture type) among the images in the frame image group. The structure (the first coding structure or the second coding structure) is set for all the images in the frame image group. That is, for example, the first picture type corresponds to an I picture type or the like, and the second picture type corresponds to a P picture type or the like.
　仮ピクチャタイプ決定部１０３は、連続して入力される画像であって第１ピクチャタイプの画像の間隔または第２ピクチャタイプの画像の間隔を含む符号化条件に従って、連続して入力される画像のピクチャタイプを、当該連続して入力される画像それぞれの仮ピクチャタイプとして決定する。つまり、仮ピクチャタイプ決定部１０３は、連続して入力される画像に対して、第１ピクチャタイプ、第２ピクチャタイプおよび第３ピクチャタイプのうちいずれか１つのピクチャタイプを仮のピクチャタイプとして設定する。具体的には、符号化対象の複数の入力画像におけるＩフレーム（ピクチャ）の間隔またはＰフレーム（ピクチャ）の間隔を含む符号化条件に従って、符号化対象の複数の入力画像それぞれをフレーム符号化する場合に適用されるピクチャタイプを、符号化対象の複数の入力画像それぞれの仮ピクチャタイプとして決定する。すなわち、仮ピクチャタイプ決定部１０３は、符号化対象の入力画像１０１を符号化する際のピクチャタイプを符号化対象の複数の入力画像１０１におけるＩフレーム（ピクチャ）間隔またはＰフレーム（ピクチャ）間隔から仮決定し、仮ピクチャタイプとする。 The provisional picture type determination unit 103 determines whether images that are continuously input according to an encoding condition including an interval between first picture type images or an interval between second picture type images. The picture type is determined as a temporary picture type for each of the continuously input images. That is, the provisional picture type determination unit 103 sets one of the first picture type, the second picture type, and the third picture type as a provisional picture type for continuously input images. To do. Specifically, each of the plurality of input images to be encoded is frame-encoded according to an encoding condition including an interval of I frames (pictures) or an interval of P frames (pictures) in the plurality of input images to be encoded. The picture type applied in this case is determined as a temporary picture type for each of a plurality of input images to be encoded. That is, the provisional picture type determination unit 103 determines the picture type for encoding the input image 101 to be encoded from the I frame (picture) interval or the P frame (picture) interval in the plurality of input images 101 to be encoded. The provisional decision is made to be the provisional picture type.
　例えば、仮ピクチャタイプ決定部１０３は、図２に示すように、複数の入力画像１０１に対して入力順（表示順）に仮ピクチャタイプを割り振る（決定する）。ここで、仮ピクチャタイプ決定部１０３は、複数の入力画像１０１を入力順（表示順）にさらに番号を割り振っていてもよい。以下、説明の便宜のために、仮ピクチャタイプ決定部１０３は、複数の入力画像１０１に対して入力順（表示順）に、番号と仮ピクチャタイプとを割り振るとする。 For example, the provisional picture type determination unit 103 assigns (determines) provisional picture types to the plurality of input images 101 in the input order (display order) as shown in FIG. Here, the temporary picture type determination unit 103 may further assign a number to the plurality of input images 101 in the input order (display order). Hereinafter, for convenience of explanation, it is assumed that the provisional picture type determination unit 103 assigns numbers and provisional picture types to the plurality of input images 101 in the input order (display order).
　符号化構造決定部１０４は、少なくとも仮ピクチャタイプ決定部１０３により決定された仮ピクチャタイプに従って、符号化対象の複数の入力画像１０１それぞれに適用する符号化構造を決定する。符号化構造決定部１０４は、符号化構造情報１０５と仮ピクチャタイプ決定部１０３により決定された仮ピクチャタイプとを用いて、上記のフレーム画像群を単位として同一の符号化構造となるように複数の入力画像１０１それぞれの符号化構造を決定する。ここで、符号化構造情報１０５とは、符号化対象画像すなわち符号化対象の複数の入力画像１０１それぞれを、フレーム符号化及びフィールド符号化の何れの符号化構造で符号化するのかを示された情報である。 The coding structure determination unit 104 determines a coding structure to be applied to each of the plurality of input images 101 to be encoded according to at least the temporary picture type determined by the temporary picture type determination unit 103. The coding structure determination unit 104 uses a plurality of coding structure information 105 and the temporary picture type determined by the temporary picture type determination unit 103 so as to have the same coding structure in units of the frame image group. The encoding structure of each input image 101 is determined. Here, the coding structure information 105 indicates whether to encode each of a plurality of input images 101 to be encoded, that is, a plurality of input images 101 to be encoded, using frame encoding or field encoding. Information.
　ピクチャタイプ設定部１０６は、符号化対象のピクチャ内に含まれる画素データのみを利用して符号化する第１ピクチャタイプ、符号化順で前方に位置する画像に含まれる画素データを利用して符号化する第２ピクチャタイプおよび符号化順で双方向に位置する画像に含まれる画素データを利用して符号化する第３ピクチャタイプのうちいずれかのピクチャタイプを、前記画像のピクチャタイプとして設定する。例えば第３ピクチャタイプは、Ｂピクチャタイプなどに相当する。具体的には、ピクチャタイプ設定部１０６は、符号化構造設定部１０２より設定された仮ピクチャタイプと符号化構造とに従って、符号化対象の複数の入力画像１０１それぞれのピクチャタイプを設定（決定）する。 The picture type setting unit 106 encodes using a first picture type that is encoded using only pixel data included in a picture to be encoded, and pixel data included in an image positioned forward in the encoding order. The picture type of any one of the second picture type to be encoded and the third picture type to be encoded using the pixel data included in the image bidirectionally positioned in the encoding order is set as the picture type of the image . For example, the third picture type corresponds to a B picture type. Specifically, the picture type setting unit 106 sets (determines) the picture type of each of the plurality of input images 101 to be encoded according to the temporary picture type and the encoding structure set by the encoding structure setting unit 102. To do.
　例えば、ピクチャタイプ設定部１０６は、符号化構造設定部１０２より決定された符号化対象の入力画像１０１の符号化構造がフレーム符号化である場合、その符号化対象の入力画像１０１に対して仮ピクチャタイプ決定部１０３により仮決定された仮ピクチャタイプをピクチャタイプとして設定する。 For example, when the coding structure of the input image 101 to be coded determined by the coding structure setting unit 102 is frame coding, the picture type setting unit 106 temporarily sets the input image 101 to be coded. The provisional picture type provisionally determined by the picture type determination unit 103 is set as the picture type.
　一方、ピクチャタイプ設定部１０６は、符号化構造設定部１０２より決定された符号化対象の入力画像１０１の符号化構造がフィールド符号化である場合、その符号化対象の入力画像１０１に対して仮ピクチャタイプ決定部１０３により仮決定された仮ピクチャタイプがＰフレームまたはＢフレームであるなら、その仮ピクチャタイプと同じピクチャタイプをそのフレーム画像を構成するフィールドのピクチャタイプとして設定する。 On the other hand, when the coding structure of the input image 101 to be coded determined by the coding structure setting unit 102 is field coding, the picture type setting unit 106 temporarily sets the input image 101 to be coded. If the provisional picture type provisionally determined by the picture type determination unit 103 is P frame or B frame, the same picture type as the provisional picture type is set as the picture type of the field constituting the frame image.
　また、ピクチャタイプ設定部１０６は、符号化構造設定部１０２より決定された符号化対象の入力画像１０１の符号化構造がフィールド符号化であり、かつ、その符号化対象の入力画像１０１に対して仮ピクチャタイプ決定部１０３により仮決定された仮ピクチャタイプがＩフレームである場合、そのフレーム画像を構成するフィールドのトップフィールドをＩピクチャに、ボトムフィールドをＩピクチャまたはＰピクチャに設定する。なお、ボトムフィールドをＩピクチャまたはＰピクチャに設定するのは、上記の符号化条件に依存する。 Also, the picture type setting unit 106 has the encoding structure of the input image 101 to be encoded determined by the encoding structure setting unit 102 as field encoding, and applies to the input image 101 to be encoded. When the provisional picture type provisionally determined by the provisional picture type determination unit 103 is an I frame, the top field of the field constituting the frame image is set to an I picture, and the bottom field is set to an I picture or a P picture. Note that setting the bottom field to an I picture or a P picture depends on the above encoding condition.
　符号化部１０７は、符号化構造設定部１０２で設定された方式およびピクチャタイプ設定部１０６で設定されたピクチャタイプに基づいて画像を符号化し、符号化ストリームを生成する。具体的には、符号化部１０７は、符号化構造設定部１０２で設定された符号化構造と、ピクチャタイプ設定部１０６で設定されたピクチャタイプとに従って、符号化対象の複数の入力画像１０１それぞれを符号化し、符号化ストリーム１０８を出力する。 The encoding unit 107 encodes an image based on the scheme set by the encoding structure setting unit 102 and the picture type set by the picture type setting unit 106, and generates an encoded stream. Specifically, the encoding unit 107 includes a plurality of input images 101 to be encoded according to the encoding structure set by the encoding structure setting unit 102 and the picture type set by the picture type setting unit 106, respectively. Are encoded and an encoded stream 108 is output.
　そして、符号化部１０７が生成する符号化ストリームは、第１ピクチャタイプまたは第２ピクチャタイプが設定された画像から、少なくとも符号化順で次以降の第１ピクチャタイプまたは第２ピクチャタイプが設定された画像の１つ前の画像までが同一の符号化構造の方式である。 The encoded stream generated by the encoding unit 107 is set with at least the first and second picture types in the encoding order from the image in which the first picture type or the second picture type is set. The system with the same coding structure is used up to the previous image.
　以上のように、動画像符号化装置１００は構成される。 As described above, the moving image encoding apparatus 100 is configured.
　次に、図を用いて、フィールド符号化に切り替える方法について説明する。図３は、符号化構造を切り替えるタイミングの一例を示す図である。 Next, a method for switching to field encoding will be described with reference to the drawings. FIG. 3 is a diagram illustrating an example of timing for switching the coding structure.
　図３を用いて、例えば、符号化順に並べ替えた場合における入力画像のＰ５フレームでフィールド符号化に切り替える場合を説明する。 A case will be described with reference to FIG. 3 where, for example, switching to field coding is performed in the P5 frame of the input image when rearranged in the coding order.
　まず、複数の入力画像１０１が符号化部１０７に入力される。 First, a plurality of input images 101 are input to the encoding unit 107.
　次に、仮ピクチャタイプ決定部１０３は、図３（ａ）に示すように、複数の入力画像１０１に対して入力順（表示順）に、番号と仮ピクチャタイプとを割り振る。例えば、図３（ａ）に示されるように入力され最初の画像とその次の画像がＢピクチャのフレーム画像であったので、Ｂ０及びＢ１というように、番号と仮ピクチャタイプとを割り振っている。このようにして、入力された入力画像１０１の最初から９番目までの画像は、Ｂ０、Ｂ１、Ｉ２、Ｂ３、Ｂ４、Ｐ５、Ｂ６、Ｂ７及びＰ８というように番号と仮ピクチャタイプとが割り振られている。 Next, as shown in FIG. 3A, the provisional picture type determination unit 103 assigns numbers and provisional picture types to the plurality of input images 101 in the input order (display order). For example, as shown in FIG. 3A, since the first image and the next image that are input are B-picture frame images, numbers and provisional picture types are assigned as B0 and B1. . In this way, the first to ninth images of the input image 101 that have been input are assigned numbers and provisional picture types such as B0, B1, I2, B3, B4, P5, B6, B7, and P8. ing.
　そして、符号化構造決定部１０４には、Ｐ５フレームを符号化する際に適用される符号化構造がフィールド符号化である旨を示す符号化構造情報１０５が入力されている。 The coding structure determination unit 104 receives coding structure information 105 indicating that the coding structure applied when coding the P5 frame is field coding.
　図３（ｂ）は、図３（ａ）に示す複数の入力画像１０１を符号化順に並べ替えた図である。図３（ｂ）に示すように、Ｐ５フレームをｃｏｌＰｉｃとする画像はＢ３フレーム及びＢ４フレームである。 FIG. 3B is a diagram in which a plurality of input images 101 shown in FIG. As shown in FIG. 3B, images with P5 frame as colPic are B3 frame and B4 frame.
　ここで、Ｐ５フレームを符号化する際に適用される符号化構造がフィールド符号化で、Ｂ３フレームとＢ４フレームとを符号化する際に適用される符号化構造がフレーム符号化であるとする。なお、この場合、各ピクチャの各ＭＢで必要なｃｏｌＰｉｃ情報は、従来の技術なら前述の通りの複雑な処理を必要としていた。 Here, it is assumed that the encoding structure applied when encoding the P5 frame is field encoding, and the encoding structure applied when encoding the B3 frame and the B4 frame is frame encoding. In this case, the colPic information necessary for each MB of each picture requires complicated processing as described above in the conventional technique.
　それに対して、符号化構造決定部１０４は、図３（ｃ）に示すように、Ｐ５フレームだけでなく、Ｂ３フレーム及びＢ４フレームもフィールド符号化に切り替える。 On the other hand, as shown in FIG. 3C, the coding structure determination unit 104 switches not only the P5 frame but also the B3 frame and the B4 frame to field coding.
　このようにして、符号化構造決定部１０４は、符号化構造情報１０５と仮ピクチャタイプ決定部１０３により決定された仮ピクチャタイプとを用いて、複数の入力画像１０１それぞれの符号化構造を決定する。 In this way, the coding structure determination unit 104 determines the coding structure of each of the plurality of input images 101 using the coding structure information 105 and the temporary picture type determined by the temporary picture type determination unit 103. .
　具体的には、符号化構造決定部１０４は、同一の符号化構造を適用する旨が示されている符号化対象の複数の入力画像１０１における先頭フレーム画像と終端フレーム画像とを表示順で決定した上で、その先頭フレーム画像または前記先頭フレーム画像より符号化順で前に符号化される符号化対象の複数の入力画像１０１のフレーム画像のうち仮ピクチャタイプ決定部１０３により決定された仮ピクチャタイプがＩピクチャまたはＰピクチャであるフレーム画像から、終端フレームまたは前記終端フレームより符号化順で後に符号化される符号化対象の複数の入力画像１０１のフレーム画像のフレーム画像のうち仮ピクチャタイプ決定部１０３により決定された仮ピクチャタイプがＩピクチャもしくはＰピクチャであるフレーム画像の直前のフレーム画像までを、フレーム画像群として同一の符号化構造になるように符号化構造を決定する。 Specifically, the coding structure determination unit 104 determines the first frame image and the last frame image in the plurality of input images 101 to be encoded, which are indicated to apply the same coding structure, in display order. After that, the temporary picture determined by the temporary picture type determination unit 103 among the frame images of the input image 101 to be encoded that is encoded before the first frame image or the first frame image in the encoding order. Temporary picture type determination among frame images of a frame image of a plurality of input images 101 to be encoded that is encoded from a frame image whose type is an I picture or a P picture in an encoding order after the end frame or the end frame Immediately before the frame image whose temporary picture type determined by the section 103 is an I picture or a P picture Up to frame images, determines the coding structure to be the same coding structure as a frame image group.
　それにより、符号化部１０７は、符号化構造設定部１０２で設定された符号化構造と、ピクチャタイプ設定部１０６で設定されたピクチャタイプとに従って符号化情報の補正処理や参照画像へのアクセスを複雑にすることなく符号化構造を適応的に切り替えて符号化対象の複数の入力画像１０１それぞれを符号化することができる。 As a result, the encoding unit 107 performs encoding information correction processing and access to the reference image according to the encoding structure set by the encoding structure setting unit 102 and the picture type set by the picture type setting unit 106. Each of the plurality of input images 101 to be encoded can be encoded by adaptively switching the encoding structure without complication.
　以上のように、実施の形態１によれば、符号化情報の補正処理や参照画像へのアクセスを複雑にすることなく符号化構造を適応的に切り替えることが可能な動画像符号化装置を実現することができる。 As described above, according to the first embodiment, a moving picture coding apparatus capable of adaptively switching coding structures without complicating coding information correction processing and access to a reference image is realized. can do.
　つまり、実施の形態１の動画像符号化装置では、例えば、符号化順でＩピクチャもしくはＰピクチャから符号化構造を切替える。それにより、Ｃｕｒｒｅｎｔ　ＢとＣｏｌＰｉｃの符号化構造が同じ場合、ｃｏｌＰｉｃ情報の補正を行う必要が無くなるため、処理が単純になるという効果を奏する。 That is, in the moving picture coding apparatus according to Embodiment 1, for example, the coding structure is switched from an I picture or a P picture in the coding order. As a result, when the encoding structures of Current B and ColPic are the same, there is no need to correct the colPic information, and the process is simplified.
　また、実施の形態１の動画像符号化装置では、符号化順でＰピクチャから符号化構造を切替えることにより、ＢピクチャとＣｏｌＰｉｃに相当するＰピクチャの符号化構造を一致させることができるので、処理が単純となるという効果を奏する。 In the moving picture coding apparatus according to the first embodiment, the coding structure of the B picture and the P picture corresponding to ColPic can be matched by switching the coding structure from the P picture in the coding order. There is an effect that the processing becomes simple.
　なお、上記では、符号化する際に適用される符号化構造が１フレームだけ変わる旨を示す符号化構造情報１０５が入力されている場合を例として説明しているが、それに限らない。複数フレームに渡って符号化構造を変える旨を示す符号化構造情報１０５が入力されている場合も同様である。その場合、符号化構造決定部１０４は、符号化構造情報１０５と仮ピクチャタイプ決定部１０３により決定された仮ピクチャタイプとを用いて、符号化順でＰフレーム（ピクチャ）からＰフレーム（ピクチャ）の直前のＢフレーム（ピクチャ）までを同じ符号化構造に決定すればよい。 In the above description, the case where the coding structure information 105 indicating that the coding structure applied when coding is changed by one frame is input is described as an example, but the present invention is not limited thereto. The same applies to the case where the coding structure information 105 indicating that the coding structure is changed over a plurality of frames is input. In that case, the coding structure determination unit 104 uses the coding structure information 105 and the temporary picture type determined by the temporary picture type determination unit 103 to perform P frame (picture) to P frame (picture) in the coding order. What is necessary is just to determine to the B frame (picture) immediately before of the same encoding structure.
　（実施の形態２）
　実施の形態１では、符号化構造決定部１０４において、符号化順でＰフレーム（ピクチャ）からＰフレーム（ピクチャ）の直前のＢフレーム（ピクチャ）までを同じ符号化構造にするという切り替え方法について説明したがそれに限らない。実施の形態２では、実施の形態１で説明した構成を用いて上記切り替え方法とは別の切り替え方法について説明する。前提条件は、実施の形態１と同じものとする。 (Embodiment 2)
The first embodiment describes a switching method in which the coding structure determination unit 104 uses the same coding structure from the P frame (picture) to the B frame (picture) immediately before the P frame (picture) in the coding order. However, it is not limited to that. In the second embodiment, a switching method different from the above switching method will be described using the configuration described in the first embodiment. The precondition is the same as in the first embodiment.
　符号化構造決定部１０４は、符号化構造情報１０５と仮ピクチャタイプ決定部１０３により決定された仮ピクチャタイプとを用いて、符号化順でＰ（Ｉ）ＢＢフレーム（ピクチャ）を一つの単位として符号化構造を切り替える。例えば、符号化構造決定部１０４は、図３（ｂ）で示すように符号化順でＰ５、Ｂ３及びＢ４の３フレームを一つの単位として符号化構造を切り替えるとしてよい。 The coding structure determining unit 104 uses the coding structure information 105 and the temporary picture type determined by the temporary picture type determining unit 103 as a unit of P (I) BB frames (pictures) in the coding order. Switch coding structure. For example, the coding structure determination unit 104 may switch the coding structure with three frames P5, B3, and B4 as one unit in the coding order as shown in FIG. 3B.
　ここで、符号化部１０７は、符号化処理を行う際までに、入力された複数の入力画像１０１を入力順から符号化順へとリオーダーを行うため、符号化部１０７は、Ｐ５フレームを符号化する前にＢ３フレーム及びＢ４フレームで符号化構造を切り替える必要があるかを判定可能となる。例えば、Ｂ４フレームをフィールド符号化に切り替える場合、Ｂ４フレームを含むＰＢＢフレーム（ピクチャ）であるＰ５フレーム、Ｂ３フレーム、Ｂ４フレームの３フレームをフィールド符号化に切り替える旨を示す符号化構造が符号化構造設定部１０２で設定される。そして、符号化部１０７は、符号化構造設定部１０２で設定された符号化構造と、ピクチャタイプ設定部１０６で設定されたピクチャタイプとに従って符号化情報の補正処理や参照画像へのアクセスを複雑にすることなく符号化構造を適応的に切り替えて符号化対象の複数の入力画像１０１それぞれを符号化することができる。 Here, the encoding unit 107 reorders the plurality of input images 101 input from the input order to the encoding order until the encoding process is performed. It is possible to determine whether it is necessary to switch the coding structure between the B3 frame and the B4 frame before encoding. For example, when the B4 frame is switched to the field encoding, the encoding structure indicating that the PBB frame including the B4 frame (picture) P5 frame, B3 frame, and B4 frame is switched to the field encoding is the encoding structure. Set by the setting unit 102. The encoding unit 107 complicates encoding information correction processing and access to the reference image according to the encoding structure set by the encoding structure setting unit 102 and the picture type set by the picture type setting unit 106. The encoding structure can be adaptively switched without encoding, and each of the plurality of input images 101 to be encoded can be encoded.
　このようにして、符号化構造決定部１０４は、符号化対象の複数の入力画像１０１であって、仮ピクチャタイプ決定部１０３により決定された仮ピクチャタイプがＩピクチャもしくはＰピクチャを含むフレーム画像と、そのＩピクチャもしくはＰピクチャを含むフレーム画像から符号化順で次のＩピクチャもしくはＰピクチャを含むフレーム画像までに符号化される全てのＢピクチャを含むフレーム画像とを単位とする複数のフレーム画像を、フレーム画像群として、符号化構造を決定する。 In this way, the coding structure determination unit 104 includes a plurality of input images 101 to be encoded, and a frame image in which the temporary picture type determined by the temporary picture type determination unit 103 includes an I picture or a P picture. A plurality of frame images in units of frame images including all B pictures encoded from the frame image including the I picture or P picture to the frame image including the next I picture or P picture in the encoding order. Is determined as a frame image group.
　以上のように、実施の形態２によれば、符号化情報の補正処理や参照画像へのアクセスを複雑にすることなく符号化構造を適応的に切り替えることが可能な動画像符号化装置を実現することができる。 As described above, according to the second embodiment, a moving picture coding apparatus capable of adaptively switching coding structures without complicating coding information correction processing and access to reference images is realized. can do.
　なお、上記では、１つのＰＢＢフレーム（ピクチャ）単位で切り替える場合の方法について説明したが、それに限らない。符号化する際に適用される符号化構造が複数のフレームに渡り、１つのＰＢＢフレーム（ピクチャ）単位を超える場合でもよい。例えば、図３（ａ）の表示順でＢ４フレームからＢ６フレームまでをフィールド符号化とする場合、符号化順でＰ５、Ｂ３、Ｂ４フレームに加えて、Ｐ８、Ｂ６、Ｂ７フレームもフィールド符号化に切り替えるようにすればよい。 In the above description, the method for switching in units of one PBB frame (picture) has been described, but the method is not limited thereto. The encoding structure applied when encoding may extend over a plurality of frames and exceed one PBB frame (picture) unit. For example, when field encoding is performed from the B4 frame to the B6 frame in the display order of FIG. 3A, in addition to the P5, B3, and B4 frames in the encoding order, the P8, B6, and B7 frames are also used for field encoding. What is necessary is just to switch.
　または、ＭＰＥＧ２で言うＧＯＰ単位に相当する符号化順でＩフレーム（ピクチャ）から次のＩフレーム（ピクチャ）の一つ前のフレーム画像（ピクチャ）までを一つの単位として符号化構造を切り替えるとしてもよい。 Alternatively, the coding structure may be switched using one frame from the I frame (picture) to the frame image (picture) immediately before the next I frame (picture) in the coding order corresponding to the GOP unit in MPEG2. Good.
　（実施の形態３）
　実施の形態３では、実施の形態１で説明した構成を用いて上記の切り替え方法とは別の切り替え方法について説明する。前提条件も実施の形態１と同じものとする。 (Embodiment 3)
In the third embodiment, a switching method different from the above switching method will be described using the configuration described in the first embodiment. The preconditions are also the same as those in the first embodiment.
　以下、図を用いて、本実施の形態の切り替え方法について具体的に説明する。 Hereinafter, the switching method of the present embodiment will be specifically described with reference to the drawings.
　図４は、符号化構造を切り替えるタイミングの一例を示す図である。なお、図４（ａ）及び図４（ｂ）は、図３（ａ）及び図３（ｂ）と同図であるため詳細な説明は省略する。 FIG. 4 is a diagram illustrating an example of timing for switching the coding structure. 4 (a) and 4 (b) are the same as FIGS. 3 (a) and 3 (b), and detailed description thereof is omitted.
　図４（ａ）において、表示順でＢ４フレームまでをフレーム符号化で、Ｐ５フレーム以降をフィールド符号化で符号化する場合を例に挙げて説明する。 In FIG. 4 (a), description will be made by taking as an example a case where up to B4 frame is encoded by frame encoding in the display order, and P5 and subsequent frames are encoded by field encoding.
　ここで、符号化構造決定部１０４には、符号化する際に適用される符号化構造が表示順でＢ４フレームまでをフレーム符号化とし、Ｐ５フレーム以降をフィールド符号化とする旨を示す符号化構造情報１０５が入力されている。 Here, the coding structure determining unit 104 performs coding indicating that the coding structure applied at the time of coding is frame coding up to the B4 frame in the display order, and field coding after the P5 frame. Structure information 105 is input.
　それを、このまま符号化すると、すなわち、ピクチャタイプ設定部１０６符号化構造決定部１０４に入力される符号化構造情報１０５と、仮ピクチャタイプ決定部１０３により決定された仮ピクチャタイプとにそのまま従って符号化すると、Ｂ３、Ｂ４フレームのｃｏｌＰｉｃ情報生成に複雑な処理が必要となる。 If it is encoded as it is, that is, the coding structure information 105 input to the picture type setting unit 106 coding structure determining unit 104 and the temporary picture type determined by the temporary picture type determining unit 103 are directly encoded. In this case, complicated processing is required to generate colPic information for B3 and B4 frames.
　そこで、本実施の形態において、ピクチャタイプ設定部１０６は、図４（ｃ）に示すように表示順で符号化構造を切り替える画像（Ｐ５フレーム）の直前にあるＢ４フレームのピクチャタイプをＰピクチャ（すなわちＰフレーム）に変更する。このようにして、Ｂ３フレームのｃｏｌＰｉｃがＰ４フレームとなり、同じ符号化構造になるため、ｃｏｌＰｉｃ情報の生成が簡単になる。 Therefore, in the present embodiment, the picture type setting unit 106 changes the picture type of the B4 frame immediately before the image (P5 frame) whose coding structure is switched in the display order as shown in FIG. That is, it is changed to P frame). In this way, the colPic of the B3 frame becomes the P4 frame and has the same coding structure, so the generation of colPic information is simplified.
　このように、符号化構造設定部１０２より設定された仮ピクチャタイプと符号化構造とに従って、ｃｏｌＰｉｃ情報の生成が簡単になるになるように、符号化対象の複数の入力画像１０１それぞれのピクチャタイプが設定（決定）される。 As described above, according to the temporary picture type and the coding structure set by the coding structure setting unit 102, the picture types of the plurality of input images 101 to be coded are simplified so that the colPic information can be easily generated. Is set (determined).
　符号化構造決定部１０４は、適用する符号化構造を切り替える旨が示されている符号化対象の複数の入力画像１０１におけるフレーム画像であって表示順で直前のフレーム画像の仮ピクチャタイプをＰピクチャに変更するとして、その直前のフレーム画像をフレーム画像群の一の先頭のフレーム画像に切り替え、切り替えられたフレーム画像群の一を同一の符号化構造になるように符号化構造を決定する。そして、ピクチャタイプ設定部１０６は、仮ピクチャタイプ決定部１０３により決定された仮ピクチャタイプと、符号化構造決定部１０４により決定された符号化構造とに従って、上記直前のフレーム画像のピクチャタイプをＰピクチャに変更し、上記直前のフレーム画像以外の仮ピクチャタイプを、ピクチャタイプとすることにより、符号化対象の複数の入力画像１０１それぞれに適用するピクチャタイプを設定する。 The encoding structure determination unit 104 sets the provisional picture type of the immediately preceding frame image in the display order as the P picture, which is a frame image in the plurality of input images 101 to be encoded, which is indicated to switch the encoding structure to be applied. In this case, the immediately preceding frame image is switched to the first frame image of the frame image group, and the coding structure is determined so that one of the switched frame image groups has the same coding structure. Then, the picture type setting unit 106 sets the picture type of the immediately preceding frame image to P according to the temporary picture type determined by the temporary picture type determination unit 103 and the coding structure determined by the coding structure determination unit 104. A picture type to be applied to each of a plurality of input images 101 to be encoded is set by changing to a picture and setting a temporary picture type other than the immediately preceding frame image as a picture type.
　以上のように、実施の形態３によれば、符号化情報の補正処理や参照画像へのアクセスを複雑にすることなく符号化構造を適応的に切り替えることが可能な動画像符号化装置を実現することができる。 As described above, according to the third embodiment, a moving picture coding apparatus capable of adaptively switching coding structures without complicating coding information correction processing and access to a reference image is realized. can do.
　（実施の形態４）
　図５は、本実施の形態４に係る動画像符号化装置の構成を示すブロック図である。図５に示す動画像符号化装置２００は、時間順に連続する複数の入力画像１０１を符号化して符号化ストリーム１０８を出力し、符号化構造設定部４０１と、ピクチャタイプ設定部１０６と、符号化部１０７とを備える。なお、図１と同様の要素には同一の符号を付しており、詳細な説明は省略する。 (Embodiment 4)
FIG. 5 is a block diagram showing a configuration of the moving picture coding apparatus according to the fourth embodiment. 5 encodes a plurality of input images 101 that are continuous in time order and outputs an encoded stream 108. The encoding structure setting unit 401, the picture type setting unit 106, and the encoding Unit 107. Elements similar to those in FIG. 1 are denoted by the same reference numerals, and detailed description thereof is omitted.
　図５に示す動画像符号化装置２００は、実施の形態１に係る動画像符号化装置１００に対して、符号化構造設定部４０１の構成が異なる。このように、図５の構成は実施の形態１の図１とほぼ同じなので、以下では異なる部分を中心に説明する。 5 is different from the video encoding device 100 according to Embodiment 1 in the configuration of the encoding structure setting unit 401. The video encoding device 200 illustrated in FIG. As described above, the configuration of FIG. 5 is substantially the same as that of FIG. 1 of the first embodiment, and therefore, different parts will be mainly described below.
　符号化構造設定部４０１は、仮ピクチャタイプ決定部１０３と情報抽出部４０２と符号化構造決定部４０３とを備え、入力画像１０１の情報を用いて画像の動きを検出し、その動き量と仮ピクチャタイプ決定部１０３で仮決定された仮ピクチャタイプとから入力画像１０１を符号化する際の符号化構造を決定（設定）する。 The coding structure setting unit 401 includes a temporary picture type determination unit 103, an information extraction unit 402, and a coding structure determination unit 403. The coding structure setting unit 401 detects the motion of an image using information of the input image 101, and determines the motion amount and the temporary motion. An encoding structure for encoding the input image 101 is determined (set) from the temporary picture type temporarily determined by the picture type determination unit 103.
　情報抽出部４０２は、入力画像１０１の動きを検出する。例えば、代表的なものとしてライン間差分の絶対値和がある。これは、フレーム画像を構成するトップフィールドとボトムフィールドとの画面間差分絶対値和と同じであり、入力画像に動きがない場合、小さな値となる。 The information extraction unit 402 detects the movement of the input image 101. For example, there is a sum of absolute values of differences between lines as a representative example. This is the same as the sum of absolute differences between the screens of the top field and the bottom field constituting the frame image, and becomes a small value when there is no motion in the input image.
　符号化構造決定部４０３は、上記の絶対値和と閾値とを比較し、フィールド間に動きがあるか否かを判定する。そして、符号化構造決定部４０３は、動き判定結果と仮ピクチャタイプとから各画像（複数の入力画像１０１それぞれ）を符号化するときの符号化構造を決定する。なお、このときの切り替え方法は、実施の形態１から３に記載した内容と同様である。すなわち、符号化構造を切り替えるフレーム画像(ピクチャ)を含めて、符号化順でＰフレーム(ピクチャ)からＰフレーム(ピクチャ)の直前のＢフレーム(ピクチャ)までを同じ符号化構造にする。または、ＰＢＢフレーム(ピクチャ)単位で符号化構造を切り替えてもよいし、ＧＯＰ単位で切り替えるとしてもよい。 The coding structure determination unit 403 compares the above sum of absolute values with a threshold value, and determines whether there is motion between fields. Then, the coding structure determination unit 403 determines a coding structure for coding each image (each of the plurality of input images 101) from the motion determination result and the temporary picture type. Note that the switching method at this time is the same as that described in the first to third embodiments. That is, including the frame image (picture) for switching the coding structure, the same coding structure is used from the P frame (picture) to the B frame (picture) immediately before the P frame (picture) in the coding order. Alternatively, the coding structure may be switched in units of PBB frames (pictures) or may be switched in units of GOPs.
　このようにして、符号化構造決定部４０３は、情報抽出部４０２に検出された入力画像１０１の動き量と仮ピクチャタイプ決定部１０３により決定された仮ピクチャタイプとを用いて、各画像（複数の入力画像１０１それぞれ）の符号化構造を決定する。それにより、符号化部１０７は、符号化情報の補正処理や参照画像へのアクセスを複雑にすることなく符号化構造を適応的に切り替えて符号化対象の複数の入力画像１０１それぞれを符号化することができる。 In this way, the coding structure determination unit 403 uses the amount of motion of the input image 101 detected by the information extraction unit 402 and the provisional picture type determined by the provisional picture type determination unit 103 to generate each image (multiple images). The input image 101) is determined. Accordingly, the encoding unit 107 encodes each of the plurality of input images 101 to be encoded by adaptively switching the encoding structure without complicating encoding information correction processing and access to the reference image. be able to.
　以上のように、実施の形態４によれば、符号化情報の補正処理や参照画像へのアクセスを複雑にすることなく符号化構造を適応的に切り替えることが可能な動画像符号化装置を実現することができる。 As described above, according to the fourth embodiment, a moving picture coding apparatus capable of adaptively switching coding structures without complicating coding information correction processing and access to a reference image is realized. can do.
　なお、上記において、情報抽出部４０２が検出する動きの情報としてライン間差分を例に挙げたが、画面全体の画素または縮小した画像を用いて動き検出を行い、その結果を動き量としてもよい。また、入力画像１０１の時間的に一つ前のフレーム画像との差分から動き量を求めるとしてもよい。 In the above description, the inter-line difference is exemplified as the motion information detected by the information extraction unit 402. However, motion detection may be performed using pixels on the entire screen or a reduced image, and the result may be used as the motion amount. . Alternatively, the amount of motion may be obtained from the difference between the input image 101 and the previous frame image in time.
　（実施の形態５）
　図６は、本実施の形態５に係る動画像符号化装置の構成を示すブロック図である。図６に示す動画像符号化装置３００は、時間順に連続する複数の入力画像１０１を符号化して符号化ストリーム１０８を出力し、符号化構造設定部５０１と、ピクチャタイプ設定部１０６と、符号化部１０７とを備える。 (Embodiment 5)
FIG. 6 is a block diagram showing a configuration of the moving picture coding apparatus according to the fifth embodiment. 6 encodes a plurality of input images 101 that are continuous in time order and outputs an encoded stream 108, and includes an encoding structure setting unit 501, a picture type setting unit 106, and an encoding Unit 107.
　図６に示す動画像符号化装置３００は、実施の形態１に係る動画像符号化装置１００に対して、符号化構造設定部５０１の構成が異なる。このように、図６の構成は実施の形態１の図１とほぼ同じなので、以下では異なる部分を中心に説明する。 6 is different from the video encoding device 100 according to Embodiment 1 in the configuration of the encoding structure setting unit 501. The video encoding device 300 illustrated in FIG. As described above, the configuration of FIG. 6 is substantially the same as that of FIG. 1 of the first embodiment, and therefore, different portions will be mainly described below.
　符号化構造設定部５０１は、仮ピクチャタイプ決定部１０３と符号化構造決定部５０２とを備え、符号化部１０７で既に符号化したピクチャの符号化結果である動きベクトル情報を用いて画像の動きを検出し、その動き量と仮ピクチャタイプ決定部１０３で仮決定された仮ピクチャタイプとから入力画像１０１を符号化する際の符号化構造を決定（設定）する。 The coding structure setting unit 501 includes a provisional picture type determination unit 103 and a coding structure determination unit 502, and uses the motion vector information that is the result of coding the picture that has already been coded by the coding unit 107 to perform image motion. And a coding structure for coding the input image 101 is determined (set) from the amount of motion and the temporary picture type temporarily determined by the temporary picture type determination unit 103.
　符号化構造決定部５０２は、上記の符号化済みの動きベクトル情報を用いて動きを判定する。例えば、全ＭＢの動きベクトルの平均、分散、最大値と最小値またはベクトルの大きさのダイナミックレンジ等の情報を過去数ピクチャ分について統計処理を行い、その統計処理結果の値と閾値との比較を行い、動きがあるか否かを判定する。そして、符号化構造決定部５０２は、動き判定結果と仮決定された仮ピクチャタイプとから各画像（複数の入力画像１０１それぞれ）を符号化するときの符号化構造を決定する。なお、このときの切り替え方法は、実施の形態１から３に記載した内容と同様である。すなわち、符号化構造を切り替えるフレーム画像(ピクチャ)を含めて、符号化順でＰフレーム（ピクチャ）からＰフレーム（ピクチャ）の直前のＢフレーム（ピクチャ）までを同じ符号化構造にする。または、ＰＢＢフレーム（ピクチャ）単位で符号化構造を切り替えてもよいし、ＧＯＰ単位で切り替える等の方法としてもよい。 The encoding structure determination unit 502 determines a motion using the encoded motion vector information. For example, statistical processing is performed on the past several pictures of information such as the average, variance, maximum and minimum values of the motion vectors of all MBs, or the dynamic range of the vector size, and the value of the statistical processing result is compared with the threshold To determine whether there is movement. Then, the coding structure determining unit 502 determines a coding structure for encoding each image (each of the plurality of input images 101) from the motion determination result and the temporarily determined temporary picture type. Note that the switching method at this time is the same as that described in the first to third embodiments. That is, including the frame image (picture) for switching the coding structure, the same coding structure is used from the P frame (picture) to the B frame (picture) immediately before the P frame (picture) in the coding order. Alternatively, the coding structure may be switched in units of PBB frames (pictures), or may be switched in units of GOPs.
　このようにして、符号化構造決定部５０２は、符号化部１０７からの動きベクトル情報を用いて判定した入力画像１０１の動き量と仮ピクチャタイプ決定部１０３により決定された仮ピクチャタイプとに基づき、各画像（複数の入力画像１０１それぞれ）の符号化構造を決定する。それにより、符号化部１０７は、符号化情報の補正処理や参照画像へのアクセスを複雑にすることなく符号化構造を適応的に切り替えて符号化対象の複数の入力画像１０１それぞれを符号化することができる。 In this way, the coding structure determining unit 502 is based on the amount of motion of the input image 101 determined using the motion vector information from the encoding unit 107 and the temporary picture type determined by the temporary picture type determining unit 103. The coding structure of each image (each of the plurality of input images 101) is determined. Accordingly, the encoding unit 107 encodes each of the plurality of input images 101 to be encoded by adaptively switching the encoding structure without complicating encoding information correction processing and access to the reference image. be able to.
　以上のように、実施の形態５によれば、符号化情報の補正処理や参照画像へのアクセスを複雑にすることなく符号化構造を適応的に切り替えることが可能な動画像符号化装置を実現することができる。 As described above, according to the fifth embodiment, a moving picture coding apparatus capable of adaptively switching coding structures without complicating coding information correction processing and access to reference images is realized. can do.
　以上、本発明の動画像符号化装置及び動画像符号化方法について、実施の形態に基づいて説明したが、本発明は、この実施の形態に限定されるものではない。本発明の趣旨を逸脱しない限り、当業者が思いつく各種変形を本実施の形態に施したものや、異なる実施の形態における構成要素を組み合わせて構築される形態も、本発明の範囲内に含まれる。 As mentioned above, although the moving image encoding device and the moving image encoding method of the present invention have been described based on the embodiment, the present invention is not limited to this embodiment. Unless it deviates from the meaning of this invention, the form which carried out the various deformation | transformation which those skilled in the art can think to this embodiment, and the structure constructed | assembled combining the component in different embodiment is also contained in the scope of the present invention. .
　例えば、本発明の範囲は、上述したＨ．２６４規格に基づくＰｉｃＡＦＦやＭＢＡＦＦを適用して符号化する場合に限られない。インタレース画像を符号化する際に、インタレース画像を構成する２つのフィールドをまとめて１つのフレーム画像（ピクチャ）として扱うフレーム符号化と、インタレース画像を構成する２つのフィールドを独立（個別）に２つのピクチャとして扱うフィールド符号化とをフレーム画像毎に切り替えて符号化する場合であるなら本発明の範囲に含まれる。 For example, the scope of the present invention is the above-described H.264. The present invention is not limited to encoding using PicAFF or MBAFF based on the H.264 standard. When encoding an interlaced image, frame coding that treats two fields constituting the interlaced image as one frame image (picture) and two fields constituting the interlaced image are independent (individually) If it is a case where the field coding treated as two pictures is switched and coded for each frame image, it is included in the scope of the present invention.
　また、上記では、自ピクチャ内の画素データのみを利用して符号化する第１ピクチャタイプ、符号化順で前方に位置するピクチャの画素データを利用して符号化する第２ピクチャタイプとして、図７Ａに示すようなＨ．２６４規格におけるＩピクチャタイプ（図中、Ｉ０）およびＰピクチャタイプ（図中、Ｐ３、Ｐ６）を例に挙げて説明したがそれに限らない。また、符号化順で双方向に位置するピクチャの画素データを利用して符号化する第３ピクチャタイプとして、図７Ａに示すようなＨ．２６４規格におけるＢピクチャタイプ（図中、Ｂ１、Ｂ２、Ｂ４，Ｂ５）を例に挙げて説明したがそれに限らない。 Also, in the above, as a first picture type that is encoded using only pixel data in its own picture and a second picture type that is encoded using pixel data of a picture located forward in the encoding order, FIG. H. As shown in 7A. The I picture type (I0 in the figure) and the P picture type (P3, P6 in the figure) in the H.264 standard have been described as examples, but not limited thereto. In addition, as a third picture type to be encoded using pixel data of pictures located bidirectionally in the encoding order, H.264 as shown in FIG. The B picture type (B1, B2, B4, B5 in the figure) in the H.264 standard has been described as an example, but is not limited thereto.
　例えば、図７Ｂに示すように、ＰピクチャタイプとＢピクチャタイプの区別がなく、Ｉピクチャタイプ（Ｉ０）とＢピクチャタイプ（Ｂ１～Ｂ６）しかピクチャタイプがない場合でも本発明の範囲に含まれる。なぜなら、この場合には、図７Ｂに示すＢ３のように、前方のみの参照ピクチャとの画素の相関を用いて符号化するピクチャタイプであれば、Ｂ３を本発明の第２ピクチャタイプとして扱えばよいからである。ここで、図７Ａは、Ｈ．２６４の動画像圧縮規格におけるピクチャタイプの参照関係の例を示す図であり、図７Ｂは、前方のみの参照ピクチャとの画素の相関を用いて符号化するピクチャタイプの参照関係の別の例を示す図である。 For example, as shown in FIG. 7B, even if there is no distinction between P picture type and B picture type and only I picture type (I0) and B picture types (B1 to B6) have picture types, they are included in the scope of the present invention. . This is because, in this case, if B3 is treated as the second picture type of the present invention as long as it is a picture type that is encoded using a pixel correlation with a reference picture only forward, as shown in B3 in FIG. 7B. Because it is good. Here, FIG. FIG. 7B is a diagram illustrating an example of a reference relationship of picture types in the H.264 video compression standard, and FIG. 7B is another example of a reference relationship of picture types to be encoded using a pixel correlation with a reference picture only in front. FIG.
　また、例えば図８に示す表示装置や、ビデオ、ムービーカメラ、デジタルカメラ（ＤＳＣ）、携帯電話、携帯機器、携帯タブレット等であっても、本発明の動画像符号化装置及び動画像符号化方法を備える場合には本発明の範囲に含まれる。 Further, for example, even in the display device shown in FIG. 8, a video, a movie camera, a digital camera (DSC), a cellular phone, a portable device, a portable tablet, etc., the moving image coding apparatus and the moving image coding method of the present invention are used. Is included in the scope of the present invention.
　本発明は、動画像符号化装置及び動画像符号化方法に利用でき、特に、Ｈ．２６４規格等の動画像圧縮規格に従って動画像を符号化し、放送、録画を行うことができる表示装置、ビデオ、ムービーカメラ、デジタルカメラ（ＤＳＣ）、携帯電話、携帯機器または携帯タブレット等に用いられる動画像符号化装置及び動画像符号化方法に利用することができる。 The present invention can be used for a moving picture coding apparatus and a moving picture coding method. Moving images used for display devices, videos, movie cameras, digital cameras (DSC), mobile phones, portable devices, portable tablets, etc. that can encode and broadcast and record moving images according to the H.264 standard. The present invention can be used for an image encoding device and a moving image encoding method.
　　１０１　　入力画像
　　１０２、４０１、５０１　　符号化構造設定部
　　１０３　　仮ピクチャタイプ決定部
　　１０４、４０３、５０２　　符号化構造決定部
　　１０５　　符号化構造情報
　　１０６　　ピクチャタイプ設定部
　　１０７　　符号化部
　　１０８　　符号化ストリーム
　　４０２　　情報抽出部 DESCRIPTION OF SYMBOLS 101 Input image 102,401,501 Coding structure setting part 103 Temporary picture type determination part 104,403,502 Coding structure determination part 105 Coding structure information 106 Picture type setting part 107 Coding part 108 Encoding stream 402 Information extraction Part

Claims (4)

  1. 　連続して入力される画像であって、トップフィールドおよびボトムフィールドの２つのフィールドから構成されるインタレース方式の画像を符号化し、符号化ストリームを生成する動画像符号化装置であって、
    　前記連続して入力される画像に対して、当該画像を構成する２つのフィールドをまとめて１つのピクチャとして扱い符号化する第１符号化構造の方式および当該画像を構成する２つのフィールドを独立したピクチャとして扱い符号化する第２符号化構造の方式のうちいずれかの方式を設定する符号化構造設定部と、
    　符号化対象のピクチャ内に含まれる画素データのみを利用して符号化する第１ピクチャタイプ、符号化順で前方に位置する画像に含まれる画素データを利用して符号化する第２ピクチャタイプおよび符号化順で双方向に位置する画像に含まれる画素データを利用して符号化する第３ピクチャタイプのうちいずれかのピクチャタイプを、前記画像のピクチャタイプとして設定するピクチャタイプ設定部と、
    　前記符号化構造設定部で設定された符号化構造の方式および前記ピクチャタイプ設定部で設定されたピクチャタイプに基づいて前記画像を符号化し、符号化ストリームを生成する符号化部と、を備え、
    　前記符号化部が生成する符号化ストリームは、前記第１ピクチャタイプまたは前記第２ピクチャタイプが設定された画像から、少なくとも符号化順で次以降の前記第１ピクチャタイプまたは前記第２ピクチャタイプが設定された画像の１つ前の画像までが同一の符号化構造の方式である
    　動画像符号化装置。     A moving image encoding device that continuously inputs images, encodes an interlaced image composed of two fields, a top field and a bottom field, and generates an encoded stream,
    A method of a first coding structure that encodes the consecutively input images by treating the two fields constituting the image together as one picture, and the two fields constituting the image are independent. A coding structure setting unit that sets one of the methods of the second coding structure that is treated and coded as a picture;
    A first picture type that is encoded using only pixel data included in a picture to be encoded, a second picture type that is encoded using pixel data included in an image positioned forward in the encoding order, and A picture type setting unit that sets, as a picture type of the image, any picture type of a third picture type that is encoded using pixel data included in an image that is bidirectionally positioned in the encoding order;
    An encoding unit that encodes the image based on a coding structure scheme set by the encoding structure setting unit and a picture type set by the picture type setting unit, and generates an encoded stream;
    The encoded stream generated by the encoding unit includes at least the first picture type or the second picture type subsequent to the encoding order from an image in which the first picture type or the second picture type is set. A moving picture coding apparatus in which a picture up to the previous one of a set picture has the same coding structure.
  2. 　前記符号化構造設定部は、
    　前記画像に対して前記第１符号化構造の方式を設定した場合、トップフィールドに含まれる第１符号化単位とボトムフィールドに含まれる当該第１符号化単位に対応する符号化単位をまとめて１つの符号化単位として符号化する符号化構造方式を設定する
    　請求項１に記載の動画像符号化装置。     The encoding structure setting unit includes:
    When the scheme of the first coding structure is set for the image, the first coding unit included in the top field and the coding unit corresponding to the first coding unit included in the bottom field are collectively 1 The moving picture coding apparatus according to claim 1, wherein a coding structure method for coding as one coding unit is set.
  3. 　前記連続して入力される画像に対して、前記第１ピクチャタイプ、前記第２ピクチャタイプおよび前記第３ピクチャタイプのうちいずれか１つのピクチャタイプを仮のピクチャタイプとして設定する仮ピクチャタイプ設定部をさらに備え、
    　前記符号化構造設定部は、前記設定した仮のピクチャタイプに基づいて、前記連続して入力される画像のそれぞれに対し、前記第１符号化構造の方式および前記第２符号化構造の方式のうちいずれか１つを設定し、
    　前記ピクチャタイプ設定部は、前記仮のピクチャタイプとして前記第３ピクチャタイプが設定された対象画像の表示順で次の画像から符号化構造の方式が異なる場合、当該対象画像のピクチャタイプを前記第１ピクチャタイプおよび前記第２ピクチャタイプのうちいずれかを設定する
    　請求項１または２に記載の動画像符号化装置。     A temporary picture type setting unit that sets any one of the first picture type, the second picture type, and the third picture type as a temporary picture type for the continuously input images. Further comprising
    The coding structure setting unit determines whether the first coding structure scheme and the second coding structure scheme are applied to each of the continuously input images based on the set temporary picture type. Set one of them,
    The picture type setting unit determines the picture type of the target image when the coding structure method is different from the next image in the display order of the target image in which the third picture type is set as the temporary picture type. The moving picture coding apparatus according to claim 1, wherein either one picture type or the second picture type is set.
  4. 　連続して入力される画像であって、トップフィールドおよびボトムフィールドの２つのフィールドから構成されるインタレース方式の画像を符号化し、符号化ストリームを生成する動画像符号化方法であって、
    　前記連続して入力される画像に対して、当該画像を構成する２つのフィールドをまとめて１つのピクチャとして扱い符号化する第１符号化構造の方式および当該画像を構成する２つのフィールドを独立したピクチャとして扱い符号化する第２符号化構造の方式のうちいずれかの方式を設定し、
    　符号化対象のピクチャ内に含まれる画素データのみを利用して符号化する第１ピクチャタイプ、符号化順で前方に位置する画像に含まれる画素データを利用して符号化する第２ピクチャタイプおよび符号化順で双方向に位置する画像に含まれる画素データを利用して符号化する第３ピクチャタイプのうちいずれかのピクチャタイプを、前記画像のピクチャタイプとして設定し、
    　前記設定した符号化構造の方式およびピクチャタイプに基づいて前記画像を符号化し、符号化ストリームを生成し、
    　前記生成した符号化ストリームは、前記第１ピクチャタイプまたは前記第２ピクチャタイプが設定された画像から、少なくとも符号化順で次以降の前記第１ピクチャタイプまたは前記第２ピクチャタイプが設定された画像の１つ前の画像までが同一の符号化構造の方式である
    　動画像符号化方法。     A moving image encoding method for encoding an interlaced image composed of two fields of a top field and a bottom field and generating an encoded stream, which are images that are input continuously.
    A method of a first coding structure that encodes the consecutively input images by treating the two fields constituting the image together as one picture, and the two fields constituting the image are independent. Set one of the methods of the second coding structure that is treated and coded as a picture,
    A first picture type that is encoded using only pixel data included in a picture to be encoded, a second picture type that is encoded using pixel data included in an image positioned forward in the encoding order, and One of the third picture types to be encoded using pixel data included in an image located bidirectionally in the encoding order is set as the picture type of the image,
    Encoding the image based on the set coding structure scheme and picture type, and generating an encoded stream;
    The generated encoded stream is an image in which the first picture type or the second picture type is set at least in the encoding order from an image in which the first picture type or the second picture type is set. A moving picture coding method in which the previous picture is the same coding structure.
PCT/JP2011/001344 2010-03-09 2011-03-08 Video image coding device and video image coding method WO2011111372A1 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
JP2010052369 2010-03-09
JP2010-052369 2010-03-09

Publications (1)

Publication Number Publication Date
WO2011111372A1 true WO2011111372A1 (en) 2011-09-15

Family

ID=44563205

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/JP2011/001344 WO2011111372A1 (en) 2010-03-09 2011-03-08 Video image coding device and video image coding method

Country Status (1)

Country Link
WO (1) WO2011111372A1 (en)

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2002252855A (en) * 1991-12-27 2002-09-06 Sony Corp Image data combining method and apparatus
JP2005510984A (en) * 2001-11-21 2005-04-21 ジェネラル・インストルメント・コーポレーション Picture-level adaptive frame / field coding for digital video content
JP2008028882A (en) * 2006-07-25 2008-02-07 Victor Co Of Japan Ltd Moving image encoding apparatus

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2002252855A (en) * 1991-12-27 2002-09-06 Sony Corp Image data combining method and apparatus
JP2005510984A (en) * 2001-11-21 2005-04-21 ジェネラル・インストルメント・コーポレーション Picture-level adaptive frame / field coding for digital video content
JP2008028882A (en) * 2006-07-25 2008-02-07 Victor Co Of Japan Ltd Moving image encoding apparatus

Similar Documents

Publication Publication Date Title
US12167044B2 (en) Image processing device and image processing method
JP4014263B2 (en) Video signal conversion apparatus and video signal conversion method
US7310376B2 (en) Macroblock level adaptive frame/field coding for digital video content
CN102017615B (en) Boundary artifact correction within video units
US8630347B2 (en) Video decoding apparatus and video decoding method
US20170118485A1 (en) Methods and systems for encoding pictures associated with video data
JP3778721B2 (en) Video coding method and apparatus
US8737476B2 (en) Image decoding device, image decoding method, integrated circuit, and program for performing parallel decoding of coded image data
JP2016123131A (en) Adaptive frame/field encoding at macro block level of digital video content
WO2014010224A1 (en) Video compression device, video decoding device, image compression device, image decoding device, imaging device, and program
JP4774315B2 (en) Image decoding apparatus and image decoding method
JPWO2010100672A1 (en) Compressed video encoding device, compressed video decoding device, compressed video encoding method, and compressed video decoding method
US20180249175A1 (en) Method and apparatus for motion vector predictor derivation
JP2010130351A (en) Motion compensation device
JP6021153B2 (en) Method and apparatus for decoding video images
KR101678138B1 (en) Video encoding method, device, and program
WO2011111372A1 (en) Video image coding device and video image coding method
WO2010143497A1 (en) Moving image data processing device, imaging device, and moving image reproduction device
JP4779207B2 (en) Motion vector conversion apparatus and motion vector conversion method
JP4130197B2 (en) Video coding method and apparatus
JP6181242B2 (en) Image decoding method
JP5951915B2 (en) Image decoding method
JP5946980B1 (en) Image decoding method
JP2007166555A (en) Encoding device and method
JP5750191B2 (en) Image decoding method

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 11753037

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 11753037

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: JP

点击 这是indexloc提供的php浏览器服务，不要输入任何密码和下载