CN111713109B - Video processing method, device and equipment - Google Patents

Abstract

A video processing method, device and equipment, the method comprising: obtaining motion information of a first image block of a current frame; Encoding or decoding of adjacent blocks; wherein, the size of the storage unit is M×N, and M and N meet the following conditions: M is greater than the minimum horizontal size of all image blocks in the current frame, and/or, N is greater than the size of all image blocks in the current frame Minimum vertical size. The embodiments of the present disclosure can reduce the data processing pressure in the process of video encoding and decoding.

Description

Video processing method, device and equipment

technical field

The present disclosure relates to the field of image processing, and more specifically, to a video processing method, device and equipment.

Background technique

Prediction is an important module of the mainstream video coding framework, and prediction can include intra-frame prediction and inter-frame prediction. In the inter-frame prediction mode, the codec process needs to refer to the motion information of other image blocks to determine the motion information of the current image block, and then complete the image prediction. Therefore, motion information of a large number of image blocks needs to be stored for reference by other motion information.

Therefore, how to reduce the data processing pressure of motion information in the inter prediction mode is an urgent problem to be solved.

Contents of the invention

According to a first aspect of the present disclosure, a video processing method is provided, including:

Obtain the motion information of the first image block of the current frame;

storing the motion information corresponding to the storage unit, the motion information being used for encoding or decoding of spatial adjacent blocks of the first image block;

Wherein, the size of the storage unit is M×N, and M and N meet the following conditions: M is greater than the minimum horizontal size of all image blocks in the current frame, and/or, N is greater than the minimum vertical size of all image blocks in the current frame.

The video processing method provided in this embodiment can effectively reduce the data processing pressure in the process of video encoding and decoding by increasing the size of the storage unit corresponding to the motion information and reducing the amount of stored motion information.

According to a second aspect of the present disclosure, a video processing method is provided, including:

Obtain the motion information of the first image block of the current frame;

Converting the motion information into motion information expressed in exponential form, and storing the motion information expressed in exponential form corresponding to the storage unit, the motion information expressed in exponential form is used for spatial adjacent blocks of the first image block encoding or decoding.

The video processing method provided in this embodiment stores spatial motion information in exponential form, which can effectively reduce storage space occupation of spatial motion information, reduce data transmission volume, and further effectively reduce data processing pressure in the video encoding and decoding process.

According to a third aspect of the present disclosure, a video processing device is provided, including:

A motion information acquisition module, configured to acquire motion information of the first image block of the current frame;

A motion information storage module, configured to store the motion information corresponding to the storage unit, and the motion information is used for encoding or decoding of spatial adjacent blocks of the first image block;

Wherein, the size of the storage unit is M×N, and M and N meet the following conditions: M is greater than the minimum horizontal size of all image blocks in the current frame, and/or, N is greater than the minimum vertical size of all image blocks in the current frame.

The video processing device provided in this embodiment can effectively reduce the data processing pressure in the process of video encoding and decoding by increasing the size of the storage unit corresponding to the motion information and reducing the amount of stored motion information.

According to a fourth aspect of the present disclosure, a video processing device is provided, including:

A motion information acquisition module, configured to acquire motion information of the first image block of the current frame;

a motion information storage module, configured to convert the motion information into motion information expressed in exponential form, and store the motion information represented in exponential form corresponding to the storage unit, and the motion information represented in exponential form is used for the first Coding or decoding of spatially adjacent blocks of an image block.

The video processing device provided by this embodiment stores spatial motion information in exponential form, which can effectively reduce storage space occupation of spatial motion information, reduce data transmission volume, and further effectively reduce data processing pressure during video encoding and decoding.

According to a fifth aspect of the present disclosure, there is provided a video processing device, comprising:

storage; and

A processor coupled to the associated memory, the processor configured to execute the video processing method as described in the first aspect above based on instructions stored in the memory.

According to a sixth aspect of the present disclosure, there is provided a video processing device, comprising:

storage; and

A processor coupled to the associated memory, the processor configured to execute the video processing method as described in the second aspect above based on instructions stored in the memory.

According to a seventh aspect of the present disclosure, there is provided a computer storage medium for storing program codes, and the program codes are used to execute the method described in the first aspect above.

According to an eighth aspect of the present disclosure, there is provided a computer storage medium for storing program codes, and the program codes are used to execute the method as described in the second aspect above.

Description of drawings

In order to more clearly illustrate the technical solutions of the embodiments of the present disclosure, the following will briefly introduce the drawings that need to be used in the embodiments or the description of the prior art. Obviously, the drawings in the following description are only some of the present disclosure. Embodiments, for those of ordinary skill in the art, other drawings can also be obtained based on these drawings without any creative effort.

FIG. 1 is a structural diagram of a technical solution applying an embodiment of the present disclosure;

FIG. 2 is a schematic diagram of a video encoding process in an embodiment of the present disclosure;

3 is a schematic flowchart of a video processing method according to an embodiment of the present disclosure;

Fig. 4 is a schematic diagram of an image block in an embodiment of the present disclosure;

Fig. 5 is a schematic diagram of the relationship between spatial adjacent blocks and the first image block in an embodiment of the present disclosure;

6A and 6B are schematic diagrams of memory cells;

7 is a schematic diagram of a storage unit in an embodiment of the present disclosure;

Fig. 8 is a schematic diagram of a storage unit size larger than an image block size in an embodiment of the disclosure;

Fig. 9 is a schematic diagram of storing a plurality of motion information in an embodiment of the present disclosure;

Fig. 10 is a schematic diagram of applying motion information in an embodiment of the present disclosure;

Fig. 11 is a schematic flowchart of another video processing method according to an embodiment of the present disclosure.

Fig. 12 is a schematic block diagram of a video processing device according to an embodiment of the present disclosure.

FIG. 13 is a schematic block diagram of a video processing device according to an embodiment of the present disclosure.

FIG. 14 is a schematic block diagram of a video processing device according to an embodiment of the present disclosure.

Detailed ways

The technical solutions in the embodiments of the present disclosure will be described below with reference to the drawings in the embodiments of the present disclosure. Apparently, the described embodiments are part of the embodiments of the present disclosure, but not all of them. Based on the embodiments in the present disclosure, all other embodiments obtained by persons of ordinary skill in the art without making creative efforts belong to the protection scope of the present disclosure.

Unless otherwise specified, all technical and scientific terms used in the embodiments of the present disclosure have the same meaning as commonly understood by those skilled in the art of the present disclosure. The terms used in the present disclosure are for the purpose of describing specific embodiments only, and are not intended to limit the scope of the present disclosure.

FIG. 1 is a structural diagram of a technical solution applying an embodiment of the present disclosure.

As shown in FIG. 1 , the system 100 may receive data to be processed 102 , process the data to be processed 102 , and generate processed data 108 . For example, the system 100 may receive data to be encoded and encode the data to be encoded to generate encoded data, or the system 100 may receive data to be decoded and decode the data to be decoded to generate decoded data. In some embodiments, the components in the system 100 may be implemented by one or more processors, which may be processors in computing devices, or processors in mobile devices (such as drones). The processor may be any type of processor, which is not limited in this embodiment of the present invention. In some possible designs, the processor may include an encoder, decoder, or codec, among others. One or more memories may also be included in system 100 . The memory may be used to store instructions and data, for example, computer-executable instructions for implementing the technical solutions of the embodiments of the present invention, data to be processed 102, processed data 108, and the like. The storage may be any type of storage, which is not limited in this embodiment of the present invention.

Data to be encoded may include text, images, graphic objects, animation sequences, audio, video, or any other data that requires encoding. In some cases, the data to be encoded may include sensory data from sensors such as vision sensors (e.g., cameras, infrared sensors), microphones, near-field sensors (e.g., ultrasonic sensors, radar), position sensors, temperature sensors, touch sensors, etc. In some cases, the data to be encoded may include information from the user, for example, biometric information, which may include facial features, fingerprint scans, retinal scans, voice recordings, DNA samples, and the like.

Fig. 2 is a block diagram of an encoder according to an embodiment of the disclosure. The processes of inter-frame encoding and intra-frame encoding will be introduced respectively below in conjunction with FIG. 2 .

As shown in Figure 2, the flow of inter-frame encoding and decoding can be as follows:

In 201, a current frame image is acquired. In 202, a reference frame image is acquired. In 203a, motion estimation is performed using the reference frame image to obtain a motion vector (Motion Vector, MV) of each image block of the current frame image. In 204a, motion compensation is performed using the motion vector obtained by motion estimation to obtain an estimated value of the current image block. In 205, the estimated value of the current image block is subtracted from the current image block to obtain a residual. In 206, the residual is transformed to obtain transform coefficients. In 207, the transform coefficients are quantized to obtain quantized coefficients. In 208, entropy encoding is performed on the quantized coefficients, and finally the bit stream obtained by entropy encoding and the encoded encoding mode information are stored or sent to the decoding end. In 209, inverse quantization is performed on the quantized result. In 210, inverse transform is performed on the inverse quantization result. In 211, the reconstructed pixels are obtained by using the inverse transformation result and the motion compensation result. At 212, the reconstructed pixels are filtered. In 213, the filtered reconstructed pixels are output.

As shown in Figure 2, the flow of intra-frame encoding and decoding can be as follows:

In 202, the current frame image is acquired. In 203b, intra-frame prediction selection is performed on the current frame image. In 204b, intra-frame prediction is performed on the current image block in the current frame. In 205, the estimated value of the current image block is subtracted from the current image block to obtain a residual. In 206, the residual of the image block is transformed to obtain transform coefficients. In 207, the transform coefficients are quantized to obtain quantized coefficients. In 208, entropy encoding is performed on the quantized coefficients, and finally the bit stream obtained by entropy encoding and the encoded encoding mode information are stored or sent to the decoding end. In 209, inverse quantization is performed on the quantization result. In 210, perform inverse transformation on the inverse quantization result, and in 211, use the inverse transformation result and the intra prediction result to obtain reconstructed pixels.

As shown in FIG. 2 , during the encoding process, in order to remove redundancy, the image may be predicted. Different images in the video can be predicted in different ways. According to the prediction mode adopted by the image, the image can be divided into an intra-frame prediction image and an inter-frame prediction image. Inter prediction modes may include AMVP mode and Merge mode.

For the AMVP mode, the motion vector prediction (MVP) can be determined first. After the MVP is obtained, the starting point of the motion estimation can be determined according to the MVP. Motion search is performed near the starting point. After the search is completed, the optimal MV, the position of the reference block in the reference image is determined by the MV, the reference block is subtracted from the current block to obtain the residual block, the MV is subtracted from the MVP to obtain the motion vector difference (Motion Vector Difference, MVD), and the MVD is passed through the code stream transmitted to the decoder.

For the Merge mode, the MVP can be determined first, and the MVP can be directly determined as the MV, wherein, in order to obtain the MVP, an MVP candidate list (merge candidate list) can be constructed first, and at least one candidate MVP can be included in the MVP candidate list , each candidate MVP can have an index corresponding to it. After selecting an MVP from the MVP candidate list, the encoder can write the MVP index into the code stream, and the decoder can find the index from the MVP candidate list according to the index The corresponding MVP is used to realize the decoding of image blocks.

In order to understand the Merge mode more clearly, the following will introduce the operation process of encoding in the Merge mode.

Step 1. Obtain the MVP candidate list;

Step 2, select an optimal MVP from the MVP candidate list, and simultaneously obtain the index of the MVP in the MVP candidate list;

Step 3, use the MVP as the MV of the current block;

Step 4, determine the position of the reference block (also referred to as the prediction block) in the reference frame image according to the MV;

Step 5, subtracting the current block from the reference block to obtain the residual data;

Step 6: Send the residual data and the index of the MVP to the decoder.

It should be understood that the above process is only a specific implementation of the Merge mode. The Merge pattern can also have other implementations.

For example, Skip mode is a special case of Merge mode. After the MV is obtained according to the Merge mode, if the encoder determines that the current block is basically the same as the reference block, then there is no need to transmit the residual data, only the index of the MV, and a flag that can indicate that the current block can be directly Obtained from the reference block.

That is to say, the feature of the Merge mode is: MV=MVP (MVD=0); and the Skip mode has one more feature, namely: the reconstructed value rec=predicted value pred (residual value resi=0).

Regardless of the AMVP mode or the Merge mode, the MV of each image block needs to be stored so as to provide the MVP for adjacent blocks. Since the encoding or decoding process needs to store multiple MVPs in one frame of image, in order to improve the efficiency of encoding/decoding and reduce the amount of data processing, the embodiment of the present disclosure improves the storage method of MVP, which can effectively reduce the MVP Storage pressure on hardware.

Fig. 3 is a schematic flowchart of a video processing method 300 according to an embodiment of the present disclosure. The method 300 can be implemented by a processing device. The processing device may be used at an encoding end or a decoding end, and specifically may be an encoder or a decoder. Referring to FIG. 3, method 300 may include:

Step S301, acquiring motion information of the first image block of the current frame;

Step S302, corresponding to the storage unit storing the motion information, the motion information is used for encoding or decoding of spatial adjacent blocks of the first image block;

Wherein, the size of the storage unit is M×N, and M and N meet the following conditions: M is greater than the minimum horizontal size of all image blocks in the current frame, and/or, N is greater than the minimum vertical size of all image blocks in the current frame.

In step S301, as shown in Figure 4, when encoding an image, a frame of image can be divided into multiple coding areas (Coding Tree Unit, CTU), and each encoding area is divided into multiple image blocks, also called Coding Unit (CodingUnit, CU). In some implementations, for example, in the form of a quadtree, the size of the coding area may be 64×64, 128×128; the size of the image block may be 64×64, 32×32, 16×16, or 8×8. It can be understood that, in some other division forms, the size of the coding area and the size of the image block can also be other sizes, for example, the size of the image block is 4×8, 8×4, 8×16, etc., which is not limited here.

Referring to the descriptions of FIG. 2 and FIG. 1, in the embodiment of the present disclosure, the motion information may include a motion vector (MV) corresponding to an image block (CU), or include a motion vector and reference frame information (such as a reference frame index), etc. . The motion information of the first image block may be used for encoding or decoding of spatial adjacent blocks of the first image block. The spatial adjacent block includes not only an image block directly adjacent to the first image block, but also an image block separated from the first image block by at least one pixel, which is not specifically limited in the present disclosure.

Fig. 5 is a schematic diagram of the relationship between spatial adjacent blocks and the first image block in an embodiment of the present disclosure.

Referring to FIG. 5 , the middle square in FIG. 5 represents the current image block. The square is only for illustration and does not limit the size of the image block. In some implementation manners, the square in the middle may also represent the current sub-image block. For a coding unit (CU), it can be divided into one or more prediction units (Prediction Unit, PU) according to the cutting type of the prediction mode. At this time, the prediction unit (PU) here may be the sub-image block. For the current image block or the current sub-image block, the MVs of the storage units spatially adjacent to the current image block or the current sub-image block can be used as candidate MVPs that can be added to the MVP candidate list.

In some implementations, the construction of the spatial candidate list for the current image block or the current sub-image block can be as follows: the storage unit in the lower left corner is A0, the storage unit in the left side is A1, the storage unit in the upper left corner is B2, and the storage unit in the upper left corner is A0. The storage unit is B1, and the upper right corner is B0, then the order of MVP candidates in the airspace candidate list is A1->B1->B0->A0->B2 in descending order of priority.

In addition, the motion information mentioned in this disclosure may include both single motion information and dual motion information. Wherein, dual-motion information may refer to motion information including two single-motion information. The single motion information is forward motion information or backward motion information, wherein the forward motion information means that the corresponding reference frame is the forward frame of the current frame, and the backward motion information means that the corresponding reference frame is the backward frame of the current frame. frame. The two single-motion information included in the dual-motion information may both be forward motion information, may both be backward motion information, or may be one forward motion information and one backward motion information, which is not specifically limited in the present disclosure.

In some embodiments, a tile (CU) has only one sub-chunk (PU), at which point there is one motion information for the tile. In some other embodiments, an image block includes two or more sub-image blocks, and each sub-image block can correspond to at least one piece of motion information at this time, that is, the first image block of the current frame obtained in step S301 The motion information includes acquiring multiple pieces of motion information of the first image block of the current frame.

In step S302, in order to conveniently provide MVPs for each spatial adjacent block, the MV of an image block is stored in a storage unit.

6A and 6B are schematic diagrams of memory cells.

Referring to FIG. 6A, for a first image block (CU) with a size of 16×16, a motion information MV0 can be stored in a 4×4 image unit, that is, corresponding to each of the multiples of 4 as the starting point and the ending point in the CU. One motion information is stored in a region, and a total of 16 pieces of motion information are stored, and the MV stored in each location is the motion information MV0 corresponding to the CU.

Referring to FIG. 6B, when the first image block includes two sub-image blocks (PU1, PU2), each sub-image block corresponds to at least one piece of motion information, for example, PU1 corresponds to MV1, and PU2 corresponds to MV2. At this time, when the size of the first image block is 16×16 and one piece of motion information is stored in units of 4×4 (that is, the storage unit size is 4×4), 8 MV1 and 8 MV2 can be stored.

FIG. 7 is a schematic diagram of a storage unit in an embodiment of the present disclosure.

Referring to FIG. 7 , in order to reduce data storage pressure, the embodiment of the present disclosure sets the storage unit size to M×N, and sets M and N to meet the following conditions: M is greater than the minimum horizontal size of all image blocks in the current frame, and/or, N Minimum vertical size of all image blocks larger than the current frame.

In the field of image processing, the minimum horizontal size and the minimum vertical size of an image block are generally 4, and in some cases, the minimum horizontal size and the minimum vertical size can be larger values. For example, when the current frame image is divided into image blocks to obtain image blocks with various sizes of 4×4, 8×8, 16×16, and 32×32, the minimum horizontal size and minimum vertical size of all image blocks in the current frame The size is 4, at this time, the size of the storage unit needs to satisfy that its horizontal dimension is greater than 4 or its vertical dimension is greater than 4.

In some embodiments, both M and N are positive integer multiples of i, i is the minimum horizontal size or minimum vertical size of all image blocks in the first image block, and in some embodiments, i is the minimum horizontal size of all image blocks size or the smallest vertical size, whichever is smaller. In this technical field, the size of the smallest image block is generally 4×8 or 8×4.

For example, when the smallest image block size is 4×8, i=4, both M and N are positive integer multiples of 4, and at least one of M and N is greater than 4. In some embodiments, the size of the storage unit may be 4×8, 8×4, 8×8, etc., for example.

In the embodiment shown in FIG. 7 , the horizontal size of the first image block 71 is 16, and the vertical size is 16. When both M and N are less than 16, multiple pieces of motion information can be stored for the first image block 71 . If the first image block 71 is the smallest image block of the current frame at this time, 4≤M≤16, 4≤N≤16, at this time, the size of the storage unit is not greater than the size of the smallest image block, and one storage unit only corresponds to one Image blocks.

In other embodiments, as shown in FIG. 8, when the size of the storage unit (for example, 8×4 in the figure) is larger than the size of the smallest image block (for example, 4×4 in the figure), one storage unit 81 can correspond to two One or more image blocks (for example, CU1 and CU2 in the figure). In the embodiment of the present disclosure, if one storage unit corresponds to two or more image blocks, only the motion information of one image block is stored (for example, only the motion information MV1 of CU1 is stored in the figure). In an embodiment of the present disclosure, the storage unit only stores the motion information of the image block where the coordinate position of the storage unit is located.

In some implementations, the source image block of the motion information MV stored in the storage unit is determined by the coordinates of the storage unit. Specifically, a fixed coordinate can be preselected to be set for the storage unit, for example (x, y), and then the motion information of the image block at the coordinate (x, y) in the image will be stored corresponding to the storage unit. When one storage unit corresponds to two or more image blocks, this method of selecting the source image block of the motion information can also be used. For example, in FIG. 8, when the storage unit 81 corresponds to CU1 and CU2, and its coordinates are located in CU1, only the motion information corresponding to CU1 is stored in the storage unit. Similarly, when the storage unit corresponds to more image blocks, only the motion information of the image block where the coordinate position of the storage unit is stored is stored, and the motion information of the remaining image blocks corresponding to the storage unit is not stored.

Referring to FIG. 9 , corresponding to the situation shown in FIG. 6B , the storage unit (4×8) corresponding to the sub-image block PU1 or PU2 of the first image block 91 stores the motion information MV1 and MV2 of the sub-image block respectively. Generally speaking, the storage units corresponding to the storage of motion information in the same image block have the same size. In the embodiment shown in FIG. 9 , the storage units of PU1 and PU2 are both 4×8.

Fig. 10 is a schematic diagram of applying motion information in an embodiment of the present disclosure.

Referring to FIG. 10, when the motion information of the first image block CU (with a size of 16×16) is stored according to M×N, the motion information of the first image block is selected from a plurality of candidate motion information in the spatial candidate list , the size of the storage unit corresponding to each candidate motion information is M×N.

That is, if the motion information is stored in the first image block CU according to 4×8, the motion information corresponding to the 4×8 area of the reference bits A0-B2 in the figure is obtained as the MVP, and the first image is selected among the five MVPs The motion information MV of the block CU, and finally store the motion information MV of the first image block CU for the storage unit according to 4×8, and provide the MVP for other spatial adjacent blocks.

In order to further reduce data storage pressure and bandwidth pressure, and improve bandwidth utilization and data processing efficiency, in the embodiments of the present disclosure, a method for storing airspace motion information is improved.

In step S302, the motion information may be converted into motion information expressed in exponential form, and stored in the storage unit.

In one embodiment, the exponential form is, for example, an exponent mantissa form.

For example, the motion information MV can be expressed as MV=a×k ^b , where a is the mantissa, b is the exponent, and k is the base. The base k may be, for example, a default value of 2 or 10, and may also be adjusted according to actual conditions, and the present disclosure is not limited thereto.

When the motion information MV is expressed in the form of a mantissa exponent, the first preset number of digits can be used to store the mantissa a, and the second preset mantissa can be used to store the exponent b, thereby reducing the storage capacity of the data MV. In one embodiment, the first preset number of digits is, for example, 6 bits, and the second preset number of digits is, for example, 4 bits. At this time, using 10 bits can represent a maximum value of 63× ²¹⁵ (k=2), read For motion information, you only need to read 10bit data and restore the MV value according to the settings of the first preset digit, the second preset digit and the base number, and you can quickly read the MV, which greatly reduces the amount of data storage and improves the Data processing efficiency.

The above-mentioned embodiment is only an example, and those skilled in the art can adjust the first preset digit, the second preset digit and the mantissa by themselves, as long as the sum of the first preset digit and the second preset digit is less than the movement The number of bits occupied when the information MV is directly stored in binary is sufficient.

Fig. 11 is a flowchart of a video processing method provided in an embodiment of the present disclosure.

Referring to FIG. 11, a video processing method 1100 may include:

Step S111, acquiring motion information of the first image block of the current frame;

Step S112, converting the motion information into motion information expressed in exponential form, and storing the motion information expressed in exponential form corresponding to the storage unit, the motion information expressed in exponential form is used for the spatial domain of the first image block Encoding or decoding of adjacent blocks.

Wherein, the spatial adjacent block may include an image block directly adjacent to the first image block, or may include an image block separated from the first image block by at least one pixel.

In one embodiment, the form of the exponent in step S112 is, for example, the form of the mantissa of the exponent.

For example, the motion information MV can be expressed as MV=a×k ^b , where a is the mantissa, b is the exponent, and k is the base. The base k may be, for example, a default value of 2 or 10, and may also be adjusted according to actual conditions, and the present disclosure is not limited thereto.

When the motion information MV is expressed in the form of a mantissa exponent, the first preset number of digits can be used to store the mantissa a, and the second preset mantissa can be used to store the exponent b, thereby reducing the storage capacity of the data MV. In one embodiment, the first preset number of digits is, for example, 6 bits, and the second preset number of digits is, for example, 4 bits. At this time, using 10 bits can represent a maximum value of 63× ²¹⁵ (k=2), read For motion information, you only need to read 10bit data and restore the MV value according to the settings of the first preset digit, the second preset digit and the base number, and you can quickly read the MV, which greatly reduces the amount of data storage and improves the Data processing efficiency.

The above-mentioned embodiment is only an example, and those skilled in the art can adjust the first preset digit, the second preset digit and the mantissa by themselves, as long as the sum of the first preset digit and the second preset digit is less than the movement The number of bits occupied when the information MV is directly stored in binary is sufficient.

Using the exponential form to store motion information can greatly reduce the amount of data storage, thereby reducing the amount of data processing in the process of encoding and decoding, and improving the efficiency of data processing.

In order to further reduce the amount of data processing, in step S111, the size of the storage unit may also be adjusted. In the embodiment of the present disclosure, the size of the storage unit can be set as M×N, and M and N meet the following conditions: M is greater than the minimum horizontal size of all image blocks in the current frame, and/or, N is greater than the minimum horizontal size of all image blocks in the current frame Minimum vertical size.

In some embodiments, both M and N are positive integer multiples of i, where i is the smallest horizontal size or the smallest vertical size of all image blocks. For example, i may be the smaller of the smallest horizontal size or the smallest vertical size of all image blocks.

Referring to FIG. 4 to FIG. 10 , in some embodiments, the size of the storage unit may be, for example, 4×8, 8×4, or 8×8, which is not specifically limited in the present disclosure.

When the size of the storage unit is not larger than the size of the smallest image block of the current frame, one storage unit corresponds to one image block, and the MV stored corresponding to one storage unit is the MV of one image block.

When the size of the storage unit is larger than the size of the smallest image block of the current frame, the storage unit may correspond to two or more image blocks, and at this time, only the motion information of one image block is stored corresponding to the storage unit. In an embodiment of the present disclosure, the storage unit only stores the motion information of the image block where the coordinate position of the storage unit is located.

After the storage unit is enlarged, when the motion information of the first image block is selected from multiple candidate motion information in the spatial candidate list, the size of the storage unit corresponding to each candidate motion information is M×N.

By enlarging the storage unit, the amount of motion information stored for one image block can be reduced, thereby reducing the amount of data processing.

In some embodiments, the first image block may also include multiple sub-image blocks (PU1, PU2, PUn...), each sub-image block has at least one motion information, and each sub-image block corresponds to at least one storage unit, here When , in step S111, a plurality of pieces of motion information of the first image block of the current frame are acquired, and in step S112, a storage unit corresponding to each sub-image block stores the motion information of the sub-image block.

It should be understood that the implementation of each step in the method 1100 may refer to the above description, and for the sake of brevity, details are not repeated here.

FIG. 12 is a schematic block diagram of a video processing device 1200 according to an embodiment of the present disclosure. The video processing device 1200 includes:

A motion information acquisition module 1201, configured to acquire motion information of the first image block of the current frame;

A motion information storage module 1202, configured to store the motion information corresponding to the storage unit, and the motion information is used for encoding or decoding of spatial adjacent blocks of the first image block;

Wherein, the size of the storage unit is M×N, and M and N meet the following conditions: M is greater than the minimum horizontal size of all image blocks in the current frame, and/or, N is greater than the minimum vertical size of all image blocks in the current frame.

In an exemplary embodiment of the present disclosure, the spatial adjacent blocks include image blocks directly adjacent to the first image block.

In an exemplary embodiment of the present disclosure, the spatial adjacent block includes an image block at least one pixel apart from the first image block.

In an exemplary embodiment of the present disclosure, both M and N are positive integer multiples of i, where i is the smallest horizontal size or the smallest vertical size of all image blocks.

In an exemplary embodiment of the present disclosure, the i is the smaller one of the smallest horizontal size or the smallest vertical size of all the image blocks.

In an exemplary embodiment of the present disclosure, the size of the storage unit is 4×8.

In an exemplary embodiment of the present disclosure, the size of the storage unit is 8×4.

In an exemplary embodiment of the present disclosure, the size of the storage unit is 8×8.

In an exemplary embodiment of the present disclosure, the exercise information storage module 1202 is configured to:

When the storage unit corresponds to multiple image blocks, only the motion information of one image block is stored corresponding to the storage unit.

In an exemplary embodiment of the present disclosure, the exercise information storage module 1202 is configured to:

Corresponding to the storage unit, only the motion information of the image block where the coordinate position of the storage unit is stored is stored.

In an exemplary embodiment of the present disclosure, the motion information acquiring module 1201 is configured to acquire multiple pieces of motion information of the first image block of the current frame.

In an exemplary embodiment of the present disclosure, the first image block includes a plurality of sub-image blocks, and each sub-image block has at least one piece of motion information.

In an exemplary embodiment of the present disclosure, each of the sub-image blocks corresponds to at least one storage unit, and the motion information storage module 1202 is further configured to store the sub-image in the storage unit corresponding to the sub-image Motion information of image blocks.

In an exemplary embodiment of the present disclosure, the motion information acquisition module is configured to select the motion information of the first image block from a plurality of motion information candidates in the spatial candidate list, wherein each motion information candidate The corresponding storage unit size is M×N.

In an exemplary embodiment of the present disclosure, the motion information storage module is configured to convert the motion information into motion information expressed in exponential form, and store the motion information represented in exponential form into the storage unit middle.

In an exemplary embodiment of the present disclosure, the exponential form includes a mantissa exponential form.

In an exemplary embodiment of the present disclosure, a first preset number of bits is used to store the mantissa, and a second preset number of bits is used to store the exponent.

In an exemplary embodiment of the present disclosure, the first preset number of bits is 6 bits.

In an exemplary embodiment of the present disclosure, the second preset number of bits is 4 bits.

In an exemplary embodiment of the present disclosure, the sum of the first preset number of bits and the second preset number of bits is smaller than the number of bits occupied when the motion information is stored in binary.

It should be understood that the apparatus 1200 may be used to implement the method 300, and details are not described here for brevity.

FIG. 13 is a schematic block diagram of a video processing device 1300 according to an embodiment of the present disclosure. The video processing device 1300 includes:

A motion information acquisition module 1301, configured to acquire motion information of the first image block of the current frame;

A motion information storage module 1302, configured to convert the motion information into motion information expressed in exponential form, and store the motion information represented in exponential form corresponding to the storage unit, and the motion information represented in exponential form is used for the first Coding or decoding of spatially adjacent blocks of an image block.

In an exemplary embodiment of the present disclosure, the spatial adjacent blocks include image blocks directly adjacent to the first image block.

In an exemplary embodiment of the present disclosure, the spatial adjacent block includes an image block at least one pixel apart from the first image block.

In an exemplary embodiment of the present disclosure, the exponential form includes a mantissa exponential form.

In an exemplary embodiment of the present disclosure, a first preset number of bits is used to store the mantissa, and a second preset number of bits is used to store the exponent.

In an exemplary embodiment of the present disclosure, the first preset number of bits is 6 bits.

In an exemplary embodiment of the present disclosure, the second preset number of bits is 4 bits.

In an exemplary embodiment of the present disclosure, the sum of the first preset number of bits and the second preset number of bits is smaller than the number of bits occupied when the motion information is stored in binary.

In an exemplary embodiment of the present disclosure, the size of the storage unit is M×N, and M and N meet the following conditions: M is larger than the minimum horizontal size of all image blocks in the current frame, and/or, N is larger than all image blocks in the current frame The minimum vertical size of an image block.

In an exemplary embodiment of the present disclosure, both M and N are positive integer multiples of i, where i is the smallest horizontal size or the smallest vertical size of all image blocks.

In an exemplary embodiment of the present disclosure, the i is the smaller one of the smallest horizontal size or the smallest vertical size of all the image blocks.

In an exemplary embodiment of the present disclosure, the size of the storage unit is 4×8.

In an exemplary embodiment of the present disclosure, the size of the storage unit is 8×4.

In an exemplary embodiment of the present disclosure, the size of the storage unit is 8×8.

In an exemplary embodiment of the present disclosure, the exercise information storage module 1302 is configured to:

When the storage unit corresponds to multiple image blocks, only the motion information of one image block is stored corresponding to the storage unit.

In an exemplary embodiment of the present disclosure, the exercise information storage module 1302 is configured to:

Corresponding to the storage unit, only the motion information of the image block where the coordinate position of the storage unit is stored is stored.

In an exemplary embodiment of the present disclosure, the motion information acquisition module is configured to select the motion information of the first image block from a plurality of motion information candidates in the spatial candidate list, wherein each motion information candidate The corresponding storage unit size is M×N.

In an exemplary embodiment of the present disclosure, the motion information acquiring module is configured to acquire multiple pieces of motion information of the first image block of the current frame.

In an exemplary embodiment of the present disclosure, the first image block includes a plurality of sub-image blocks, and each sub-image block has at least one piece of motion information.

In an exemplary embodiment of the present disclosure, each of the sub-image blocks corresponds to at least one storage unit; the motion information storage module is configured to store the sub-image blocks in the storage unit corresponding to the sub-image blocks sports information.

It should be understood that the apparatus 1300 may be used to implement the method 1100, and details are not described here for brevity.

FIG. 14 shows a schematic block diagram of a video processing device 1400 according to an embodiment of the present disclosure.

As shown in FIG. 14 , the video processing device 1400 may include a processor 1410 and may further include a memory 1420 .

It should be understood that the video processing device 1400 may also include components commonly included in other video processing devices, for example, input and output devices, communication interfaces, etc., which are not limited in this embodiment of the present disclosure.

The memory 1420 is used to store computer-executable instructions.

The memory 1420 can be various types of memory, for example, it can include a high-speed random access memory (Random Access Memory, RAM), and it can also include a non-volatile memory (non-volatile memory), such as at least one disk memory. Examples are not limited to this.

The processor 1410 is configured to access the memory 1420 and execute the computer-executable instructions to perform the video processing method 300 or 1100 in the above embodiments of the present disclosure.

The processor 1410 may include a microprocessor, a Field-Programmable Gate Array (Field-Programmable GateArray, FPGA), a central processing unit (Central Processing unit, CPU), a graphics processing unit (Graphics Processing Unit, GPU), etc., and embodiments of the present disclosure are directed to This is not limited.

The video processing device in the embodiment of the present disclosure may correspond to the execution subject of the video processing method in the embodiment of the present disclosure, and the above-mentioned and other operations and/or functions of each module in the video processing device are to realize the corresponding processes of the foregoing methods, For the sake of brevity, details are not repeated here.

An embodiment of the present disclosure further provides an electronic device, and the electronic device may include the above-mentioned device for video processing in various embodiments of the present disclosure.

The embodiment of the present disclosure also provides a computer storage medium, in which program code is stored, and the program code may be used to instruct the execution of the video processing method 300 or 1100 in the above embodiment of the present disclosure.

It should be understood that, in the embodiments of the present disclosure, the term "and/or" is only an association relationship describing associated objects, indicating that there may be three relationships. For example, A and/or B may mean that A exists alone, A and B exist simultaneously, and B exists alone. In addition, the character "/" in this article generally indicates that the contextual objects are an "or" relationship.

Those of ordinary skill in the art can realize that the units and algorithm steps of the examples described in conjunction with the embodiments disclosed herein can be implemented by electronic hardware, computer software, or a combination of the two. In order to clearly illustrate the relationship between hardware and software Interchangeability. In the above description, the composition and steps of each example have been generally described according to their functions. Whether these functions are executed by hardware or software depends on the specific application and design constraints of the technical solution. Skilled artisans may implement the described functions using different methods for each particular application, but such implementation should not be considered as exceeding the scope of the present disclosure.

Those skilled in the art can clearly understand that for the convenience and brevity of the description, the specific working process of the above-described system, device and unit can refer to the corresponding process in the foregoing method embodiment, and will not be repeated here.

In the several embodiments provided in the present disclosure, it should be understood that the disclosed systems, devices and methods may be implemented in other ways. For example, the device embodiments described above are only illustrative. For example, the division of the units is only a logical function division. In actual implementation, there may be other division methods. For example, multiple units or components can be combined or May be integrated into another system, or some features may be ignored, or not implemented. In addition, the mutual coupling or direct coupling or communication connection shown or discussed may be indirect coupling or communication connection through some interfaces, devices or units, and may also be electrical, mechanical or other forms of connection.

The units described as separate components may or may not be physically separated, and the components shown as units may or may not be physical units, that is, they may be located in one place, or may be distributed to multiple network units. Part or all of the units can be selected according to actual needs to achieve the purpose of the solutions of the embodiments of the present disclosure.

In addition, each functional unit in each embodiment of the present disclosure may be integrated into one processing unit, each unit may exist separately physically, or two or more units may be integrated into one unit. The above-mentioned integrated units can be implemented in the form of hardware or in the form of software functional units.

If the integrated unit is realized in the form of a software function unit and sold or used as an independent product, it can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of the present disclosure is essentially or part of the contribution to the prior art, or all or part of the technical solution can be embodied in the form of a software product, and the computer software product is stored in a storage medium In the above, several instructions are included to make a computer device (which may be a personal computer, a server, or a network device, etc.) execute all or part of the steps of the methods described in various embodiments of the present disclosure. The aforementioned storage medium includes: U disk, mobile hard disk, read-only memory (ROM, Read-OnlyMemory), random access memory (RAM, Random Access Memory), magnetic disk or optical disc and other media that can store program codes.

The above is only a specific embodiment of the present disclosure, but the protection scope of the present disclosure is not limited thereto. Any person familiar with the technical field can easily think of various equivalents within the technical scope of the present disclosure. Modifications or replacements should be covered within the protection scope of the present disclosure. Therefore, the protection scope of the present disclosure should be determined by the protection scope of the claims.

Claims (82)

1. A video processing method, comprising:

acquiring motion information of a first image block of a current frame;

storing the motion information corresponding to a storage unit, the motion information being used for encoding or decoding of spatial neighboring blocks of the first image block;

the size of the storage unit is M multiplied by N, and M and N meet the following conditions: m is larger than the minimum transverse size of all image blocks of the current frame, and/or N is larger than the minimum longitudinal size of all image blocks of the current frame;

wherein, the obtaining the motion information of the first image block of the current frame includes:

and selecting the motion information of the first image block from a plurality of candidate motion information in the spatial domain candidate list by taking the motion vector of the storage unit which is adjacent to the first image block in the spatial domain as candidate motion information added into the spatial domain candidate list, wherein the size of the storage unit corresponding to each candidate motion information is M multiplied by N.

2. The video processing method of claim 1, wherein the spatial neighboring block comprises a block immediately adjacent to the first block.

3. The video processing method of claim 1, wherein the spatial neighboring block comprises an image block spaced at least one pixel apart from the first image block.

4. The video processing method of claim 1, wherein M and N are positive integer multiples of i, where i is a minimum lateral size or a minimum longitudinal size of all the image blocks.

5. The video processing method of claim 4, wherein the i is the smaller of the smallest horizontal size or the smallest vertical size of all the image blocks.

6. The video processing method according to claim 1 or 4, wherein the storage unit size is 4 x 8.

7. The video processing method according to claim 1 or 4, wherein the storage unit size is 8 x 4.

8. The video processing method according to claim 1 or 4, wherein the storage unit size is 8 x 8.

9. The video processing method according to claim 1, wherein when the storage unit corresponds to a plurality of image blocks, motion information of only one image block is stored corresponding to the storage unit.

10. The video processing method of claim 9, wherein said storing motion information for only one image block in correspondence with said storage unit comprises:

and only storing the motion information of the image block where the coordinate position of the storage unit is located corresponding to the storage unit.

11. The video processing method according to claim 1, wherein said obtaining motion information of the first image block of the current frame comprises:

a plurality of pieces of motion information of a first image block of a current frame are acquired.

12. The video processing method of claim 11, wherein the first image block comprises a plurality of sub image blocks, and motion information of each of the sub image blocks is at least one.

13. The video processing method of claim 12, each of the sub image blocks corresponding to at least one storage unit; the storing of the motion information corresponding to the storage unit further includes:

the storage unit corresponding to the sub image block stores motion information of the sub image block.

14. The video processing method of claim 1, wherein said storing the motion information corresponding to the storage unit comprises:

converting the motion information into motion information expressed in an exponential form, and storing the motion information expressed in the exponential form into the storage unit.

15. The video processing method of claim 14, wherein the exponential form comprises a mantissa exponential form.

16. The video processing method of claim 15, wherein the mantissa in mantissa exponential form is stored using a first predetermined number of bits, and the exponent in mantissa exponential form is stored using a second predetermined number of bits.

17. The video processing method of claim 16, wherein the first predetermined number of bits is 6 bits.

18. The video processing method according to claim 16 or 17, wherein said second predetermined number of bits is 4 bits.

19. The video processing method of claim 16, wherein a sum of the first predetermined number of bits and the second predetermined number of bits is smaller than a number of bits occupied when the motion information is stored in binary.

20. A video processing method, comprising:

acquiring motion information of a first image block of a current frame;

converting the motion information into motion information expressed in an exponential form, and storing the motion information expressed in the exponential form corresponding to a storage unit, wherein the motion information expressed in the exponential form is used for encoding or decoding spatial neighboring blocks of the first image block;

wherein, the obtaining the motion information of the first image block of the current frame comprises:

and selecting the motion information of the first image block from a plurality of candidate motion information in the spatial domain candidate list by taking the motion vector of the storage unit which is adjacent to the first image block in the spatial domain as candidate motion information added into the spatial domain candidate list.

21. The video processing method of claim 20, wherein the spatial neighboring block comprises an image block immediately adjacent to the first image block.

22. The video processing method of claim 20, wherein the spatial neighboring block comprises an image block spaced at least one pixel apart from the first image block.

23. The video processing method of claim 20, wherein the exponential form comprises a mantissa exponential form.

24. The video processing method of claim 23, wherein the mantissa in mantissa exponential form is stored using a first predetermined number of bits, and the exponent in mantissa exponential form is stored using a second predetermined number of bits.

25. The video processing method of claim 24, wherein the first predetermined number of bits is 6 bits.

26. The video processing method according to claim 24 or 25, wherein said second predetermined number of bits is 4 bits.

27. The video processing method of claim 24, wherein a sum of the first predetermined number of bits and the second predetermined number of bits is less than a number of bits occupied when the motion information is stored in binary.

28. The video processing method of claim 20, wherein the storage unit size is mxn, and M, N satisfy the following condition:

m is greater than the minimum lateral size of all image blocks of the current frame, and/or,

n is greater than the minimum vertical size of all image blocks of the current frame.

29. The video processing method of claim 28, wherein M and N are positive integer multiples of i, where i is a minimum lateral size or a minimum vertical size of all image blocks.

30. The video processing method of claim 29, wherein i is the smaller of the smallest horizontal size or the smallest vertical size of all image blocks.

31. The video processing method according to claim 28 or 30, wherein the storage unit size is 4 x 8.

32. The video processing method according to claim 28 or 30, wherein the storage unit size is 8 x 4.

33. The video processing method according to claim 28 or 30, wherein the storage unit size is 8 x 8.

34. The video processing method according to claim 28, wherein when the storage unit corresponds to a plurality of image blocks, the motion information of only one image block is stored corresponding to the storage unit.

35. The video processing method of claim 34, wherein said storing motion information for only one image block in correspondence with said storage unit comprises:

and only storing the motion information of the image block where the coordinate position of the storage unit is located corresponding to the storage unit.

36. The video processing method of claim 28, wherein each candidate motion information corresponds to a memory unit size of mxn.

37. The video processing method of claim 20, wherein said obtaining motion information of the first image block of the current frame comprises:

a plurality of pieces of motion information of a first image block of a current frame are acquired.

38. The video processing method of claim 37, wherein the first image block comprises a plurality of sub image blocks, and motion information of each of the sub image blocks is at least one.

39. The video processing method of claim 38, each of the sub image blocks corresponding to at least one storage unit; the storing the motion information corresponding to the storage unit further includes:

the storage unit corresponding to the sub image block stores motion information of the sub image block.

40. A video processing apparatus, comprising:

the motion information acquisition module is used for acquiring motion information of a first image block of a current frame;

a motion information storage module for storing the motion information corresponding to a storage unit, the motion information being used for encoding or decoding of an spatial neighboring block of the first image block;

the size of the storage unit is M multiplied by N, and M and N meet the following conditions: m is larger than the minimum transverse size of all image blocks of the current frame, and/or N is larger than the minimum longitudinal size of all image blocks of the current frame;

the motion information acquisition module is configured to use a motion vector of a storage unit adjacent to the first image block in a spatial domain as candidate motion information added to a spatial domain candidate list, and select motion information of the first image block from a plurality of candidate motion information in the spatial domain candidate list, where a size of a storage unit corresponding to each candidate motion information is mxn.

41. The video processing device of claim 40, wherein the spatial neighboring block comprises a block immediately adjacent to the first block.

42. The video processing device of claim 40, wherein the spatial neighboring block comprises an image block that is spaced at least one pixel apart from the first image block.

43. The video processing apparatus of claim 40, wherein M and N are positive integer multiples of i, where i is a minimum lateral size or a minimum vertical size of all of the image blocks.

44. The video processing device of claim 43, wherein the i is the smaller of the smallest horizontal size or the smallest vertical size of all image blocks.

45. The video processing apparatus of claim 40 or 43, wherein the storage unit size is 4 x 8.

46. The video processing apparatus of claim 40 or 43, wherein the storage unit size is 8 x 4.

47. The video processing apparatus of claim 40 or 43, wherein the storage unit size is 8 x 8.

48. The video processing apparatus of claim 40, wherein the motion information storage module is configured to:

when the storage unit corresponds to a plurality of image blocks, the motion information of one image block is stored corresponding to the storage unit.

49. The video processing apparatus of claim 48, wherein the motion information storage module is configured to:

and only storing the motion information of the image block where the coordinate position of the storage unit is located corresponding to the storage unit.

50. The video processing apparatus as claimed in claim 40, wherein said motion information obtaining module is configured to obtain a plurality of motion information of the first image block of the current frame.

51. The video processing apparatus of claim 50, wherein the first image block comprises a plurality of sub image blocks, and motion information of each of the sub image blocks is at least one.

52. The video processing device of claim 51, each of the sub-tiles corresponding to at least one storage unit, the motion information storage module further to store motion information for the sub-tiles corresponding to the storage unit of the sub-tile.

53. The video processing apparatus according to claim 40, wherein the motion information storage module is configured to convert the motion information into motion information expressed in an exponential form, and store the motion information expressed in the exponential form into the storage unit.

54. The video processing apparatus of claim 53, wherein the exponential form comprises a mantissa exponential form.

55. The video processing apparatus of claim 54, wherein the mantissa in mantissa exponential form is stored using a first predetermined number of bits, and the exponent in mantissa exponential form is stored using a second predetermined number of bits.

56. The video processing device of claim 55, wherein the first predetermined number of bits is 6 bits.

57. The video processing apparatus of claim 55 or 56, wherein the second predetermined number of bits is 4 bits.

58. The video processing apparatus of claim 55, wherein a sum of the first predetermined number of bits and the second predetermined number of bits is less than a number of bits occupied when the motion information is stored in binary.

59. A video processing apparatus, comprising:

the motion information acquisition module is used for acquiring motion information of a first image block of a current frame;

a motion information storage module for converting the motion information into motion information expressed in an exponential form, and storing the motion information expressed in the exponential form corresponding to a storage unit, wherein the motion information expressed in the exponential form is used for encoding or decoding an airspace adjacent block of the first image block;

the motion information acquisition module is used for taking a motion vector of a storage unit which is adjacent to the first image block in a spatial domain as candidate motion information added into a spatial domain candidate list, and selecting the motion information of the first image block from a plurality of candidate motion information in the spatial domain candidate list.

60. The video processing device of claim 59, wherein the spatial neighboring block comprises an image block immediately adjacent to the first image block.

61. The video processing device of claim 59, wherein the spatial neighboring block comprises an image block that is at least one pixel apart from the first image block.

62. The video processing apparatus of claim 59, wherein the exponential form comprises a mantissa exponential form.

63. The video processing apparatus of claim 62, wherein the mantissa in the mantissa exponential form is stored using a first predetermined number of bits, and the exponent in the mantissa exponential form is stored using a second predetermined number of bits.

64. The video processing device of claim 63, wherein the first predetermined number of bits is 6 bits.

65. The video processing apparatus of claim 63 or 64, wherein the second predetermined number of bits is 4 bits.

66. The video processing apparatus of claim 63, wherein a sum of the first predetermined number of bits and the second predetermined number of bits is less than a number of bits occupied when the motion information is stored in binary.

67. The video processing apparatus of claim 59, wherein the storage unit size is M x N, where M, N satisfy the following condition:

m is greater than the minimum lateral size of all image blocks of the current frame, and/or,

n is greater than the minimum vertical size of all image blocks of the current frame.

68. The video processing device of claim 67, wherein M and N are positive integer multiples of i, where i is a minimum lateral dimension or a minimum longitudinal dimension of the all image blocks.

69. The video processing device of claim 68, wherein the i is the smaller of the smallest horizontal dimension or the smallest vertical dimension of all image blocks.

70. The video processing apparatus of claim 67 or 69, wherein the storage unit size is 4 x 8.

71. The video processing apparatus of claim 67 or 69, wherein the storage unit size is 8 x 4.

72. The video processing apparatus of claim 67 or 69, wherein the storage unit size is 8 x 8.

73. The video processing apparatus of claim 67, wherein the motion information storage module is configured to:

when the storage unit corresponds to a plurality of image blocks, the motion information of one image block is stored corresponding to the storage unit.

74. The video processing apparatus of claim 67, wherein the motion information storage module is configured to:

and only storing the motion information of the image block where the coordinate position of the storage unit is located corresponding to the storage unit.

75. The video processing apparatus of claim 67, wherein each candidate motion information corresponds to a memory unit size of MxN.

76. The video processing apparatus of claim 59, wherein the motion information obtaining module is configured to obtain a plurality of motion information for a first image block of the current frame.

77. The video processing apparatus of claim 76 wherein the first image block comprises a plurality of sub image blocks, at least one of the motion information of each of the sub image blocks.

78. The video processing device of claim 77, each of the sub image blocks corresponding to at least one storage unit; the motion information storage module is used for storing the motion information of the sub image blocks corresponding to the storage units of the sub image blocks.

79. A video processing apparatus, comprising:

a memory; and

a processor coupled to the memory, the processor configured to perform the video processing method of any of claims 1-19 based on instructions stored in the memory.

80. A video processing apparatus, comprising:

a memory; and

a processor coupled to the memory, the processor configured to perform the video processing method of any of claims 20-39 based on instructions stored in the memory.

81. A computer storage medium for storing program code, the program code being executable by a processor for implementing the method of any one of claims 1 to 19.

82. A computer storage medium storing program code for execution by a processor to implement the method of any one of claims 20 to 39.

Images