+

CN113489998A - Deblocking filtering method and device, electronic equipment and medium - Google Patents

Deblocking filtering method and device, electronic equipment and medium Download PDF

Info

Publication number
CN113489998A
CN113489998A CN202110584494.2A CN202110584494A CN113489998A CN 113489998 A CN113489998 A CN 113489998A CN 202110584494 A CN202110584494 A CN 202110584494A CN 113489998 A CN113489998 A CN 113489998A
Authority
CN
China
Prior art keywords
sub
block
filtering
blocks
lcu
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN202110584494.2A
Other languages
Chinese (zh)
Inventor
向国庆
黄菊
张鹏
王邵康
宋磊
贾惠柱
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Hangzhou Boya Hongtu Video Technology Co ltd
Original Assignee
Hangzhou Boya Hongtu Video Technology Co ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Hangzhou Boya Hongtu Video Technology Co ltd filed Critical Hangzhou Boya Hongtu Video Technology Co ltd
Priority to CN202110584494.2A priority Critical patent/CN113489998A/en
Publication of CN113489998A publication Critical patent/CN113489998A/en
Pending legal-status Critical Current

Links

Images

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/85Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using pre-processing or post-processing specially adapted for video compression
    • H04N19/86Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using pre-processing or post-processing specially adapted for video compression involving reduction of coding artifacts, e.g. of blockiness
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/42Methods or arrangements for coding, decoding, compressing or decompressing digital video signals characterised by implementation details or hardware specially adapted for video compression or decompression, e.g. dedicated software implementation
    • H04N19/439Methods or arrangements for coding, decoding, compressing or decompressing digital video signals characterised by implementation details or hardware specially adapted for video compression or decompression, e.g. dedicated software implementation using cascaded computational arrangements for performing a single operation, e.g. filtering

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Computing Systems (AREA)
  • Theoretical Computer Science (AREA)
  • Compression Or Coding Systems Of Tv Signals (AREA)

Abstract

本申请提供一种去块效应滤波方法、装置、电子设备及存储介质。其中,所述方法包括:对当前视频帧按照最大编码单元LCU进行划分,得到多个LCU;根据光栅扫描顺序和相邻LCU之间的滤波依赖关系,将当前LCU划分为多个子块;对所述多个子块中满足滤波依赖关系的子块进行去块效应滤波,将剩余的子块存储于对应的行缓存中,以等待之后存在滤波依赖关系的LCU滤波时一同处理。相较于现有技术,本申请能够利用LCU级缓存,实现硬件编码器中高效的去块效应滤波。

Figure 202110584494

The present application provides a deblocking filtering method, apparatus, electronic device and storage medium. The method includes: dividing the current video frame according to the largest coding unit LCU to obtain multiple LCUs; dividing the current LCU into multiple sub-blocks according to the raster scanning order and the filtering dependency between adjacent LCUs; Deblocking filtering is performed on the sub-blocks that satisfy the filtering dependency among the multiple sub-blocks, and the remaining sub-blocks are stored in the corresponding line buffer to be processed together when the LCUs with the filtering dependency are filtered later. Compared with the prior art, the present application can utilize the LCU-level cache to realize efficient deblocking filtering in the hardware encoder.

Figure 202110584494

Description

Deblocking filtering method and device, electronic equipment and medium
Technical Field
The present application relates to the field of video encoding and decoding technologies, and in particular, to a deblocking filtering method and apparatus, an electronic device, and a storage medium.
Background
The main role of video coding and decoding techniques is to pursue the highest possible video reconstruction quality and compression ratio within the available computational resources.
In video reconstruction, varying degrees of inter-block discontinuous distortion, known as "blockiness", often occur. A loop filtering algorithm in a video coding frame is used for reducing distortion of a reconstructed video, wherein a DBK (deblocking Filter) module is used for relieving a blocking effect phenomenon visible to human eyes, and the blocking effect caused by block compression can be effectively improved and the subjective quality of an image is improved by filtering block boundaries.
And achieving better image coding quality by vertically and horizontally filtering the boundary of the optimal division unit and the minimum filtering block. The DBK module is one of the modules that is very data dependent. When a hardware encoder is designed, the unbalancedness of the division of Coding blocks and the problem of vertical and horizontal filtering order specified by a relevant standard cause that the brightness and the chroma of an LCU (Largest Coding Unit) block level have very strong data dependence, so that the design difficulty is very high when the flow parallel is considered, and the data throughput rate is difficult to improve due to the data dependence.
Disclosure of Invention
The present application provides a deblocking filtering method, apparatus, electronic device, and storage medium, so as to implement efficient deblocking filtering in a hardware encoder.
A first aspect of the present application provides a deblocking filtering method, including:
dividing a current video frame according to a Largest Coding Unit (LCU) to obtain a plurality of LCUs;
dividing the current LCU into a plurality of sub-blocks according to the raster scanning sequence and the filtering dependency relationship between adjacent LCUs;
performing deblocking effect filtering on the subblocks meeting the filtering dependency relationship among the subblocks, and storing the rest subblocks in corresponding line caches to wait for simultaneous processing when LCU filtering with the filtering dependency relationship exists later;
the subblocks satisfying the filtering dependency relationship refer to subblocks having a filtering dependency relationship with a neighboring LCU.
A second aspect of the present application provides a deblocking filter apparatus, including:
the LCU dividing module is used for dividing the current video frame according to the largest coding unit LCU to obtain a plurality of LCUs;
the sub-block dividing module is used for dividing the current LCU into a plurality of sub-blocks according to the raster scanning sequence and the filtering dependency relationship between adjacent LCUs;
the filtering module is used for performing deblocking effect filtering on the subblocks meeting the filtering dependency relationship among the subblocks, and storing the rest subblocks in the corresponding line cache so as to wait for the LCU filtering with the filtering dependency relationship to be processed together;
the subblocks satisfying the filtering dependency relationship refer to subblocks having a filtering dependency relationship with a neighboring LCU.
A third aspect of the present application provides an electronic device comprising: memory, a processor and a computer program stored on the memory and executable on the processor, the processor executing the computer program when executing the computer program to perform the method of the first aspect of the application.
A fourth aspect of the present application provides a computer readable medium having computer readable instructions stored thereon which are executable by a processor to implement the method of the first aspect of the present application.
Compared with the prior art, the deblocking filtering method provided by the application obtains a plurality of LCUs by dividing the current video frame according to the largest coding unit LCU; dividing the current LCU into a plurality of sub-blocks according to the raster scanning sequence and the filtering dependency relationship between adjacent LCUs; and performing deblocking filtering on the subblocks meeting the filtering dependency relationship among the subblocks, and storing the rest subblocks in corresponding line caches to wait for simultaneous processing during LCU filtering with the filtering dependency relationship.
Drawings
Various other advantages and benefits will become apparent to those of ordinary skill in the art upon reading the following detailed description of the preferred embodiments. The drawings are only for purposes of illustrating the preferred embodiments and are not to be construed as limiting the application. Also, like reference numerals are used to refer to like parts throughout the drawings. In the drawings:
fig. 1 illustrates a flow chart of a deblocking filtering method provided in some embodiments of the present application;
fig. 2 illustrates a schematic diagram of video frame partitioning LCU blocks provided by some embodiments of the present application;
FIG. 3 illustrates a schematic diagram of a deblocking filter apparatus according to some embodiments of the present application;
FIG. 4 illustrates a schematic diagram of an electronic device provided by some embodiments of the present application;
FIG. 5 illustrates a schematic diagram of a computer-readable storage medium provided by some embodiments of the present application.
Detailed Description
Exemplary embodiments of the present disclosure will be described in more detail below with reference to the accompanying drawings. While exemplary embodiments of the present disclosure are shown in the drawings, it should be understood that the present disclosure may be embodied in various forms and should not be limited to the embodiments set forth herein. Rather, these embodiments are provided so that this disclosure will be thorough and complete, and will fully convey the scope of the disclosure to those skilled in the art.
It is to be noted that, unless otherwise specified, technical or scientific terms used herein shall have the ordinary meaning as understood by those skilled in the art to which this application belongs.
In addition, the terms "first" and "second", etc. are used to distinguish different objects, rather than to describe a particular order. Furthermore, the terms "include" and "have," as well as any variations thereof, are intended to cover non-exclusive inclusions. For example, a process, method, system, article, or apparatus that comprises a list of steps or elements is not limited to only those steps or elements listed, but may alternatively include other steps or elements not listed, or inherent to such process, method, article, or apparatus.
To further illustrate aspects of embodiments of the present application, reference is made to the following description taken in conjunction with the accompanying drawings. It is to be understood that, in the following embodiments, the same or corresponding contents may be mutually referred to, and for simplicity and convenience of description, the subsequent descriptions are not repeated.
Embodiments of the present application provide a deblocking filtering method and apparatus, an electronic device, and a computer-readable storage medium, which are described below with reference to the accompanying drawings.
Please refer to fig. 1, which illustrates a flowchart of a deblocking filtering method according to some embodiments of the present application, the method can be applied to a DBK module of a hardware encoder, for example, AVS3
(Advanced Video Coding ) hardware encoder.
As shown in fig. 1, the deblocking filtering method may include the following steps:
step S101: dividing a current video frame according to a Largest Coding Unit (LCU) to obtain a plurality of LCUs;
step S102: dividing the current LCU into a plurality of sub-blocks according to the raster scanning sequence and the filtering dependency relationship between adjacent LCUs;
step S103: performing deblocking effect filtering on subblocks meeting the filtering dependency relationship among the subblocks, and storing the rest subblocks in corresponding line caches to wait for simultaneous processing when LCU filtering with the filtering dependency relationship exists later; the sub-blocks satisfying the filtering dependency relationship refer to sub-blocks having a filtering dependency relationship with a previous neighboring LCU.
The above steps will be described in detail.
In order to be able to implement the deblocking filtering in a hardware encoder, the frame level buffer needs to be rewritten to the LCU level buffer.
The original image of the whole frame is stored in a buffer space of a frame level, and pixel point values and other coding information of corresponding positions of each coding block in each area can be obtained at any time. After the hardware environment is changed, the space cannot be buffered, and meanwhile, in order to improve the throughput rate, each LCU is traversed, so that the buffer space is changed to the LCU-level buffer, and thus the video frames are divided according to the LCUs in step S101. As shown in fig. 2, for example, the size of a video frame is 128x128, and the size of an LCU is 64x64, and the video frame is divided by the LCU to obtain 4 LCUs. Since the original vertical-to-horizontal filtering order cannot be changed, otherwise the standard decoder cannot decode, so that strong data dependency is generated.
In step S102, the raster scanning sequence is from left to right, from top to bottom, first scanning a line, and then moving to the starting position of the next line to continue scanning. In the present application, lines of LCUs in a video frame are deblock filtered in a raster scan order.
As shown in fig. 2, after the LCU level buffering is changed, one LCU is buffered each time for deblocking filtering, in the present application, the LCU is further divided into a plurality of sub-blocks according to the filter dependency relationship, that is, the buffer space of the LCU is divided into four parts, 1, 2, 3, and 4, and the deblocking filtering is performed on the pixel region of the sub-blocks. First, vertical and horizontal filtering of sub-block 1 is performed, and vertical filtering of sub-block 2 needs to depend on sub-block 5, and sub-block 5 waits for the next cycle until the second LCU (5, 6, 7, 8) can obtain its pixel value, so that it must wait for the next cycle to complete filtering with the second LCU, and similarly, sub-block 6 also depends on the next LCU to perform filtering together. The vertical filtering of sub-block 3 has no dependency, but the horizontal filtering depends on the pixel values of sub-block 9, so that the full filtering can only be done by waiting for the loop to go right below the next row of LCUs.
In particular, sub-block 4 has a dual dependency, depending on both sub-block 7 and sub-block 10, wherein vertical filtering depends on sub-block 7 and horizontal filtering depends on sub-block 10, while sub-block 7 horizontal filtering depends on sub-block 13 and sub-block 10 vertical filtering depends on sub-block 13, so that it is necessary to wait until the next row of LCUs (13, 14, 15, 16) are filtered together to complete the complete filtering of sub-blocks 4, 7, 10.
As shown in fig. 2, the sizes of the sub-blocks 1, 2, 3, 4 are determined according to the encoding standard.
In step S103, as shown in fig. 2, for a video frame with a resolution of 128 × 128, the filtering order of the present application is as follows:
1. firstly, carrying out vertical and horizontal filtering on a subblock 1(60x60), and respectively caching subblocks 2, 3 and 4;
2. the next cycle enters a second LCU, sub-block 2 is taken out, vertical and horizontal filtering of sub-blocks 2, 5 and 6 is completed, and sub-blocks 7 and 8 are stored;
3. entering the first LCU in the next row, taking out the sub-block 3, finishing the vertical and horizontal filtering of the sub-blocks 3, 9 and 11, and storing the sub-blocks 10 and 12;
4. the second LCU (13, 14, 15, 16) in the second row is entered and sub-blocks 4, 7, 8, 10, 12 are fetched, the sub-blocks (4, 7, 8, 10, 13, 14, 12, 15, 16) being jointly filtered vertically and horizontally.
In some embodiments of the present application, the plurality of sub-blocks includes a first sub-block, a second sub-block, a third sub-block, and a fourth sub-block; the second sub-block is located at the right side of the first sub-block, the third sub-block is located at the lower side of the first sub-block, and the fourth sub-block is located at the lower right side of the first sub-block, as shown in fig. 2 as 1, 2, 3 and 4.
Before step S103, the method further includes:
according to the size of the video frame and the size of the LCU, line caches with corresponding quantities are set for the second sub-block, the third sub-block and the fourth sub-block, and the method specifically comprises the following steps:
setting the number of line caches corresponding to the second sub-block to be 1;
setting the number of line caches corresponding to the third sub-block to be A/B;
setting the number of line caches corresponding to the fourth sub-block to be A/B + 1;
where A represents the width of the video frame and B represents the width of the LCU.
The width of the video frame in fig. 2 is 128 and the width of the LCU is 64.
For example, in the AVS3 standard, it is specified that the order of vertical and horizontal filtering cannot be changed, otherwise decoding cannot be done with a standard decoder. Therefore, a great deal of data dependency problem exists in the frame level cache changed into the LCU cache and needs to be solved, the data dependency problem can be solved by setting a line cache (linebuffer), and the problem of the data dependency of the filtering of the boundary of the adjacent block can be solved with the lowest storage cost as possible by caching the filtering boundary and multiplexing and updating to a certain extent. A dedicated line cache is therefore required to store sub-blocks 2 and 3, where the line cache of sub-block 2 (size 60x4) requires only one, while the line cache of sub-block 3 (size 4x60) requires waiting for one line of LCUs, thus requiring 128/64 (i.e. 2), in particular sub-block 4 (size 4x4) requires setting (128/64+1) (i.e. 3). By setting these line buffers, the multiple data dependency problem can be solved smoothly.
Based on H264 or HEVC (High Efficiency Video Coding), the scheme is different from that of the DBK in the AVS3 standard, the division mode and the filtering scale of the AVS3 Coding block are complex, the maximum complexity of the optimal division tree of the Coding block is higher, and the existing method cannot meet the real-time performance requirement of the DBK hardware module under AVS 3.
In some embodiments of the present application, step S103 may be implemented as: and performing deblocking effect filtering on the current sub-block and the sub-blocks which have filtering dependency relationship with the current sub-block by adopting multiple filtering kernels.
Further, the step of performing deblocking filtering on the current subblock and subblocks having filtering dependency relationship with the current subblock by using multiple filtering kernels can be realized as follows:
dividing the current sub-block and the sub-block which has a filtering dependency relationship with the current sub-block into a luminance component and a chrominance component;
and respectively adopting multiple filtering kernels to simultaneously carry out deblocking filtering on the brightness component and the chrominance component.
In the present application, in order to improve the efficiency of deblocking filtering, a high-efficiency multi-level parallel pipeline scheme is adopted, including the parallel of multiple filtering kernels and the parallel of luminance and chrominance filtering.
And (3) parallel of multiple filtering kernels: for example, 4 filter kernels are provided, each filter kernel processes 1/4 LCUs, the filter function is divided into four parts, parallel processing is performed, and the filter operation of the complete LCU is performed synchronously. The number of filter kernels can be chosen according to the actual situation.
Parallelism of luma and chroma filtering: in the conventional implementation, the filtering of the luminance component is performed first, and then the filtering of the chrominance component is performed. In fact, different buffer spaces exist for the luminance component pixels and the chrominance component pixels, and data dependency does not exist during filtering, so that luminance and chrominance filtering operations can be directly realized in parallel. For example, 4 filter kernels for luminance and chrominance filtering are provided, respectively.
The deblocking filtering method provided by the application can successfully complete frame level cache rewriting into LCU level cache, solve the problem of vertical and horizontal filtering dependency, and realize an efficient parallel pipeline scheme. The problem of complex data dependency is solved by arranging a plurality of line caches, a multilevel parallel pipeline scheme with parallel brightness and chrominance and parallel multi-filtering cores is provided, a pipeline parallel framework of deblocking filtering can be realized with high concurrency and low resource number, and the performance requirement of real-time processing of high-definition videos is met.
In the foregoing embodiments, a deblocking filtering method is provided, and accordingly, a deblocking filtering apparatus is also provided. Please refer to fig. 3, which illustrates a schematic diagram of a deblocking filter apparatus according to some embodiments of the present application. Since the apparatus embodiments are substantially similar to the method embodiments, they are described in a relatively simple manner, and reference may be made to some of the descriptions of the method embodiments for relevant points. The device embodiments described below are merely illustrative.
As shown in fig. 3, the deblocking filter apparatus 10 includes:
an LCU partitioning module 101, configured to partition a current video frame according to a largest coding unit LCU to obtain multiple LCUs;
a sub-block dividing module 102, configured to divide a current LCU into a plurality of sub-blocks according to a raster scanning order and a filtering dependency relationship between adjacent LCUs;
the filtering module 103 is configured to perform deblocking filtering on sub-blocks that satisfy a filtering dependency relationship among the plurality of sub-blocks, and store remaining sub-blocks in corresponding line caches, so as to wait for processing together when an LCU having a filtering dependency relationship is filtered later;
the sub-blocks satisfying the filtering dependency relationship refer to sub-blocks having a filtering dependency relationship with a previous neighboring LCU.
According to some embodiments of the present application, the plurality of sub-blocks includes a first sub-block, a second sub-block, a third sub-block, and a fourth sub-block; the second sub-block is positioned at the right side of the first sub-block, the third sub-block is positioned at the lower side of the first sub-block, and the fourth sub-block is positioned at the lower right side of the first sub-block;
the device further comprises:
and the setting module is used for setting line caches with corresponding quantities for the second sub-block, the third sub-block and the fourth sub-block according to the size of the video frame and the size of the LCU before the filtering module carries out deblocking filtering on the sub-blocks which meet the filtering dependency relationship among the plurality of sub-blocks.
According to some embodiments of the present application, the setting module is specifically configured to:
setting the number of line caches corresponding to the second sub-block to be 1;
setting the number of line caches corresponding to the third sub-block to be A/B;
setting the number of line caches corresponding to the fourth sub-block to be A/B + 1;
where A represents the width of the video frame and B represents the width of the LCU.
According to some embodiments of the present application, the filtering module 103 is specifically configured to:
and performing deblocking effect filtering on the current sub-block and the sub-blocks which have filtering dependency relationship with the current sub-block by adopting multiple filtering kernels.
According to some embodiments of the present application, the filtering module 103 is further configured to:
dividing the current sub-block and the sub-block which has a filtering dependency relationship with the current sub-block into a luminance component and a chrominance component;
and respectively adopting multiple filtering kernels to simultaneously carry out deblocking filtering on the brightness component and the chrominance component.
The deblocking filter device provided by the embodiment of the application and the deblocking filter method provided by the previous embodiment of the application have the same beneficial effects based on the same inventive concept.
The present disclosure further provides an electronic device, such as a mobile phone, a notebook computer, a tablet computer, a desktop computer, etc., corresponding to the deblocking filtering method provided in the foregoing embodiments, so as to execute the deblocking filtering method.
Referring to fig. 4, a schematic diagram of an electronic device provided in some embodiments of the present application is shown. As shown in fig. 4, the electronic device 20 includes: the system comprises a processor 200, a memory 201, a bus 202 and a communication interface 203, wherein the processor 200, the communication interface 203 and the memory 201 are connected through the bus 202; the memory 201 stores a computer program that can be executed on the processor 200, and the processor 200 executes the computer program to perform the deblocking filtering method provided in any of the foregoing embodiments.
The Memory 201 may include a high-speed Random Access Memory (RAM) and may further include a non-volatile Memory (non-volatile Memory), such as at least one disk Memory. The communication connection between the network element of the system and at least one other network element is realized through at least one communication interface 203 (which may be wired or wireless), and the internet, a wide area network, a local network, a metropolitan area network, and the like can be used.
Bus 202 can be an ISA bus, PCI bus, EISA bus, or the like. The bus may be divided into an address bus, a data bus, a control bus, etc. The memory 201 is used for storing a program, and the processor 200 executes the program after receiving an execution instruction, and the deblocking filtering method disclosed in any of the foregoing embodiments of the present application may be applied to the processor 200, or implemented by the processor 200.
The processor 200 may be an integrated circuit chip having signal processing capabilities. In implementation, the steps of the above method may be performed by integrated logic circuits of hardware or instructions in the form of software in the processor 200. The Processor 200 may be a general-purpose Processor, and includes a Central Processing Unit (CPU), a Network Processor (NP), and the like; but may also be a Digital Signal Processor (DSP), an Application Specific Integrated Circuit (ASIC), an off-the-shelf programmable gate array (FPGA) or other programmable logic device, discrete gate or transistor logic, discrete hardware components. The various methods, steps, and logic blocks disclosed in the embodiments of the present application may be implemented or performed. A general purpose processor may be a microprocessor or the processor may be any conventional processor or the like. The steps of the method disclosed in connection with the embodiments of the present application may be directly implemented by a hardware decoding processor, or implemented by a combination of hardware and software modules in the decoding processor. The software module may be located in ram, flash memory, rom, prom, or eprom, registers, etc. storage media as is well known in the art. The storage medium is located in the memory 201, and the processor 200 reads the information in the memory 201 and completes the steps of the method in combination with the hardware thereof.
The electronic device provided by the embodiment of the present application and the deblocking filtering method provided by the embodiment of the present application have the same inventive concept, and have the same beneficial effects as the method adopted, operated or implemented by the electronic device.
Referring to fig. 5, the computer readable storage medium is an optical disc 30, and a computer program (i.e., a program product) is stored thereon, and when being executed by a processor, the computer program performs the deblocking filtering method according to any of the foregoing embodiments.
It should be noted that examples of the computer-readable storage medium may also include, but are not limited to, phase change memory (PRAM), Static Random Access Memory (SRAM), Dynamic Random Access Memory (DRAM), other types of Random Access Memory (RAM), Read Only Memory (ROM), Electrically Erasable Programmable Read Only Memory (EEPROM), flash memory, or other optical and magnetic storage media, which are not described in detail herein.
The computer-readable storage medium provided by the above-mentioned embodiments of the present application and the deblocking filtering method provided by the embodiments of the present application have the same beneficial effects as the method adopted, executed or implemented by the application program stored in the computer-readable storage medium.
Finally, it should be noted that: the above embodiments are only used for illustrating the technical solutions of the present application, and not for limiting the same; although the present application has been described in detail with reference to the foregoing embodiments, it should be understood by those of ordinary skill in the art that: the technical solutions described in the foregoing embodiments may still be modified, or some or all of the technical features may be equivalently replaced; such modifications and substitutions do not depart from the spirit and scope of the present disclosure, and the present disclosure should be construed as being covered by the claims and the specification.

Claims (10)

1.一种去块效应滤波方法,其特征在于,包括:1. A deblocking filtering method, characterized in that, comprising: 对当前视频帧按照最大编码单元LCU进行划分,得到多个LCU;Divide the current video frame according to the largest coding unit LCU to obtain multiple LCUs; 根据光栅扫描顺序和相邻LCU之间的滤波依赖关系,将当前LCU划分为多个子块;Divide the current LCU into multiple sub-blocks according to the raster scan order and the filtering dependencies between adjacent LCUs; 对所述多个子块中满足滤波依赖关系的子块进行去块效应滤波,将剩余的子块存储于对应的行缓存中,以等待之后存在滤波依赖关系的LCU滤波时一同处理;Deblocking filtering is performed on the sub-blocks that satisfy the filtering dependency among the plurality of sub-blocks, and the remaining sub-blocks are stored in the corresponding line buffer, and are processed together while waiting for the LCU filtering with the filtering dependency afterward; 所述满足滤波依赖关系的子块是指与相邻LCU之间存在滤波依赖关系的子块。The sub-blocks that satisfy the filtering dependency refer to the sub-blocks that have filtering dependencies with adjacent LCUs. 2.根据权利要求1所述的方法,其特征在于,所述多个子块中包括第一子块、第二子块、第三子块和第四子块;其中,第二子块位于第一子块的右侧,第三子块位于第一子块的下侧,第四子块位于第一子块的右下方;2 . The method according to claim 1 , wherein the plurality of sub-blocks comprises a first sub-block, a second sub-block, a third sub-block and a fourth sub-block; wherein the second sub-block is located in the first sub-block. 3 . The right side of a sub-block, the third sub-block is located at the lower side of the first sub-block, and the fourth sub-block is located at the lower right of the first sub-block; 在对所述多个子块中满足滤波依赖关系的子块进行去块效应滤波之前,所述方法还包括:Before performing deblocking filtering on sub-blocks that satisfy the filtering dependency among the plurality of sub-blocks, the method further includes: 根据视频帧的尺寸和LCU的尺寸,对第二子块、第三子块和第四子块设置对应数量的行缓存。According to the size of the video frame and the size of the LCU, a corresponding number of line buffers are set for the second sub-block, the third sub-block and the fourth sub-block. 3.根据权利要求2所述的方法,其特征在于,所述根据视频帧的尺寸和LCU的尺寸,对第二子块、第三子块和第四子块设置对应数量的行缓存,包括:3. The method according to claim 2, wherein, according to the size of the video frame and the size of the LCU, a corresponding number of line buffers are set for the second sub-block, the third sub-block and the fourth sub-block, comprising: : 设置第二子块对应的行缓存的数量为1;Set the number of line buffers corresponding to the second sub-block to 1; 设置第三子块对应的行缓存的数量为A/B;Set the number of line buffers corresponding to the third sub-block to A/B; 设置第四子块对应的行缓存的数量为A/B+1;Set the number of line buffers corresponding to the fourth sub-block to A/B+1; 其中,A表示视频帧的宽度,B表示LCU的宽度。Among them, A represents the width of the video frame, and B represents the width of the LCU. 4.根据权利要求1或2所述的方法,其特征在于,所述对所述多个子块中满足滤波依赖关系的子块进行去块效应滤波,包括:4. The method according to claim 1 or 2, wherein the performing deblocking filtering on the sub-blocks that satisfy the filtering dependency among the plurality of sub-blocks comprises: 将当前子块以及与当前子块存在滤波依赖关系的子块,采用多滤波核同时进行去块效应滤波。The current sub-block and the sub-blocks that have a filtering dependency with the current sub-block are simultaneously deblocked by using multiple filtering kernels. 5.根据权利要求4所述的方法,其特征在于,所述将当前子块以及与当前子块存在滤波依赖关系的子块,采用多滤波核同时进行去块效应滤波,包括:5. The method according to claim 4, characterized in that, using multiple filter kernels to simultaneously perform deblocking filtering on the current sub-block and the sub-block having a filtering dependency with the current sub-block, comprising: 将当前子块以及与当前子块存在滤波依赖关系的子块分为亮度分量和色度分量;Divide the current sub-block and the sub-block that has a filtering dependency with the current sub-block into a luminance component and a chrominance component; 对所述亮度分量和色度分量分别采用多滤波核同时进行去块效应滤波。Simultaneous deblocking filtering is performed on the luminance component and the chrominance component using multiple filter kernels. 6.一种去块效应滤波装置,其特征在于,包括:6. A deblocking filtering device, comprising: LCU划分模块,用于对当前视频帧按照最大编码单元LCU进行划分,得到多个LCU;The LCU division module is used to divide the current video frame according to the largest coding unit LCU to obtain multiple LCUs; 子块划分模块,用于根据光栅扫描顺序和相邻LCU之间的滤波依赖关系,将当前LCU划分为多个子块;a sub-block division module, which is used to divide the current LCU into multiple sub-blocks according to the raster scanning order and the filtering dependency between adjacent LCUs; 滤波模块,用于对所述多个子块中满足滤波依赖关系的子块进行去块效应滤波,将剩余的子块存储于对应的行缓存中,以等待之后存在滤波依赖关系的LCU滤波时一同处理;The filtering module is used to perform deblocking filtering on the sub-blocks that satisfy the filtering dependency among the plurality of sub-blocks, and store the remaining sub-blocks in the corresponding line buffers, so as to wait for the LCUs that have the filtering dependency to filter together. deal with; 所述满足滤波依赖关系的子块是指与相邻LCU之间存在滤波依赖关系的子块。The sub-blocks that satisfy the filtering dependency refer to the sub-blocks that have filtering dependencies with adjacent LCUs. 7.根据权利要求6所述的装置,其特征在于,所述多个子块中包括第一子块、第二子块、第三子块和第四子块;其中,第二子块位于第一子块的右侧,第三子块位于第一子块的下侧,第四子块位于第一子块的右下方;7 . The apparatus according to claim 6 , wherein the plurality of sub-blocks comprise a first sub-block, a second sub-block, a third sub-block and a fourth sub-block; wherein the second sub-block is located in the first sub-block. 8 . The right side of a sub-block, the third sub-block is located at the lower side of the first sub-block, and the fourth sub-block is located at the lower right of the first sub-block; 所述装置还包括:The device also includes: 设置模块,用于在所述滤波模块对所述多个子块中满足滤波依赖关系的子块进行去块效应滤波之前,根据视频帧的尺寸和LCU的尺寸,对第二子块、第三子块和第四子块设置对应数量的行缓存。The setting module is used for, before the filtering module performs deblocking filtering on the sub-blocks that satisfy the filtering dependency among the plurality of sub-blocks, according to the size of the video frame and the size of the LCU, the second sub-block, the third sub-block and the third sub-block are The block and the fourth sub-block set the corresponding number of line buffers. 8.根据权利要求7所述的装置,其特征在于,所述设置模块,具体用于:8. The device according to claim 7, wherein the setting module is specifically used for: 设置第二子块对应的行缓存的数量为1;Set the number of line buffers corresponding to the second sub-block to 1; 设置第三子块对应的行缓存的数量为A/B;Set the number of line buffers corresponding to the third sub-block to A/B; 设置第四子块对应的行缓存的数量为A/B+1;Set the number of line buffers corresponding to the fourth sub-block to A/B+1; 其中,A表示视频帧的宽度,B表示LCU的宽度。Among them, A represents the width of the video frame, and B represents the width of the LCU. 9.一种电子设备,包括:存储器、处理器及存储在所述存储器上并可在所述处理器上运行的计算机程序,其特征在于,所述处理器运行所述计算机程序时执行以实现如权利要求1至5中任一项所述的方法。9. An electronic device, comprising: a memory, a processor, and a computer program stored on the memory and executable on the processor, wherein the processor executes the computer program to achieve A method as claimed in any one of claims 1 to 5. 10.一种计算机可读存储介质,其上存储有计算机程序,所述计算机程序在被处理器运行时执行以实现如权利要求1至5中任一项所述的方法。10. A computer-readable storage medium having stored thereon a computer program that, when executed by a processor, executes to implement the method of any one of claims 1 to 5.
CN202110584494.2A 2021-05-27 2021-05-27 Deblocking filtering method and device, electronic equipment and medium Pending CN113489998A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202110584494.2A CN113489998A (en) 2021-05-27 2021-05-27 Deblocking filtering method and device, electronic equipment and medium

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202110584494.2A CN113489998A (en) 2021-05-27 2021-05-27 Deblocking filtering method and device, electronic equipment and medium

Publications (1)

Publication Number Publication Date
CN113489998A true CN113489998A (en) 2021-10-08

Family

ID=77933120

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202110584494.2A Pending CN113489998A (en) 2021-05-27 2021-05-27 Deblocking filtering method and device, electronic equipment and medium

Country Status (1)

Country Link
CN (1) CN113489998A (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN114222120A (en) * 2022-01-17 2022-03-22 北京达佳互联信息技术有限公司 Encoding method and device, decoding method and device

Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101472173A (en) * 2007-12-29 2009-07-01 深圳安凯微电子技术有限公司 Method, system and filter for filtering de-block
CN101924938A (en) * 2010-08-11 2010-12-22 上海交通大学 Processing Method of Adjacent Block Information in Macroblock Prediction and Boundary Filtering of Video Decoding
US20120106622A1 (en) * 2010-11-03 2012-05-03 Mediatek Inc. Method and Apparatus of Slice Grouping for High Efficiency Video Coding
WO2013047325A1 (en) * 2011-09-27 2013-04-04 ソニー株式会社 Image processing device and method
US20140286442A1 (en) * 2013-03-25 2014-09-25 Kwangwoon University Industry-Academic Collaboration Foundation Apparatus and method for in-loop filtering based on largest coding unit for reducing external memory access bandwidth
CN108156460A (en) * 2016-11-17 2018-06-12 联发科技股份有限公司 Video decoding system, video decoding method, and computer storage medium therefor
CN109660797A (en) * 2018-11-09 2019-04-19 北京达佳互联信息技术有限公司 Adaptive filter method, device, electronic equipment and computer-readable medium
CN112312139A (en) * 2019-08-02 2021-02-02 扬智科技股份有限公司 Loop filtering method and decoding device for video decoding

Patent Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101472173A (en) * 2007-12-29 2009-07-01 深圳安凯微电子技术有限公司 Method, system and filter for filtering de-block
CN101924938A (en) * 2010-08-11 2010-12-22 上海交通大学 Processing Method of Adjacent Block Information in Macroblock Prediction and Boundary Filtering of Video Decoding
US20120106622A1 (en) * 2010-11-03 2012-05-03 Mediatek Inc. Method and Apparatus of Slice Grouping for High Efficiency Video Coding
WO2013047325A1 (en) * 2011-09-27 2013-04-04 ソニー株式会社 Image processing device and method
US20140286442A1 (en) * 2013-03-25 2014-09-25 Kwangwoon University Industry-Academic Collaboration Foundation Apparatus and method for in-loop filtering based on largest coding unit for reducing external memory access bandwidth
CN108156460A (en) * 2016-11-17 2018-06-12 联发科技股份有限公司 Video decoding system, video decoding method, and computer storage medium therefor
CN109660797A (en) * 2018-11-09 2019-04-19 北京达佳互联信息技术有限公司 Adaptive filter method, device, electronic equipment and computer-readable medium
CN112312139A (en) * 2019-08-02 2021-02-02 扬智科技股份有限公司 Loop filtering method and decoding device for video decoding

Non-Patent Citations (5)

* Cited by examiner, † Cited by third party
Title
HENG SUN ET AL.,: "LCU-Level bit allocation for rate control in High Efficiency Video Coding", 《2014 IEEE CHINA SUMMIT & INTERNATIONAL CONFERENCE ON SIGNAL AND INFORMATION PROCESSING (CHINASIP)》, 13 July 2014 (2014-07-13) *
RUNLONG KANG ET AL.: "An efficient deblocking filter algorithm for HEVC", 《CHINASIP》 *
冯磊: "数字视频的HEVC编码快速算法的研究", 《中国优秀博士论文电子期刊》, 15 August 2016 (2016-08-15) *
吴超凡: "适用于HEVC的高吞吐率环路滤波器的研究与硬件设计", 《万方》 *
周建政等: "H.265解码器去块滤波并行化设计与性能优化", 《电视技术》 *

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN114222120A (en) * 2022-01-17 2022-03-22 北京达佳互联信息技术有限公司 Encoding method and device, decoding method and device

Similar Documents

Publication Publication Date Title
CN103503456B (en) In-loop processing method and device for reconstructing video
US8913656B2 (en) Method and apparatus for in-loop filtering
KR20210132708A (en) Loop filtering implementation method, apparatus and computer storage medium
CN104584561A (en) Sampling adaptive offset processing method and device applied in video decoder
JP5183664B2 (en) Deblocking apparatus and method for video compression
US20060133504A1 (en) Deblocking filters for performing horizontal and vertical filtering of video data simultaneously and methods of operating the same
JP2017099017A (en) Image decoding apparatus, image coding apparatus, image decoding method, image coding method, program and integrated circuit
CN101573978A (en) Mechanism for parallel processing in-loop deblocking filter
US20090129478A1 (en) Deblocking filter
CN103051892B (en) Embedded loop filtering method and embedded loop filtering device
US8090028B2 (en) Video deblocking memory utilization
KR20220066917A (en) Image dewarping system
JP2015012410A (en) Image decoder
US7680351B2 (en) Video deblocking method and apparatus
CN104521234B (en) Video processing method and apparatus incorporating deblocking processing and sample adaptive offset processing
US20160165238A1 (en) Neighbor tile buffering for deblock filtering across tile boundaries
TWI832449B (en) Method and apparatus for video coding
Li et al. De-blocking filter design for HEVC and H. 264/AVC
CN113489998A (en) Deblocking filtering method and device, electronic equipment and medium
US12382072B2 (en) Luma mapping with chroma scaling for gradual decoding refresh
US20140056363A1 (en) Method and system for deblock filtering coded macroblocks
EP1774467A1 (en) Caching data for video edge filtering
CN113489986A (en) Integer pixel motion estimation method and device, electronic equipment and medium
US20080159637A1 (en) Deblocking filter hardware accelerator with interlace frame support
CN107667529B (en) Method, apparatus, and computer-readable recording medium for efficiently embedded compression of data

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
AD01 Patent right deemed abandoned

Effective date of abandoning: 20250103

AD01 Patent right deemed abandoned
点击 这是indexloc提供的php浏览器服务,不要输入任何密码和下载