WO2022002002A1

WO2022002002A1 - Image processing method, image processing apparatus, electronic device, and storage medium

Info

Publication number: WO2022002002A1
Application number: PCT/CN2021/102912
Authority: WO
Inventors: 徐青松; 李青
Original assignee: 杭州睿琪软件有限公司
Priority date: 2020-07-03
Filing date: 2021-06-29
Publication date: 2022-01-06
Also published as: CN111767924A; CN111767924B

Abstract

An image processing method, an image processing apparatus, an electronic device, and a non-transitory computer readable storage medium. The image processing method comprises: obtaining an original image, wherein the original image comprises at least one object; processing the original image by a first binarization model to obtain a first binarized image of the original image; processing the first binarized image to obtain a pixel circumscribed contour image, wherein the pixel circumscribed contour image comprises a plurality of circumscribed contour pixels, and pixels within an area surrounded by the plurality of circumscribed contour pixels are pixels corresponding to at least part of the objects in the at least one object; processing the original image by a second binarization model to obtain a second binarized image; and according to the positions of the plurality of circumscribed contour pixels in the pixel circumscribed contour image, synthesizing the second binarized image and the first binarized image to obtain a synthesized image, wherein the composite image is a binarized image.

Description

Image processing method, image processing apparatus, electronic device, storage medium

technical field

The present invention relates to the technical field of digital image processing, and in particular, to an image processing method, an image processing apparatus, an electronic device, and a non-transitory computer-readable storage medium.

Background technique

In digital image processing, image binarization processing is to set the gray value of pixels on the image to 0 or 255, and image binarization processing can greatly reduce the amount of data in the image. , so that the outline of the target of interest can be highlighted, and in addition, it is convenient to process and analyze the image, for example, to extract the information in the image.

SUMMARY OF THE INVENTION

At least one embodiment of the present disclosure provides an image processing method, including: acquiring an original image, wherein the original image includes at least one object; and processing the original image by using a first binarization model to obtain the original image The first binarized image of the image; the first binarized image is processed to obtain a pixel circumscribed contour image, wherein the pixel circumscribed contour image includes a plurality of circumscribed contour pixels, and the plurality of circumscribed contour pixels The pixels in the enclosed area are pixels corresponding to at least part of the objects in the at least one object; the original image is processed by a second binarization model to obtain a second binarized image; according to the plurality of objects The position of the circumscribed contour pixel in the pixel circumscribed contour image, and the second binarized image and the first binarized image are synthesized to obtain a synthesized image, wherein the synthesized image is a binary image image.

For example, in the image processing method provided by at least one embodiment of the present disclosure, the original image is processed by the first binarization model to obtain the first binarized image of the original image, including: The original image is compressed to obtain an input image, wherein the size of the input image is smaller than the size of the original image; and the input image is processed by the first binarization model to obtain the The first binarized image of the original image.

For example, in the image processing method provided by at least one embodiment of the present disclosure, processing the input image by using the first binarization model to obtain the first binarized image of the original image includes: The first binarization model processes the input image to obtain a binarized predicted image of the input image; and restores the size of the binarized predicted image to obtain the first binarized image The size of the first binarized image is the same as the size of the original image.

For example, in the image processing method provided in at least one embodiment of the present disclosure, processing the first binarized image to obtain a pixel circumscribed contour image includes: performing blurring processing on the first binarized image , obtain a blurred image; perform XOR processing on the blurred image and the first binarized image to obtain the pixel circumscribed contour image.

For example, in the image processing method provided by at least one embodiment of the present disclosure, according to the positions of the plurality of circumscribed contour pixels in the pixel circumscribed contour image, the second binarized image and the first binary image are analyzed. Synthesizing the binarized images to obtain the synthesized image includes: acquiring the positions of the plurality of circumscribed contour pixels in the pixel circumscribed contour image; extracting the plurality of circumscribed contour pixels in the second binarized image multiple target second binarized pixels at positions corresponding to the positions of the contour pixels; according to the pixel correspondence between the second binarized image and the first binarized image, the second binarized image is The plurality of target second binarized pixels in the image are respectively combined into the same position in the first binarized image to obtain the combined image.

For example, in the image processing method provided by at least one embodiment of the present disclosure, all the second binarized pixels in the second binarized image are arranged in n rows and m columns, and the pixels in the first binarized image are arranged in n rows and m columns. All the first binarized pixels are arranged in n rows and m columns, and all the synthesized pixels in the composite image are arranged in n rows and m columns, according to the pixels of the second binarized image and the first binarized image Corresponding relationship, synthesizing the multiple target second binarized pixels in the second binarized image to the same position in the first binarized image respectively includes: determining the multiple target second binarized pixels. The q th target second binarized pixel in the two binarized pixels, wherein the q th target second binarized pixel is located in the ith row and the jth column of the second binarized image; determine The q-th target first binarized pixel located in the i-th row and j-th column in the first binarized image; replace the grayscale value of the q-th target first binarized pixel with the grayscale value of the second binarized pixel of the q th target, so as to obtain the q th target composite pixel located in the i th row and the j th column in the composite image, wherein the q th target composite pixel The grayscale value of the pixel is the grayscale value of the qth target second binarized pixel, n, m, q, i, and j are all positive integers, and i is less than or equal to n, j is less than or equal to m, and q is less than or equal to is equal to the number of the plurality of target second binarized pixels.

For example, in the image processing method provided by at least one embodiment of the present disclosure, processing the original image by using a second binarization model to obtain a second binarized image includes: performing grayscale on the original image process the grayscale image to obtain a grayscale image; process the grayscale image according to the first threshold to obtain an intermediate binarized image; use the intermediate binarized image as a guide map to perform guided filtering on the grayscale image process to obtain a filtered image; determine high-value pixels in the filtered image according to a second threshold, wherein the gray value of the high-value pixels is greater than the second threshold; The gray value of the high-value pixels is expanded to obtain an expanded image; the expanded image is sharpened to obtain a clear image; and the contrast of the clear image is adjusted to obtain the second binarization image.

For example, in the image processing method provided by at least one embodiment of the present disclosure, the first binarization model is a model based on a neural network.

At least one embodiment of the present disclosure provides an image processing apparatus, including: an acquisition module for acquiring an original image, wherein the original image includes at least one object; and a first binarization module for obtaining an original image through a first binarization The model processes the original image to obtain a first binarized image of the original image; a processing module is used to process the first binarized image to obtain a pixel circumscribed contour image, wherein the The pixel circumscribed contour image includes a plurality of circumscribed contour pixels, and the pixels in the area surrounded by the plurality of circumscribed contour pixels are pixels corresponding to at least part of the objects in the at least one object; the second binarization module is configured to pass The second binarization model processes the original image to obtain a second binarized image; the synthesis module is configured to, according to the positions of the plurality of circumscribed contour pixels in the pixel circumscribed contour image, analyze the The second binarized image and the first binarized image are combined to obtain the combined image, wherein the combined image is a binarized image.

For example, in the image processing apparatus provided in at least one embodiment of the present disclosure, the first binarization module performs processing on the original image through a first binarization model, so as to obtain the first two images of the original image. The operation of binarizing the image includes performing the following operations: compressing the original image to obtain an input image, wherein the size of the input image is smaller than the size of the original image; The model processes the input image to obtain a first binarized image of the original image.

For example, in the image processing apparatus provided in at least one embodiment of the present disclosure, the first binarization module performs processing on the input image by using the first binarization model, so as to obtain a second image of the original image. The operation of a binarized image includes performing the following operations: processing the input image by using the first binarization model to obtain a binarized predicted image of the input image; The predicted image is resized to obtain the first binarized image, wherein the size of the first binarized image is the same as the size of the original image.

For example, in the image processing apparatus provided in at least one embodiment of the present disclosure, when the processing module performs the operation of processing the first binarized image to obtain a pixel circumscribed contour image, the operation includes performing the following operations: performing a blurring process on the first binarized image to obtain a blurred image; and performing XOR processing on the blurred image and the first binarized image to obtain the pixel circumscribed contour image.

For example, in the image processing apparatus provided by at least one embodiment of the present disclosure, the synthesizing module performs, according to the positions of the plurality of circumscribed contour pixels in the pixel circumscribed contour image, the second binarized image and the When the first binarized image is synthesized to obtain a synthesized image of the original image, the operation includes performing the following operations: obtaining the positions of the plurality of circumscribed contour pixels in the pixel circumscribed contour image; multiple target second binarized pixels at positions corresponding to the positions of the plurality of circumscribed contour pixels in the second binarized image; according to the second binarized image and the first binarized The pixel correspondence of the image, the multiple target second binarized pixels in the second binarized image are respectively synthesized into the same position in the first binarized image to obtain the original image composite image.

For example, in the image processing apparatus provided in at least one embodiment of the present disclosure, all the second binarized pixels in the second binarized image are arranged in n rows and m columns, and the pixels in the first binarized image are arranged in n rows and m columns. All the first binarized pixels are arranged in n rows and m columns, and all the synthesized pixels in the composite image are arranged in n rows and m columns, and the composite module executes the process according to the second binarized image and the first binarized image. The pixel correspondence relationship of the binarized image, and the operation of synthesizing the plurality of target second binarized pixels in the second binarized image to the same position in the first binarized image respectively includes: performing the following operations: determining the qth target second binarization pixel in the plurality of target second binarization pixels, wherein the qth target second binarization pixel is located in the second binarization pixel The i-th row and the j-th column of the binarized image are determined; the q-th target first binarized pixel located in the i-th row and the j-th column in the first binarized image is determined; the q-th target first binarized pixel is The gray-level value of a binarized pixel is replaced with the gray-level value of the q-th target second binarized pixel, so as to obtain the q-th target composite in the i-th row and j-th column in the composite image pixel, wherein the grayscale value of the qth target composite pixel is the grayscale value of the qth target second binarized pixel, n, m, q, i, and j are all positive integers, and i is less than or equal to n, j is less than or equal to m, and q is less than or equal to the number of the plurality of target second binarized pixels.

For example, in the image processing apparatus provided in at least one embodiment of the present disclosure, the second binarization module includes: a grayscale module, configured to perform grayscale processing on the original image to obtain a grayscale image; an intermediate The binarization module is used to process the grayscale image according to the first threshold to obtain an intermediate binarized image; the filtering module is used to take the intermediate binarized image as a guide map, and to process the grayscale image. The image is subjected to guided filtering processing to obtain a filtered image; a determination module is configured to determine high-value pixels in the filtered image according to a second threshold, wherein the gray value of the high-value pixels is greater than the second threshold The expansion module is used to expand the gray value of the high-value pixel points according to the preset expansion coefficient to obtain an expanded image; the clearing module is used to clear the expanded image to obtain a clear image. , and adjust the contrast of the clear image to obtain the second binarized image.

At least one embodiment of the present disclosure provides an electronic device, comprising: a memory for non-transitory storage of computer-readable instructions; a processor for executing the computer-readable instructions, the computer-readable instructions being executed by the The image processing method according to any embodiment of the present disclosure is implemented when the processor runs.

At least one embodiment of the present disclosure provides a non-transitory computer-readable storage medium, wherein the non-transitory computer-readable storage medium stores computer-readable instructions that, when executed by a processor, implement a The image processing method described in any embodiment of the present disclosure.

Description of drawings

In order to explain the technical solutions of the embodiments of the present disclosure more clearly, the accompanying drawings of the embodiments will be briefly introduced below. Obviously, the drawings in the following description only relate to some embodiments of the present disclosure, rather than limit the present disclosure. .

FIG. 1 is a schematic flowchart of an image processing method provided by at least one embodiment of the present disclosure;

FIG. 2 is a schematic diagram of an original image provided by at least one embodiment of the present disclosure;

FIG. 3 shows an input image provided by an embodiment of the present disclosure;

FIG. 4 is a schematic diagram of a first binarized image provided by an embodiment of the present disclosure;

FIG. 5 is a schematic diagram of a blurred image provided by an embodiment of the present disclosure;

FIG. 6 is a pixel circumscribed contour image provided by an embodiment of the present disclosure;

FIG. 7 is a schematic diagram of a second binarized image according to an embodiment of the present disclosure;

FIG. 8 is a schematic diagram of a composite image provided by an embodiment of the present disclosure;

FIG. 9 is a schematic block diagram of an image processing apparatus according to at least one embodiment of the present disclosure;

10 is a schematic block diagram of an electronic device according to at least one embodiment of the present disclosure;

11 is a schematic diagram of a non-transitory computer-readable storage medium provided by at least one embodiment of the present disclosure;

FIG. 12 is a schematic diagram of a hardware environment provided by at least one embodiment of the present disclosure.

detailed description

In order to make the purposes, technical solutions and advantages of the embodiments of the present disclosure more clear, the technical solutions of the embodiments of the present disclosure will be clearly and completely described below with reference to the accompanying drawings of the embodiments of the present disclosure. Obviously, the described embodiments are some, but not all, embodiments of the present disclosure. Based on the described embodiments of the present disclosure, all other embodiments obtained by those of ordinary skill in the art without creative efforts fall within the protection scope of the present disclosure.

Unless otherwise defined, technical or scientific terms used in this disclosure shall have the ordinary meaning as understood by one of ordinary skill in the art to which this disclosure belongs. As used in this disclosure, "first," "second," and similar terms do not denote any order, quantity, or importance, but are merely used to distinguish the various components. "Comprises" or "comprising" and similar words mean that the elements or things appearing before the word encompass the elements or things recited after the word and their equivalents, but do not exclude other elements or things. Words like "connected" or "connected" are not limited to physical or mechanical connections, but may include electrical connections, whether direct or indirect. "Up", "Down", "Left", "Right", etc. are only used to represent the relative positional relationship, and when the absolute position of the described object changes, the relative positional relationship may also change accordingly.

In order to keep the following description of the embodiments of the present disclosure clear and concise, the present disclosure omits a detailed description of some well-known functions and well-known components.

At least one embodiment of the present disclosure provides an image processing method, an image processing apparatus, an electronic device, and a non-transitory computer-readable storage medium. The image processing method includes: acquiring an original image, wherein the original image includes at least one object; processing the original image through a first binarization model to obtain a first binarized image of the original image; Perform processing to obtain a pixel circumscribed contour image, wherein the pixel circumscribed contour image includes a plurality of circumscribed contour pixels, and the pixels in the area surrounded by the plurality of circumscribed contour pixels are pixels corresponding to at least part of the at least one object; The binarization model processes the original image to obtain a second binarized image; the second binarized image and the first binarized image are synthesized according to the positions of multiple circumscribed contour pixels in the pixel circumscribed contour image , to get a composite image of the original image. For example, the composite image is a binarized image.

The image processing method can convert an original image (for example, a color image or an unclear image) into a binarized image with obvious and clear black and white contrast, which can effectively improve the quality of the binarized image and improve the recognition degree of the image content. In addition, since the converted image has less noise and obvious black and white contrast, it can effectively improve the printing effect.

It should be noted that the image processing method provided by the embodiment of the present disclosure can be applied to the image processing apparatus provided by the embodiment of the present disclosure, and the image processing apparatus can be configured on an electronic device. The electronic device may be a personal computer, a mobile terminal, etc., and the mobile terminal may be a hardware device with various operating systems, such as a mobile phone, a tablet computer, and the like.

The embodiments of the present disclosure will be described in detail below with reference to the accompanying drawings, but the present disclosure is not limited to these specific embodiments.

FIG. 1 is a schematic flowchart of an image processing method provided by at least one embodiment of the present disclosure; FIG. 2 is a schematic diagram of an original image provided by at least one embodiment of the present disclosure.

As shown in FIG. 1 , the image processing method provided by the embodiment of the present disclosure includes steps S10 to S14.

As shown in FIG. 1 , first, the image processing method includes step S10 : acquiring an original image.

For example, the original image includes at least one object, and the object may be a character, and the character may include Chinese (for example, Chinese characters or pinyin), English, Japanese, French, Korean, Latin, numbers, etc. In addition, the object may also include various symbols ( For example, greater than sign, less than sign, percent sign, etc.) and various graphics, etc. At least one of the objects may include printed or machine-typed characters, as well as handwritten characters. For example, as shown in FIG. 2, in some embodiments, objects in the original image may include words and letters in print (eg, English, Japanese, French, Korean, German, Latin, etc. in different national languages and scripts) ), printed numbers (eg, dates, weights, dimensions, etc.), printed symbols and images, etc., handwritten words and letters, handwritten numbers, handwritten symbols and graphics, etc.

The original image may be various types of images, for example, may be an image of a shopping list, an image of a dining receipt, an image of a test paper, an image of a contract, and the like. As shown in FIG. 2, the original image may be an image of a letter.

The shape of the original image can be rectangle etc. The shape and size of the original image can be set by the user according to the actual situation.

The original image may be an image captured by an image acquisition device (eg, a digital camera or a mobile phone, etc.), and the original image may be a grayscale image or a color image. It should be noted that the original image refers to a form in which the object to be processed (eg, test paper, cooperation, shopping receipt, etc.) is presented in a visual manner, such as a picture of the object to be processed. For another example, the original image can also be obtained by scanning or the like. For example, the original image may be an image directly collected by an image collection device, or an image obtained after preprocessing the collected image. For example, in order to avoid the influence of data quality and data imbalance of the original image on image processing, before processing the original image, the image processing method provided by at least one embodiment of the present disclosure may further include an operation of preprocessing the original image. The preprocessing may include, for example, processing, such as cropping, gamma (Gamma) correction, or noise reduction filtering, on the image directly collected by the image collection device. Preprocessing can eliminate irrelevant information or noise information in the original image, so as to facilitate better image processing of the original image.

Next, as shown in FIG. 1 , in step S11 , the original image is processed through a first binarization model to obtain a first binarized image of the original image.

For example, the first binarization model is a neural network-based model. For example, the first binarization model may be implemented using machine learning techniques and run, for example, on a general purpose computing device or a special purpose computing device. The first binarization model is a neural network model obtained by pre-training. For example, the first binarization model can be implemented by using a U-net neural network, a neural network similar to the U-net neural network, a Mask-rcnn neural network, or other neural networks.

For example, the first binarization model is used to binarize the original image to obtain the first binarized image. The binarization process is to set the gray value of the pixel on the original image to the first gray value (for example, 0) or the second gray value (for example, 255), that is, to make the whole original image appear obvious Process of black and white effect.

The first binarization model to be trained can be trained through a large number of original training images and the binarized images of the original training images, and then the first binarization model (for example, a neural network model such as a U-net neural network) is established. ). For the process of training the to-be-trained first binarization model to establish the first binarization model, reference may be made to the training process in the field of neural networks, and the specific process will not be repeated.

It should be noted that, in some embodiments, an existing binarization processing method may also be used to perform binarization processing on the original image to obtain the first binarized image. For example, the binarization processing method may include a threshold value method, and the threshold value method includes: setting a binarization threshold value, and comparing the gray level value of each pixel in the original image with the binarization threshold value. If the grayscale value is greater than or equal to the binarization threshold, the grayscale value of the pixel is set to 255 grayscale. If the grayscale value of a pixel in the original image is less than the binarization threshold, the grayscale value of the pixel is set to Set it to 0 grayscale, so that the original image can be binarized. For example, the selection method of the binarization threshold includes the bimodal method, the P-parameter method, the big law (OTSU method), the maximum entropy method, and the iterative method.

In some embodiments, step S11 may include: compressing the original image to obtain an input image; and processing the input image through a first binarization model to obtain a first binarized image of the original image.

FIG. 3 shows an input image provided by an embodiment of the present disclosure. For example, the input image in FIG. 3 may be an image obtained by compressing the original image in FIG. 2 .

The dimensions of the input image are smaller than the dimensions of the original image. It should be noted that when the first binarization model is used for the binarization prediction processing, if the original image is too large, the processing speed will be relatively slow. Therefore, in order to improve the processing speed, the original image can be compressed to obtain The compressed input image is then subjected to binarization prediction processing on the input image through the first binarization model.

In some embodiments, the size of the input image may be 1500*1500. It should be noted that the size of the input image is not limited to this, and can be set according to the actual situation. The user can preset the compression ratio, etc. The compression ratio is related to factors such as processing speed and image quality, and the user can comprehensively consider the processing speed and image quality. factor to set the compression ratio. If the processing speed needs to be made faster, the compression ratio can be larger, so that the size of the input image is smaller. However, at this time, the quality of the final first binarized image may be poor; if the final second binarized image needs to be obtained If the quality of the binarized image is better, the compression ratio can be smaller, so that the size of the input image is larger. At this time, the processing speed is slower, that is, the first binarization model performs binarization processing on the input image. process is longer. In some examples, the aspect ratio of the input image and the aspect ratio of the original image may be the same. In other examples, the aspect ratio of the input image and the aspect ratio of the original image may be different. In this case, relative to the original image , the input image is deformed. After the input image is processed, a binarized predicted image is obtained. The size of the binarized predicted image needs to be restored to the same size as the original image. The resolution of the photo is 12 million pixels, that is, 4000*3000. At this time, the size of the original image can be 4000*3000, and the size of the input image obtained after compressing the original image can also be 1500*1500. This , the input image is deformed.

FIG. 4 is a schematic diagram of a first binarized image provided by an embodiment of the present disclosure.

In step S11, processing the input image through the first binarization model to obtain the first binarization image of the original image includes: processing the input image through the first binarization model to obtain the first binarization model of the input image. Binarize the predicted image; restore the size of the binarized predicted image to obtain a first binarized image.

The first binarized image in FIG. 4 is the binarized image of the original image shown in FIG. 2 . For example, the size of the first binarized image is the same as the size of the original image.

As shown in FIG. 4 , in the first binarized image, the black pixels represent the pixels corresponding to the object, and the white pixels represent the pixels corresponding to the background.

For example, the size of the binarized predicted image is the same as the size of the input image.

It should be noted that, after the binarized predicted image is obtained, the size of the binarized predicted image is restored, that is, the size of the binarized predicted image is enlarged according to the enlargement ratio, so that the size of the first binarized image is equal to the size of the first binarized image. The size of the original image is the same, so that it is convenient to perform pixel synthesis at the corresponding position later. In the resizing process, the enlargement ratio may correspond to the compression ratio. For example, if the compression ratio is 1/K, the enlargement ratio may be K.

In some embodiments, an interpolation method may be used to restore the size of the binarized predicted image to obtain the first binarized image.

FIG. 5 is a schematic diagram of a blurred image according to an embodiment of the disclosure, and FIG. 6 is a pixel circumscribed contour image according to an embodiment of the disclosure.

Next, as shown in FIG. 1 , in step S12 , the first binarized image is processed to obtain a pixel circumscribed contour image.

The pixel circumscribed contour image shown in FIG. 6 is a pixel circumscribed contour image obtained by processing the first binarized image shown in FIG. 4 .

As shown in FIG. 6 , the pixel circumscribed contour image includes a plurality of circumscribed contour pixels, and the white pixels in FIG. 6 represent circumscribed contour pixels. The pixels in the area surrounded by the plurality of circumscribed contour pixels are pixels corresponding to at least part of the at least one object, and the black pixels inside the white pixels in FIG. 6 represent the pixels of the object.

In some embodiments, step S12 includes: performing a blurring process on the first binarized image to obtain a blurred image; and performing XOR processing on the blurred image and the first binarized image to obtain a pixel circumscribed contour image.

The blurred image shown in FIG. 5 may be a blurred image obtained by blurring the first binarized image shown in FIG. 4 . As shown in FIGS. 4 and 5 , after the blurring process is performed on the first binarized image, the mask area (Mask area) of the object in the first binarized image becomes larger.

In some embodiments, Gaussian filtering may be used to blur the first binarized image. It should be noted that, in the present disclosure, the method of fuzzification processing is not limited to Gaussian filtering, and may also be other suitable methods, such as median filtering, mean filtering, and the like.

The white pixels in Fig. 6 represent different pixels between the blurred image and the first binarized image, that is, for any white pixel in Fig. 6, the pixel at the position corresponding to the white pixel in the blurred image The grayscale value is different from the grayscale value of the pixel at the position corresponding to the white pixel in the first binarized image. The black pixels in Fig. 6 represent the same pixels between the blurred image and the first binarized image, that is, for any black pixel in Fig. 6, the pixel at the position corresponding to the black pixel in the blurred image The grayscale value is the same as the grayscale value of the pixel at the position corresponding to the black pixel in the first binarized image.

FIG. 7 is a schematic diagram of a second binarized image according to an embodiment of the present disclosure.

Next, as shown in FIG. 1 , in step S13 , the original image is processed through a second binarization model to obtain a second binarized image.

The second binarized image shown in FIG. 7 is an image obtained by processing the original image shown in FIG. 2 through the second binarization model.

In step S13, the processing performed by the second binarization model (for example, lessink processing) is performed according to the original image. For example, the processing performed by the second binarization model can be used to remove part of the grayscale in the original image. pixels, while enhancing the detail information of objects (eg, characters), that is, more detailed pixel features can be preserved. The processing performed by the second binarization model can also remove image noise interference in the original image, making the details of the object more prominent.

The binarized prediction image obtained by performing the binarization prediction process on the input image shown in Figure 3 does not perform well in the detail part and has jaggedness. Therefore, it is necessary to supplement the detail pixels of the image, so that the final composite image has better effect.

In some embodiments, step S13 may include: performing grayscale processing on the original image to obtain a grayscale image; processing the grayscale image according to the first threshold to obtain an intermediate binarized image; As a guide map, conduct guide filtering processing on the grayscale image to obtain a filtered image; determine high-value pixels in the filtered image according to a second threshold, wherein the grayscale value of the high-value pixels is greater than the second threshold; according to a preset The expansion coefficient is used to expand the gray value of the high-value pixels to obtain an expanded image; to clear the expanded image to obtain a clear image; and to adjust the contrast of the clear image to obtain a second binarized image.

For example, grayscale processing methods include component method, maximum value method, average value method, weighted average method, and the like.

For example, a threshold method can be used to binarize a grayscale image to obtain an intermediate binarized image. For example, the commonly used binarization threshold selection methods include the bimodal method, the P parameter method, the big law (OTSU method), the maximum entropy method, the iterative method, etc. The selection method of the first threshold can be any of the above methods. kind. The first threshold can be set according to the actual situation, which is not specifically limited here.

In step S13, in the guided filtering process, the intermediate binarized image is used as the guided image, the grayscale image is used as the input image in the guided filtering process, and the filtered image is the output image in the guided filtering process. The valued image performs guided filtering on the grayscale image, which can output a filtered image that is roughly similar to the grayscale image and similar to the intermediate binarized image at the edge texture. After the guided filtering process, the noise in the image is significantly reduced.

The second threshold is the sum of the average gray value of the filtered image and the standard deviation of the gray value, that is, the second threshold is equal to the average value of the gray value of each pixel in the filtered image plus the gray value of each pixel in the filtered image. The standard deviation of the degree value.

In some embodiments, the preset expansion factor is 1.2-1.5, eg, 1.3. The gray value of each high-value pixel is multiplied by a preset expansion coefficient to perform expansion processing on the gray value of the high-value pixel, thereby obtaining an expanded image with more obvious black and white contrast.

In step S13, in some embodiments, performing a sharpening process on the expanded image to obtain a clear image includes: using Gaussian filtering to perform blurring processing on the expanded image to obtain a blurred image corresponding to the expanded image; according to a preset mixing coefficient, The blurred image corresponding to the expanded image and the expanded image are mixed proportionally to obtain a clear image. By sharpening the expanded image, a clearer image that is clearer than the expanded image can be obtained.

Suppose f ₁ (i, j) is the gray value of the pixel point at _{(i, j) of the extended image, and f 2} (i, j) is the pixel point of the blurred image corresponding to the extended image at (i, j) , f ₃ (i, j) is the gray value of the pixel point at (i, j) of the clear image, k ₁ is the preset mixing coefficient _{of the extended image, and k 2} is the blurred image corresponding to the extended image , then f ₁ (i,j), f ₂ (i, j), and f ₃ (i, j) satisfy the following relations:

f ₃ (i,j)=k ₁ f ₁ (i,j)+k ₂ f ₂ (i,j).

For example, the preset mixing coefficient of the extended image may be 1.5, and the preset mixing coefficient of the blurred image corresponding to the extended image may be -0.5.

In step S13, adjusting the contrast of the clear image includes: adjusting the gray value of each pixel of the clear image according to the gray mean value of the clear image. Therefore, by adjusting the contrast of the clear image, a second binarized image with more obvious black and white contrast can be obtained.

For example, the gray value of each pixel of a clear image can be adjusted by the following formula:

Among them, f'(i,j) is the gray value of the pixel point at (i,j) of the second binarized image,

is the average value of the gray value of each pixel point in the clear image, f(i, j) is the gray value of the pixel point at (i, j) of the clear image, and t is the intensity value. For example, the intensity value may be from 0.1 to 0.5, for example, the intensity value may be 0.2. In practical applications, the intensity value can be selected according to the final ink saving effect to be achieved.

FIG. 8 is a schematic diagram of a composite image provided by an embodiment of the present disclosure.

Finally, as shown in FIG. 1 , in step S14 , the second binarized image and the first binarized image are synthesized according to the positions of the plurality of circumscribed contour pixels in the pixel circumscribed contour image to obtain a synthesized image.

It should be noted that "combining the second binarized image and the first binarized image to obtain a composite image" means combining the pixels corresponding to the positions of the plurality of circumscribed contour pixels in the first binarized image. The gray-scale value is replaced with the gray-scale value of the pixels corresponding to the positions of the multiple circumscribed contour pixels in the second binarized image, that is, all the pixels corresponding to the positions of the multiple circumscribed contour pixels in the first binarized image Replace with better-performing pixels.

FIG. 8 is an image obtained by synthesizing the first binarized image shown in FIG. 4 and the second binarized image shown in FIG. 7 . For example, as shown in FIG. 8 , the composite image is a binarized image.

In some embodiments, step S14 includes: obtaining the positions of a plurality of circumscribed contour pixels in the pixel circumscribed contour image; Two binarized pixels; according to the pixel correspondence between the second binarized image and the first binarized image, multiple target second binarized pixels in the second binarized image are synthesized into the first binarized image respectively. The same location in the image to get a composite image of the original image.

In some embodiments, the size of the second binarized image, the size of the first binarized image, and the size of the composite image may all be the same.

All the second binarized pixels in the second binarized image are arranged in n rows and m columns, all the first binarized pixels in the first binarized image are arranged in n rows and m columns, and all the composite images in the composite image are arranged in n rows and m columns. The pixels are arranged in n rows and m columns, and all the pixels in the pixel circumscribed contour image are arranged in n rows and m columns. That is, the number of all the second binarized pixels in the second binarized image is n*m, the number of all the first binarized pixels in the first binarized image is n*m, and the composite image The number of all synthesized pixels in is n*m, and the number of all pixels in the pixel circumscribed contour image is n*m.

The multiple target second binarized pixels are in one-to-one correspondence with the multiple circumscribed contour pixels, and the positions of the target second binarized pixels are the same as the positions of the circumscribed contour pixels corresponding to the target second binarized pixels. For example, if in the pixel circumscribed contour image, the pixel located in the i-th row and the j-th column is the circumscribed contour pixel, correspondingly, in the second binarized image, the second binarized pixel located in the i-th row and the j-th column The second binarized pixel for the target.

In step S14, according to the pixel correspondence between the second binarized image and the first binarized image, multiple target second binarized pixels in the second binarized image are synthesized into the first binarized image respectively. The same position in the image includes: determining the qth target second binarization pixel in the plurality of target second binarization pixels, wherein the qth target second binarization pixel is located in the second binarized image The i-th row and the j-th column of ; determine the q-th target first binarized pixel located in the i-th row and the j-th column in the first binarized image; The value is replaced with the grayscale value of the qth target second binarized pixel to obtain the qth target composite pixel located at the ith row and the jth column in the composite image.

n, m, q, i, and j are all positive integers, and i is less than or equal to n, j is less than or equal to m, and q is less than or equal to the number of multiple target second binarized pixels.

"Replace the grayscale value of the qth target first binarized pixel with the grayscale value of the qth target second binarized pixel to obtain the qth target composite pixel" can make objects (eg, characters) The perimeter is smooth. That is to say, the grayscale value of the qth target synthesized pixel is the same as the grayscale value of the qth target second binarized pixel.

In the first binarized image, the first binarized pixels that do not correspond to the plurality of target second binarized pixels are directly used as the synthesized pixels in the synthesized image. The first binarized pixel located in the p1th row and the p2th column does not correspond to any of the multiple target second binarization pixels, that is, the second binarized image in the second binarized image is located in The second binarized pixel at row p1 and column p2 is not the target second binarized pixel, then the first binarized pixel located at row p1 and column p2 in the first binarized image is used as the composite image. The grayscale value of the synthesized pixel located at row p1 and column p2, that is, the grayscale value of the first binarized pixel located at row p1 and column p2 is the same as the grayscale value of the synthesized pixel located at row p1 and column p2.

It should be noted that, in the present disclosure, the pixels in the second binarized image are referred to as second binarized pixels, the pixels in the first binarized image are referred to as first binarized pixels, and the composite image The pixels in the image are called composite pixels. "Second binarized pixels", "first binarized pixels", "synthetic pixels", etc. are only used to distinguish pixels located in different images, and do not mean that these pixels are in different images. structure, properties, etc. In addition, the target second binarized pixel represents a pixel corresponding to the circumscribed contour pixel in the second binarized image, and the target first binarized pixel represents a pixel corresponding to the target second binarized pixel in the first binarized image. The corresponding pixel, the target composite pixel represents a pixel in the composite image corresponding to the target second binarized pixel.

Corresponding to the above image processing method, at least one embodiment of the present disclosure further provides an image processing apparatus, and FIG. 9 is a schematic block diagram of an image processing apparatus provided by at least one embodiment of the present disclosure.

As shown in FIG. 9 , the image processing apparatus 900 includes: an acquisition module 901 , a first binarization module 902 , a processing module 903 , a second binarization module 904 and a synthesis module 905 .

The acquisition module 901 is used to acquire the original image. The original image includes at least one object.

The first binarization module 902 is configured to process the original image through the first binarization model to obtain a first binarized image of the original image.

The processing module 903 is configured to process the first binarized image to obtain a pixel circumscribed contour image. For example, the pixel circumscribed contour image includes a plurality of circumscribed contour pixels, and the pixels in the area surrounded by the plurality of circumscribed contour pixels are pixels corresponding to at least some objects in the at least one object.

The second binarization module 904 is configured to process the original image through the second binarization model to obtain a second binarized image.

The synthesizing module 905 is configured to synthesize the second binarized image and the first binarized image according to the positions of a plurality of circumscribed contour pixels in the pixel circumscribed contour image to obtain a synthesized image of the original image. For example, the composite image is a binarized image.

In some embodiments, when the first binarization module 902 performs the operation of processing the original image through the first binarization model to obtain the first binarized image of the original image, the first binarization module 902 performs The following operations: compress the original image to obtain the input image, wherein the size of the input image is smaller than the size of the original image; process the input image through the first binarization model to obtain the first binarization of the original image image.

In some embodiments, when the first binarization module 902 performs the operation of processing the input image through the first binarization model to obtain the first binarized image of the original image, the first binarization module 902 performs The following operations are as follows: processing the input image through the first binarization model to obtain a binarized predicted image of the input image; and restoring the size of the binarized predicted image to obtain the first binarized image. For example, the size of the first binarized image is the same as the size of the original image.

In some embodiments, when the processing module 903 performs an operation of processing the first binarized image to obtain a pixel circumscribed contour image, the processing module 903 performs the following operations: performing blurring processing on the first binarized image to obtain Blurred image; XOR processing is performed on the blurred image and the first binarized image to obtain a pixel circumscribed contour image.

In some embodiments, the synthesis module 905 performs synthesis of the second binarized image and the first binarized image according to the positions of a plurality of circumscribed contour pixels in the pixel circumscribed contour image to obtain a composite image of the original image. During operation, the synthesizing module 905 performs the following operations: obtaining the positions of multiple circumscribed contour pixels in the pixel circumscribed contour image; Two binarized pixels; according to the pixel correspondence between the second binarized image and the first binarized image, multiple target second binarized pixels in the second binarized image are synthesized into the first binarized image respectively. The same location in the image to get a composite image of the original image.

All the second binarized pixels in the second binarized image are arranged in n rows and m columns, all the first binarized pixels in the first binarized image are arranged in n rows and m columns, and all the composite images in the composite image are arranged in n rows and m columns. The pixels are arranged in n rows and m columns. In some embodiments, the synthesizing module 905 performs, according to the pixel correspondence between the second binarized image and the first binarized image, respectively synthesizing a plurality of target second binarized pixels in the second binarized image into During the operation at the same position in the first binarized image, the synthesizing module 905 includes performing the following operations: determining the qth target second binarization pixel among the plurality of target second binarization pixels, wherein the qth target second binarization pixel is The target second binarization pixel is located in the ith row and the jth column of the second binarized image; determine the qth target first binarization pixel located in the ith row and the jth column in the first binarized image; Replace the grayscale value of the first binarized pixel of the qth target with the grayscale value of the second binarized pixel of the qth target to obtain the composite image of the qth target located at the ith row and the jth column of the composite image. pixel.

The grayscale value of the qth target synthetic pixel is the grayscale value of the qth target second binarized pixel, n, m, q, i, and j are all positive integers, and i is less than or equal to n, and j is less than or equal to m , q is less than or equal to the number of multiple target second binarized pixels.

In some embodiments, the second binarization module 904 includes a grayscale module, an intermediate binarization module, a filter module, a determination module, an expansion module, and a sharpening module.

The grayscale module is used to perform grayscale processing on the original image to obtain a grayscale image.

The intermediate binarization module is used to process the grayscale image according to the first threshold to obtain an intermediate binarized image.

The filtering module is used for taking the intermediate binarized image as a guide image, and performing guide filtering processing on the grayscale image to obtain a filtered image.

The determining module is configured to determine high-value pixels in the filtered image according to the second threshold, wherein the gray value of the high-value pixels is greater than the second threshold.

The expansion module is used for expanding the gray value of the high-value pixel points according to the preset expansion coefficient to obtain an expanded image.

The sharpening module is used for sharpening the expanded image to obtain a clear image, and adjusting the contrast of the clear image to obtain a second binarized image.

For example, acquisition module 901, first binarization module 902, processing module 903, second binarization module 904, and/or synthesis module 905 include code and programs stored in memory; the code and programs can be executed by the processor to Some or all of the functions of the acquisition module 901 , the first binarization module 902 , the processing module 903 , the second binarization module 904 and/or the synthesis module 905 as described above are implemented. For example, the acquisition module 901 , the first binarization module 902 , the processing module 903 , the second binarization module 904 and/or the synthesis module 905 may be dedicated hardware devices for implementing the acquisition module 901 , the first Some or all of the functions of the binarization module 902 , the processing module 903 , the second binarization module 904 and/or the synthesis module 905 . For example, the acquisition module 901, the first binarization module 902, the processing module 903, the second binarization module 904 and/or the synthesis module 905 may be one circuit board or a combination of multiple circuit boards for implementing the above-mentioned function. In this embodiment of the present application, the one circuit board or the combination of multiple circuit boards may include: (1) one or more processors; (2) one or more non-transitory memories connected to the processors; and (3) The firmware stored in the memory executable by the processor.

It should be noted that the acquisition module 901 is used to implement step S10 shown in FIG. 1 , the first binarization module 902 is used to implement step S11 shown in FIG. 1 , and the processing module 903 is used to implement step S12 shown in FIG. 1 . , the second binarization module 904 is used to implement step S13 shown in FIG. 1 , and the synthesis module 905 is used to implement step S14 shown in FIG. 1 . Therefore, for the specific description of the acquisition module 901, reference may be made to the relevant description of step S10 shown in FIG. 1 in the above-mentioned embodiment of the image processing method, and for the specific description of the first binarization module 902, reference may be made to the above-mentioned embodiment of the image processing method. For the relevant description of step S11 shown in FIG. 1 , for the specific description of the processing module 903 , please refer to the relevant description of step S12 shown in FIG. 1 in the embodiment of the above image processing method, and for the specific description of the second binarization module 904 Reference may be made to the relevant description of step S13 shown in FIG. 1 in the embodiment of the above image processing method, and the specific description of the synthesis module 905 may refer to the relevant description of step S14 shown in FIG. 1 in the embodiment of the above image processing method. In addition, the image processing apparatus can achieve technical effects similar to those of the aforementioned image processing method, which will not be repeated here.

At least one embodiment of the present disclosure further provides an electronic device, and FIG. 10 is a schematic block diagram of an electronic device provided by at least one embodiment of the present disclosure.

As shown in FIG. 10 , the electronic device includes a processor 1001 , a communication interface 1002 , a memory 1003 and a communication bus 1004 . The processor 1001, the communication interface 1002, and the memory 1003 communicate with each other through the communication bus 1004, and the components such as the processor 1001, the communication interface 1002, and the memory 1003 can also communicate through a network connection. The present disclosure does not limit the type and function of the network.

Memory 1003 is used for non-transitory storage of computer readable instructions. When the processor 1001 is configured to execute computer-readable instructions, the computer-readable instructions are executed by the processor 1001 to implement the image processing method according to any of the above embodiments. For the specific implementation of each step of the image processing method and related explanation contents, reference may be made to the above-mentioned embodiments of the image processing method, which will not be repeated here.

The implementation manner of the processor 1001 executing the program stored in the memory 1003 to realize the image processing method is the same as the implementation manner mentioned in the embodiment part of the foregoing image processing method, and will not be repeated here.

The communication bus 1004 may be a Peripheral Component Interconnect Standard (PCI) bus or an Extended Industry Standard Architecture (EISA) bus, or the like. The communication bus can be divided into an address bus, a data bus, a control bus, and the like. For ease of presentation, only one thick line is used in the figure, but it does not mean that there is only one bus or one type of bus.

The communication interface 1002 is used to implement communication between the electronic device and other devices.

The processor 1001 and the memory 1003 may be provided on the server side (or cloud).

The processor 1001 may control other components in the electronic device to perform desired functions. The processor 1001 can be a central processing unit (CPU), a network processor (NP), etc.; it can also be a digital signal processor (DSP), an application specific integrated circuit (ASIC), a field programmable gate array (FPGA) or other programmable Logic devices, discrete gate or transistor logic devices, discrete hardware components. The central processing unit (CPU) can be an X86 or an ARM architecture or the like.

Memory 1003 may include any combination of one or more computer program products, which may include various forms of computer-readable storage media, such as volatile memory and/or non-volatile memory. Volatile memory may include, for example, random access memory (RAM) and/or cache memory, among others. Non-volatile memory may include, for example, read only memory (ROM), hard disk, erasable programmable read only memory (EPROM), portable compact disk read only memory (CD-ROM), USB memory, flash memory, and the like. One or more computer-readable instructions may be stored on the computer-readable storage medium, and the processor 1001 may execute the computer-readable instructions to implement various functions of the electronic device. Various application programs, various data and the like can also be stored in the storage medium.

For example, for a detailed description of the process of image processing performed by the electronic device, reference may be made to the relevant descriptions in the embodiments of the image processing method, and repeated descriptions will not be repeated.

FIG. 11 is a schematic diagram of a non-transitory computer-readable storage medium provided by at least one embodiment of the present disclosure. For example, as shown in FIG. 11 , one or more computer-readable instructions 1101 may be non-transitory stored on storage medium 1100 . For example, the computer readable instructions 1101 may perform one or more steps of the image processing method according to the above when executed by a processor.

The storage medium 1100 can be applied to the above-mentioned electronic device and/or the image processing apparatus 900 . For example, the storage medium 1100 may include the memory 1003 in the electronic device.

For the description of the storage medium 1100, reference may be made to the description of the memory in the embodiment of the electronic device, and repeated descriptions will not be repeated.

FIG. 12 shows a schematic diagram of a hardware environment provided by at least one embodiment of the present disclosure. The electronic device provided by the present disclosure can be applied to the Internet system.

The functions of the image processing apparatus and/or electronic device involved in the present disclosure can be realized by using the computer system provided in FIG. 12 . Such computer systems may include personal computers, notebook computers, tablet computers, cell phones, personal digital assistants, smart glasses, smart watches, smart rings, smart helmets, and any smart portable or wearable device. The specific system in this embodiment illustrates a hardware platform including a user interface using functional block diagrams. Such computer equipment may be a general purpose computer equipment or a special purpose computer equipment. Both computer devices can be used to implement the image processing apparatus and/or electronic device in this embodiment. The computer system may include any component that implements the information required to implement the image processing currently described. For example, a computer system can be implemented by a computer device through its hardware devices, software programs, firmware, and combinations thereof. For the sake of convenience, only one computer device is drawn in FIG. 12, but the related computer functions described in this embodiment to realize the information required for image processing can be implemented in a distributed manner by a group of similar platforms, Distribute the processing load of a computer system.

As shown in FIG. 12 , the computer system may include a communication port 250, which is connected to a network for realizing data communication. For example, the computer system may send and receive information and data through the communication port 250, that is, the communication port 250 may enable the computer system to communicate with Other electronic devices communicate wirelessly or by wire to exchange data. The computer system may also include a processor group 220 (ie, the processors described above) for executing program instructions. The processor group 220 may consist of at least one processor (eg, a CPU). The computer system may include an internal communication bus 210 . The computer system may include various forms of program storage units and data storage units (ie, the memories or storage media described above), such as hard disk 270, read only memory (ROM) 230, random access memory (RAM) 240, capable of storing Various data files used for computer processing and/or communication, and possibly program instructions executed by the processor group 220 . The computer system may also include an input/output component 260 for enabling input/output data flow between the computer system and other components (eg, user interface 280, etc.).

Typically, the following devices may be connected to the input/output assembly 260: input devices including, for example, a touch screen, touchpad, keyboard, mouse, camera, microphone, accelerometer, gyroscope, etc.; including, for example, a liquid crystal display (LCD), speakers, vibrators, etc. output device; including storage devices such as tapes, hard disks, etc.; and a communication interface.

Although Figure 12 shows a computer system with various devices, it should be understood that the computer system is not required to have all of the devices shown, and may instead have more or fewer devices.

For the present disclosure, the following points need to be noted:

(1) The accompanying drawings of the embodiments of the present disclosure only relate to the structures involved in the embodiments of the present disclosure, and other structures may refer to general designs.

(2) In the drawings for describing the embodiments of the present invention, the thickness and size of layers or structures are exaggerated for clarity. It will be understood that when an element such as a layer, film, region or substrate is referred to as being "on" or "under" another element, it can be "directly on" or "under" the other element, Or intermediate elements may be present.

(3) The embodiments of the present disclosure and the features in the embodiments may be combined with each other to obtain new embodiments without conflict.

The above descriptions are only specific embodiments of the present disclosure, but the protection scope of the present disclosure is not limited thereto, and the protection scope of the present disclosure should be subject to the protection scope of the claims.

Claims

An image processing method, comprising:

acquiring an original image, wherein the original image includes at least one object;

The original image is processed by a first binarization model to obtain a first binarized image of the original image;

The first binarized image is processed to obtain a pixel circumscribed contour image, wherein the pixel circumscribed contour image includes a plurality of circumscribed contour pixels, and the pixels in the area surrounded by the plurality of circumscribed contour pixels are the pixels corresponding to at least some of the at least one object;

Process the original image through a second binarization model to obtain a second binarized image;

According to the positions of the plurality of circumscribed contour pixels in the pixel circumscribed contour image, the second binarized image and the first binarized image are synthesized to obtain a synthesized image, wherein the synthesized image The image is a binarized image.
The image processing method according to claim 1, wherein processing the original image by using the first binarization model to obtain a first binarized image of the original image, comprising:

compressing the original image to obtain an input image, wherein the size of the input image is smaller than the size of the original image;

The input image is processed through the first binarization model to obtain a first binarized image of the original image.
The image processing method according to claim 2, wherein processing the input image by using the first binarization model to obtain a first binarized image of the original image, comprising:

Process the input image by using the first binarization model to obtain a binarized prediction image of the input image;

The size of the binarized predicted image is restored to obtain the first binarized image, wherein the size of the first binarized image is the same as the size of the original image.
The image processing method according to claim 1, wherein processing the first binarized image to obtain a pixel circumscribed contour image, comprising:

performing a blurring process on the first binarized image to obtain a blurred image;

XOR processing is performed on the blurred image and the first binarized image to obtain the pixel circumscribed contour image.
The image processing method according to claim 1, wherein the second binarized image and the first binary image are processed according to the positions of the plurality of circumscribed contour pixels in the pixel circumscribed contour image. The synthesized image is synthesized to obtain the synthesized image, including:

obtaining the positions of the plurality of circumscribed contour pixels in the pixel circumscribed contour image;

extracting a plurality of target second binarization pixels at positions corresponding to the positions of the plurality of circumscribed contour pixels in the second binarized image;

According to the pixel correspondence between the second binarized image and the first binarized image, the plurality of target second binarized pixels in the second binarized image are respectively synthesized into the The same position in the first binarized image to obtain the composite image.
The image processing method according to claim 5, wherein all the second binarized pixels in the second binarized image are arranged in n rows and m columns, and all the second binarized pixels in the first binarized image are arranged in n rows and m columns. The first binarized pixels are arranged in n rows and m columns, and all the synthesized pixels in the synthesized image are arranged in n rows and m columns,

According to the pixel correspondence between the second binarized image and the first binarized image, the plurality of target second binarized pixels in the second binarized image are respectively synthesized into the The same locations in the first binarized image, including:

Determine the qth target second binarization pixel in the plurality of target second binarization pixels, wherein the qth target second binarization pixel is located in the second binarization image of the second binarization image. row i, column j;

determining the q-th target first binarized pixel located in the i-th row and the j-th column in the first binarized image;

Replace the grayscale value of the qth target first binarized pixel with the grayscale value of the qth target second binarized pixel, so as to obtain the ith row in the composite image. The qth target synthetic pixel of column j,

Wherein, the grayscale value of the qth target composite pixel is the grayscale value of the qth target second binarized pixel, n, m, q, i, and j are all positive integers, and i is less than or equal to n, j is less than or equal to m, q is less than or equal to the number of the plurality of target second binarized pixels.
The image processing method according to any one of claims 1 to 6, wherein processing the original image through a second binarization model to obtain a second binarized image, comprising:

Grayscale processing is performed on the original image to obtain a grayscale image;

processing the grayscale image according to the first threshold to obtain an intermediate binarized image;

Taking the intermediate binarized image as a guide image, performing guide filtering processing on the grayscale image to obtain a filtered image;

determining high-value pixels in the filtered image according to a second threshold, wherein the grayscale value of the high-value pixels is greater than the second threshold;

According to the preset expansion coefficient, the gray value of the high-value pixel is expanded to obtain an expanded image;

performing sharpening processing on the expanded image to obtain a sharp image; and

The contrast of the clear image is adjusted to obtain the second binarized image.
The image processing method according to any one of claims 1 to 6, wherein the first binarization model is a model based on a neural network.
An image processing device, comprising:

an acquisition module for acquiring an original image, wherein the original image includes at least one object;

a first binarization module, configured to process the original image through a first binarization model to obtain a first binarized image of the original image;

a processing module, configured to process the first binarized image to obtain a pixel circumscribed contour image, wherein the pixel circumscribed contour image includes a plurality of circumscribed contour pixels, and an area surrounded by the plurality of circumscribed contour pixels The pixels within are pixels corresponding to at least some objects in the at least one object;

a second binarization module, configured to process the original image through a second binarization model to obtain a second binarized image;

a synthesizing module for synthesizing the second binarized image and the first binarized image according to the positions of the plurality of circumscribed contour pixels in the pixel circumscribed contour image to obtain the A composite image, wherein the composite image is a binarized image.
The image processing apparatus according to claim 9, wherein the first binarization module performs processing on the original image through a first binarization model to obtain a first binary value of the original image When converting an image, this includes doing the following:

compressing the original image to obtain an input image, wherein the size of the input image is smaller than the size of the original image;

The input image is processed through the first binarization model to obtain a first binarized image of the original image.
The image processing apparatus according to claim 10, wherein the first binarization module performs processing on the input image through the first binarization model to obtain a first image of the original image. Operations on binarizing images include performing the following operations:

Process the input image by using the first binarization model to obtain a binarized prediction image of the input image;

The size of the binarized predicted image is restored to obtain the first binarized image, wherein the size of the first binarized image is the same as the size of the original image.
The image processing apparatus according to claim 9, wherein, when the processing module performs the operation of processing the first binarized image to obtain a pixel circumscribed contour image, the operation includes performing the following operations:

performing a blurring process on the first binarized image to obtain a blurred image;

XOR processing is performed on the blurred image and the first binarized image to obtain the pixel circumscribed contour image.
The image processing apparatus according to claim 9, wherein the synthesis module executes a combination of the second binarized image and the second binarized image according to the positions of the plurality of circumscribed contour pixels in the pixel circumscribed contour image. The operation of synthesizing the first binarized image to obtain the synthesized image of the original image includes performing the following operations:

obtaining the positions of the plurality of circumscribed contour pixels in the pixel circumscribed contour image;

extracting a plurality of target second binarization pixels at positions corresponding to the positions of the plurality of circumscribed contour pixels in the second binarized image;

According to the pixel correspondence between the second binarized image and the first binarized image, the plurality of target second binarized pixels in the second binarized image are respectively synthesized into the The same position in the first binarized image is obtained to obtain a composite image of the original image.
The image processing apparatus according to claim 13, wherein all the second binarized pixels in the second binarized image are arranged in n rows and m columns, and all the second binarized pixels in the first binarized image are arranged in n rows and m columns. The first binarized pixels are arranged in n rows and m columns, and all the synthesized pixels in the synthesized image are arranged in n rows and m columns,

The synthesis module performs, according to the pixel correspondence between the second binarized image and the first binarized image, the plurality of target second binarized pixels in the second binarized image. The operations of synthesizing to the same position in the first binarized image respectively include performing the following operations:

Determine the qth target second binarization pixel in the plurality of target second binarization pixels, wherein the qth target second binarization pixel is located in the second binarization image of the second binarization image. row i, column j;

determining the q-th target first binarized pixel located in the i-th row and the j-th column in the first binarized image;

Replace the grayscale value of the qth target first binarized pixel with the grayscale value of the qth target second binarized pixel, so as to obtain the ith row in the composite image. The qth target synthetic pixel of column j,

Wherein, the grayscale value of the qth target composite pixel is the grayscale value of the qth target second binarized pixel, n, m, q, i, and j are all positive integers, and i is less than or equal to n, j is less than or equal to m, q is less than or equal to the number of the plurality of target second binarized pixels.
The image processing apparatus according to any one of claims 9 to 14, wherein the second binarization module comprises:

a grayscale module, configured to perform grayscale processing on the original image to obtain a grayscale image;

an intermediate binarization module, configured to process the grayscale image according to the first threshold to obtain an intermediate binarized image;

a filtering module, configured to use the intermediate binarized image as a guide image to perform guide filter processing on the grayscale image to obtain a filtered image;

a determination module, configured to determine a high-value pixel point in the filtered image according to a second threshold, wherein the gray value of the high-value pixel point is greater than the second threshold;

an expansion module, configured to perform expansion processing on the grayscale values of the high-value pixel points according to a preset expansion coefficient to obtain an expanded image;

The sharpening module is used for sharpening the expanded image to obtain a clear image, and adjusting the contrast of the clear image to obtain the second binarized image.
An electronic device, comprising:

a memory for non-transitory storage of computer-readable instructions;

A processor, configured to execute the computer-readable instructions, when the computer-readable instructions are executed by the processor, the image processing method according to any one of claims 1 to 8 is implemented.
A non-transitory computer-readable storage medium, characterized in that, the non-transitory computer-readable storage medium stores computer-readable instructions, and when the computer-readable instructions are executed by a processor, the computer-readable instructions according to claims 1 to 8 are implemented. The image processing method described in any one of.