CN103514581A - Screen picture capturing method, device and terminal equipment - Google Patents

Abstract

The present disclosure relates to a method for capturing a screen image, the method comprising: acquiring all screenshots within a predetermined time period after a screen capture operation is detected; The public areas of the screenshots with common areas are overlapped and spliced into one picture. In the present disclosure, multiple intercepted pictures exceeding the height of the screen are spliced into one picture without redundant information, which is convenient for users to share the pictures. The present disclosure also discloses a device and a terminal device for realizing the above method.

Description

A method, device and terminal equipment for capturing screen pictures

technical field

The present disclosure belongs to the technical field of communications, and in particular relates to a method, device and terminal equipment for capturing screen pictures.

Background technique

Smart phones have become an indispensable communication tool in people's work and life. With the increasingly powerful functions, sharing pictures through smart phones has become a frequently used way of information sharing. It is very convenient to make a lot of information clear at a glance through pictures. When sharing pictures, the current screen image is usually captured and sent to friends, but if the information to be shared exceeds the height of the screen, such as a long piece of news, it is difficult to share this information through pictures, and multiple screenshots are required. screen images for complete information.

In the smart phone operating system, there are very convenient operation shortcut keys for screen capture operation. After the screen capture operation is completed, the captured pictures will be saved in the screen capture directory in the system, so that users can obtain and share them. When the area where the information is collected exceeds the height of the screen capture, multiple pictures can only be captured and shared one by one, which is very inconvenient for the user to operate.

Contents of the invention

In order to overcome the problems existing in related technologies, the present disclosure provides a method, device and terminal equipment for capturing screen pictures, which realize the intelligent splicing of multiple captured pictures into one picture.

In one aspect, the present disclosure provides a method for capturing a screen picture, the method comprising:

After monitoring the screenshot operation, obtain all the screenshot pictures within the predetermined time;

When it is detected that there are screenshots with common areas among all the screenshots, overlapping and splicing the common areas of the screenshots with common areas into one picture.

Detect all screen capture operations within a predetermined time period, automatically judge whether there are public areas in the screen capture pictures, and splice the screen capture pictures in the public area into one picture, so as to splice the pictures that exceed the height of the screen captured in multiple times into one without redundant information The picture is convenient for users to share the picture.

Before overlapping and stitching the common areas of the screenshots with common areas into one picture, the method further includes: when detecting that at least two screenshots have the same edge frame, cutting out the Edge frame. Remove the same border frame around each screenshot, so as to ensure the continuity of the spliced image content.

The detecting that at least two screenshots have the same edge frame includes: grouping each screenshot in all screenshots in groups of two, and enumerating all grouping methods; detecting every two screenshots one by one Whether they have the same edge frame; obtain the absolute value of the pixel difference of the pixel points at the same position on each screenshot in the same group, and form a scanned image according to the absolute value of the pixel difference of all pixels; The picture is scanned, and when the absolute value of the pixel difference on the scanning line is not greater than the preset threshold, it is determined that the pixel corresponding to the absolute value of the pixel difference is located in the edge frame; when the absolute value of the pixel difference on the scanning line is If the value is greater than the preset threshold, it is determined that the pixel corresponding to the absolute value of the pixel difference is outside the edge frame. Determine the range and specific position of the edge frame according to the above method to determine whether it is the same edge frame, and the judgment result is more accurate.

When it is detected that there are screenshots with common areas in all the screenshots, the method further includes: outputting prompt information whether to stitch the screenshots; Overlapping and splicing into one picture includes: overlapping and splicing the common areas of the screenshots with common areas into one picture when receiving an instruction confirming to perform picture splicing. Prompt information is output for the user to choose whether to perform image splicing, and whether to perform image splicing can be determined according to the user's needs, so that the image splicing operation is closer to the user's needs.

The method further includes: saving the spliced pictures and deleting the screenshots used for splicing the pictures. Save the stitched pictures and delete the captured screenshots to save storage space.

The overlapping and splicing of the common areas of the screenshots with common areas into one picture includes: preprocessing the screenshots with common areas; preprocessing the preprocessed screenshots with common areas performing image registration on the screenshots; performing image re-projection on the registered screenshots existing in the common area; performing image fusion on the screenshots existing in the public area. The spliced pictures obtained by the above method can realize seamless fusion, the spliced part is smoother, and the image quality is not lost.

In another aspect, the present disclosure provides a device for capturing a screen picture, the device comprising:

The obtaining module is used to obtain all screenshots within a predetermined time period after the screen capture operation is detected;

The splicing module is configured to overlap and splice the common areas of the screenshots with common areas into one picture when it is detected that there are screenshots with common areas in all the screenshots.

The device further includes: a cropping module, configured to crop the edge frame when at least two screenshots are detected to have the same edge frame.

The clipping module includes: a grouping unit, which is used to group each screenshot in all screenshots as a group of two, and enumerates all grouping methods; a detection unit, which is used to detect whether each two screenshots one by one have the same edge frame; the processing unit is used to obtain the absolute value of the pixel difference of the pixel points at the same position on each screenshot in the same group, and form a scanned image according to the absolute value of the pixel difference of all the pixel points; a scanning unit, configured to scan the scanned picture, and when the absolute value of the pixel difference on the scanning line is not greater than a preset threshold, it is determined that the pixel corresponding to the absolute value of the pixel difference is located within the edge frame; If the absolute value of the pixel difference on the scan line is greater than a preset threshold, it is determined that the pixel corresponding to the absolute value of the pixel difference is located outside the edge frame.

The device also includes: an output module, configured to output a prompt message whether to stitch the screenshots when it is detected that there are screenshots in a common area among all the screenshots; Instructions for overlapping and splicing the common areas of the screenshots with common areas into one picture.

The device also includes: a storage module, configured to save the spliced pictures and delete the screenshots used for splicing the pictures.

The splicing module includes: an image preprocessing unit, configured to preprocess the screenshots in the common area; an image registration unit, configured to perform image registration on the preprocessed screenshots in the public area an image reprojection unit, configured to perform image reprojection on the registered screenshots in the common area; and an image fusion unit, configured to perform image fusion on the screenshots in the public area.

In another aspect, the present disclosure provides a terminal device. The terminal device includes a memory and one or more programs, wherein the one or more programs are stored in the memory and are configured to be executed by one or more processors. The one or more programs include instructions for:

After monitoring the screenshot operation, obtain all the screenshot pictures within the predetermined time;

When it is detected that there are screenshots with common areas among all the screenshots, overlapping and splicing the common areas of the screenshots with common areas into one picture.

It is to be understood that both the foregoing general description and the following detailed description are exemplary only and are not restrictive of the present disclosure.

Description of drawings

The drawings described here are used to provide further understanding of the present disclosure, constitute a part of the present application, and do not limit the present disclosure. In the attached picture:

FIG. 1 is an exemplary flow chart of a method for capturing a screen image provided in Embodiment 1 of the present disclosure;

Figure 2(a) is an exemplary schematic diagram of the first screenshot;

Figure 2(b) is an exemplary schematic diagram of the second screenshot;

Figure 2(c) is an exemplary schematic diagram of the common area of the first and second screenshots;

Figure 2(d) is an exemplary schematic diagram of a picture after splicing the first picture and the second screenshot picture;

FIG. 3 is an exemplary flowchart of a method for stitching pictures according to an embodiment of the present disclosure;

FIG. 4 is an exemplary flow chart of a method for capturing a screen picture provided in Embodiment 2 of the present disclosure;

FIG. 5 is an exemplary flowchart of a method for judging whether screenshots have the same border frame in an embodiment of the present disclosure;

FIG. 6 is an exemplary flow chart of a method for capturing a screen picture provided by Embodiment 3 of the present disclosure;

FIG. 7 is an exemplary flow chart of a method for capturing a screen picture provided in Embodiment 4 of the present disclosure;

FIG. 8 is a schematic structural diagram of an apparatus for capturing a screen picture provided in Embodiment 1 of the present disclosure;

Fig. 9 is a schematic structural diagram of an exemplary splicing module in an embodiment of the present disclosure;

FIG. 10 is a schematic structural diagram of an apparatus for capturing screen pictures provided in Embodiment 2 of the present disclosure;

Fig. 11 is a schematic structural diagram of an exemplary tailoring module in an embodiment of the present disclosure;

FIG. 12 is a schematic structural diagram of an apparatus for capturing a screen picture provided in Embodiment 3 of the present disclosure;

FIG. 13 is a schematic structural diagram of an apparatus for capturing a screen picture provided in Embodiment 4 of the present disclosure;

Fig. 14 is a schematic diagram of an exemplary structure of a terminal device provided by an embodiment of the present disclosure.

By means of the above-mentioned drawings, certain embodiments of the present disclosure have been shown and will be described in more detail hereinafter. These drawings and written description are not intended to limit the scope of the disclosed concept in any way, but to illustrate the disclosed concept for those skilled in the art by referring to specific embodiments.

Detailed ways

In order to make the purpose, technical solutions and advantages of the present disclosure clearer, the present disclosure will be described in further detail below in conjunction with the implementation manners and accompanying drawings. Here, the exemplary embodiments of the present disclosure and their descriptions are used to explain the present disclosure, but not to limit the present disclosure.

Embodiments of the present disclosure provide a method, device, and terminal device for capturing a screen picture, and the present disclosure will be described in detail below with reference to the accompanying drawings.

In Embodiment 1 of the present disclosure, as shown in FIG. 1 , a method for intercepting a screen picture includes:

In step S101, after a screen capture operation is detected, all screen capture pictures within a predetermined time period are obtained, and the method of this embodiment is used in a terminal device.

The screenshot operation is an operation input by the user to capture the current full-screen image. The screen capture operation may be a click on a screen capture button, or other gesture operations for screen capture. After receiving the screenshot operation command, the terminal captures the current full-screen image and saves it in the form of a picture (temporary cache can be used). When the screen capture operation is detected for the first time, start the timer, and continue to monitor the screen capture operation. When the timer expires, stop monitoring the screenshot operation. If multiple screen capture operations are detected during the period counted by the timer, that is, multiple screen capture pictures are obtained, then continue to the following steps.

For example, if the predetermined duration of the timer is 1 minute, and a total of 3 screen capture operations are detected within 1 minute, it is determined that the contents of these 3 screen capture operations are more relevant, and splicing of screen capture images may be required.

When the timer expires, the timer stops timing and resets the timing to zero. If the screen capture operation is detected again, it is determined that this monitoring is the first screen capture operation detected, and the timer is restarted. The timer can also be used to detect the time between two screen capture operations. If the time between two screen capture operations is less than the preset duration, it is considered that the two screen capture operations are related in content, and it may be necessary to stitch the screen capture images; if If the time between two screen capture operations is greater than or equal to the preset duration, the two screen capture operations are considered to be irrelevant in content, and the screen capture images obtained by the two screen capture operations are not spliced.

For multiple screen capture operations within a predetermined duration, all screen capture images generated by each screen capture operation are acquired.

In step S102, when it is detected that there are screenshots with common areas among all the screenshots, the common areas of the screenshots with common areas are overlapped and stitched into one picture.

The common area refers to the part of the screenshots with the same content. Screenshots with common areas usually have continuity in content, and pictures can be spliced to form a complete content. If there is no common area among the multiple screenshots, it is determined that there is no continuity in content between the multiple screenshots, and splicing of the screenshots may not be performed.

For all screenshots, check whether there is a common area according to the order in which they are captured. For example, there are three screenshots, screenshot 1, screenshot 2, and screenshot 3. According to the order of capture, first check whether there is a common area between screenshot 1 and screenshot 2, and then detect between screenshot 1 and screenshot 3 Whether there is a common area, and then detect whether there is a common area between screenshots 2 and 3. If it is detected that there are screenshots with common areas, it is determined that these pictures with common areas can be spliced. Among all the captured screenshots, if there is no common area between the screenshots and any other screenshots, no image splicing is required, and they can be deleted directly.

When detecting a screenshot with a common area among all the screenshots, the common areas of the screenshots with a common area are overlapped and stitched into one image.

As shown in Figure 2(a) and Figure 2(b), the two pictures are screenshots obtained from two screen capture operations, and it is detected that there is a common area between Figure 2(a) and Figure 2(b). As shown in Figure 2(c), it is considered that Figure 2(a) and Figure 2(b) can be spliced into one picture, and the picture formed after splicing Figure 2(a) and Figure 2(b) is shown in Figure 2(d) ) shown.

Overlapping and splicing screenshots with common areas into one picture, as shown in Figure 3, includes the following steps:

In step S301, pre-processing is performed on screenshots with public areas.

Preprocessing includes removing noise from screenshots and correcting image distortion. Noise can be removed by means of mean filtering or median filtering; when correcting image distortion, a corresponding mathematical model is established, the required information is extracted from the polluted or distorted image signal, and the image is restored along the reverse process of distorting the image. Like the original appearance.

In step S302, image registration is performed on the preprocessed screenshots with common areas.

Image registration is to spatially align two or more images captured at different times, from different viewpoints, and from different cameras. The matching information in the images of screenshots with common areas is extracted, the best matching is found in the extracted information, and the alignment between images is completed. Image registration can be performed through region-based registration algorithms, such as one-by-one comparison method, layered comparison method, or phase correlation method; feature-based registration algorithms can also be used, such as scale-invariant feature transformation algorithm, ratio matching method, etc. Perform image registration.

In step S303, image re-projection is performed on the registered screenshots with common areas.

For screenshots with common areas that need to be spliced after registration, one of the screenshot images is used as a reference image, and then the other images are distorted and deformed to the coordinate system of the reference image, so that all images are projected onto In the same coordinate system, a projection transformation is completed.

In step S304, image fusion is performed on the screenshots with common areas.

After the registration of the two images is completed, and the transformation matrix between the two images is obtained by reprojection, the overlapping area between them can be determined. The task of image fusion is to combine the two images after registration according to the Accurate positions are merged into one image. Under the condition of strict image registration, the two images to be stitched are directly fused with pixel correlation; the methods that can be used include: average value method, weighted average method, median filter method, multi-resolution technology, etc.

Embodiment 1 of the present disclosure detects all screen capture operations within a predetermined time period, automatically judges whether there are public areas in the screen capture pictures, and stitches the screen capture pictures in the public area into one picture, thereby splicing the pictures that exceed the height of the screen that have been intercepted multiple times Create a picture without redundant information, which is convenient for users to share the picture.

When the user browses the content of the page up and down, some content on the screen interface is fixed, such as the information bar with time at the top and the menu bar with "forward" and other information at the bottom as shown in Figure 2 (a). For multiple screenshots, these fixed content are included, which are different from the content shown in Figure 2(c) and do not belong to the public area. In the embodiments of this disclosure, this part of the fixed content is referred to as the same edge frame. During the splicing of screenshots, the same edge frames need to be deleted, otherwise the splicing effect will be affected. For the specific implementation process, please refer to the following embodiments.

In the second embodiment of the present disclosure, as shown in FIG. 4 , a method for intercepting a screen picture includes:

In step S401, after a screen capture operation is detected, all screen capture pictures within a predetermined time period are acquired, and the method of this embodiment is used in a terminal device. The implementation process is the same as that of S101, and will not be repeated here.

In step S402, when it is detected that at least two screenshots have the same edge frame, the edge frame is cropped.

Checks if all captured screenshots have the same edge frame. The edge frame refers to the application interface or system interface located outside the content of the webpage image when the screenshot is taken, as shown in Figure 2(a) and Figure 2(b). Like” part, the above part belongs to the specific application interface, which exists in every screenshot. Therefore, in order to ensure the effect of picture stitching, it is necessary to cut off the same edge frame in each screenshot before stitching pictures.

The method for detecting whether at least two screen captures have the same edge frame among all captured screen captures is shown in Figure 5, and includes the following steps:

In step S501, group each screenshot of all screenshots in groups of two, and enumerate all grouping modes. In order to detect the edge frames that appear in all screenshots and ensure the splicing effect, all screenshots are grouped in pairs, and all grouping methods are listed, so as to detect whether there is the same edge frame between all screenshots.

In step S502, it is detected one by one whether every two screenshots have the same border frame.

For all the grouping modes listed in step S501, it is checked one by one whether the two screenshots in each group have the same border frame.

In step S503, the absolute values of the pixel differences of the pixels at the same position on each screenshot in the same group are respectively obtained, and a scanned picture is formed according to the absolute values of the pixel differences of all the pixels.

In step S504, the scanned picture is scanned, and when the absolute value of the pixel difference on the scanning line is not greater than the preset threshold, it is determined that the pixel corresponding to the absolute value of the pixel difference is located in the edge frame; If the absolute value of the pixel difference is greater than the preset threshold, it is determined that the pixel corresponding to the absolute value of the pixel difference is outside the edge frame.

Scan horizontally from the bottom edge and top edge of the scanned image to the inside of the scanned image, and scan vertically from the left and right edges of the scanned image to detect whether the surrounding edges have the same edge frame.

If the absolute value of the pixel difference on a scan line is less than or equal to the preset threshold, it is determined that the pixel corresponding to the absolute value of each pixel difference on the scan line is located within the edge frame, and scanning is continued in the corresponding direction. If the absolute value of the pixel difference value on a scan line is greater than the preset threshold, it is determined that the pixel corresponding to the absolute value of the pixel difference value is outside the edge frame.

When the absolute value of the pixel difference on a scanning line is greater than the preset threshold, it may be caused by image distortion of the pixel corresponding to the pixel difference, so when the absolute value of the pixel difference on a scanning line is greater than the preset threshold In the case of a threshold, it is possible to further calculate whether the absolute value of the sum of all pixel differences on a scan line is greater than another preset threshold, if the absolute value of the sum of all pixel differences on a scan line is greater than another preset threshold, Then it is determined that the pixel corresponding to the absolute value of each pixel difference on the scanning line is located outside the edge frame, and if the absolute value of the sum of all pixel differences on a scanning line is less than or equal to another preset threshold, it is determined that each The pixel corresponding to the absolute value of the pixel difference is located within the edge frame.

When it is detected that at least two screenshots have the same edge frame, the same edge frame is cropped. Preserve the real webpage picture content inside the screen capture picture, so that there is no edge frame in the spliced picture, and ensure the continuity of the spliced picture content.

In step S403, when it is detected that there are screenshots with common areas in all the screenshots, the common areas of the screenshots with common areas are overlapped and stitched into one picture. The implementation process is the same as that of S102, and will not be repeated here.

Embodiment 2 of the present disclosure detects the screen capture operation within a predetermined time, automatically removes the same edge frame that appears around each screen capture picture, ensures the continuity of the picture content after splicing, and judges whether there is a common area in all the screen capture pictures. The screenshots of the area are spliced into one picture, so that the pictures that exceed the height of the screen that are captured multiple times are spliced into one picture without redundant information, which is convenient for users to share the picture.

In this embodiment, in order to obtain a large picture with complete and continuous content, multiple screenshots are stitched together. However, the user may simply obtain a screen capture image, and does not need to obtain a spliced image. In order to meet the needs of various users, before automatically stitching pictures, it is necessary to solicit the user's opinion, output prompt information to the user, and then decide whether to stitch the picture according to the user's feedback. Please refer to the following examples for the specific process.

In the third embodiment of the present disclosure, as shown in FIG. 6, a method for intercepting a screen picture includes:

In step S601, after a screen capture operation is detected, all screen capture pictures within a predetermined time period are acquired, and the method of this embodiment is used in a terminal device. The implementation process is the same as that of S101, and will not be repeated here.

In step S602, when it is detected that there is a screenshot with a common area among all the screenshots, a prompt message whether to stitch the screenshots is output.

For multiple screen capture operations within a predetermined duration, obtain the screen capture pictures generated by each screen capture operation, and detect whether there is a screen capture picture in a common area among all the acquired screen capture pictures. Screenshots with common areas usually have continuity in content, and can be spliced to form a complete content.

When it is detected that there are screenshots with common areas among all the screenshots, it is considered that the screenshots with common areas can be spliced, and a prompt message is output at this time, prompting the user whether to splice the images.

In step S603, when receiving an instruction confirming to stitch pictures, overlapping and stitching the public areas with screenshots with common areas into one picture.

The instruction for confirming the image splicing comes from the user's selection or click operation on the "OK" button, or other gesture operations indicating confirmation. When receiving an instruction to confirm the stitching of pictures, the screenshots with public areas are stitched into one picture for sharing by users. The implementation process of picture splicing is the same as that of S102, so no repeated description is given here.

In another embodiment of the present disclosure, the method also includes:

In step S604, save the spliced picture and delete the screenshot used for splicing the picture.

After the stitching of the pictures is completed, the stitched pictures are saved, and all screenshots acquired within a predetermined period of time for stitching the pictures are deleted, so as to save storage space. At this time, the preservation can adopt permanent preservation.

Embodiment 3 of the present disclosure detects the screen capture operation within a predetermined time, automatically judges whether there is a public area in the screen capture picture, and if there is a public area, then outputs prompt information for the user to choose whether to stitch pictures to meet the needs of various users, such as confirmation For splicing, the screenshots in the public area will be spliced into one picture, so that the pictures that exceed the height of the screen that have been intercepted multiple times will be spliced into one picture without redundant information, which is convenient for users to share the pictures, and only the splicing can be saved Delete the captured screenshot to save storage space.

In Embodiment 4 of the present disclosure, as shown in FIG. 7 , a method for intercepting a screen picture includes:

In step S701, after a screen capture operation is detected, all screen capture pictures within a predetermined time period are acquired, and the method of this embodiment is used in a terminal device. The implementation process is the same as that of S101 and will not be repeated here.

In step S702, when it is detected that at least two screenshots have the same edge frame, the edge frame is cropped. The implementation process is the same as that of S402, and will not be repeated here.

In step S703, when it is detected that there is a screenshot with a common area among all the screenshots, a prompt message whether to stitch the screenshots is output. The implementation process is the same as that of S602, and will not be repeated here.

In step S704, when receiving the instruction confirming to join the pictures, overlap and stitch the common areas with the screenshots with common areas into one picture. The implementation process is the same as that of S603, and will not be repeated here.

In step S705, save the spliced picture and delete the screenshot used for splicing the picture. The implementation process is the same as that of S604, and will not be repeated here.

Embodiment 4 of the present disclosure detects the screen capture operation within a preset time, automatically removes the same edge frame that appears around each screen capture picture, ensures the continuity of the picture content after splicing, and judges whether there is a public area in the screen capture picture, and if there is a public area, then Output prompt information for users to choose whether to stitch pictures to meet the needs of various users. If stitching is confirmed, the screenshots in the public area will be stitched into one picture, so that the pictures that exceed the height of the screen that have been intercepted multiple times will be stitched into one. A picture without redundant information is convenient for users to share the picture, and only the spliced picture can be saved, and the captured screenshot can be deleted to save storage space.

The present disclosure provides a device for capturing a screen picture corresponding to Embodiment 1. As shown in FIG. 8 , the device includes:

An acquisition module 80, configured to acquire all screenshot pictures within a predetermined time period after the screen capture operation is detected;

The splicing module 81 is configured to overlap and splice the common areas of the screenshots with common areas into one picture when it is detected that there are screenshots with common areas in all the screenshots.

As shown in Figure 9, splicing module 81 comprises:

An image preprocessing unit 810, configured to preprocess the screenshots in the public area;

An image registration unit 811, configured to perform image registration on the pre-processed screenshots in common areas;

An image reprojection unit 812, configured to perform image reprojection on the registered screenshots in the common area;

An image fusion unit 813, configured to perform image fusion on the screenshots in the public area.

The present disclosure provides a device for capturing a screen picture corresponding to Embodiment 2, as shown in FIG. 10 , the device includes:

An acquisition module 80, configured to acquire all screenshot pictures within a predetermined time period after the screen capture operation is detected;

A clipping module 82, configured to clip the edge frame when at least two screenshots are detected to have the same edge frame;

The splicing module 81 is configured to overlap and splice the common areas of the screenshots with common areas into one picture when it is detected that there are screenshots with common areas in all the screenshots.

As shown in Figure 11, the clipping module 82 includes:

A grouping unit 820, configured to group each of the screenshots in groups of two, and enumerate all grouping modes;

A detection unit 821, configured to detect one by one whether every two screenshots have the same edge frame;

The processing unit 822 is configured to acquire the absolute values of the pixel differences of the pixels at the same position on each screenshot in the same group, and form a scanned image according to the absolute values of the pixel differences of all the pixels;

The scanning unit 823 is configured to scan the scanned picture, and when the absolute value of the pixel difference on the scanning line is not greater than a preset threshold, it is determined that the pixel corresponding to the absolute value of the pixel difference is located in the edge frame; When the absolute value of the pixel difference on the scan line is greater than the preset threshold, it is determined that the pixel corresponding to the absolute value of the pixel difference is located outside the edge frame.

The present disclosure provides a device for capturing screen pictures corresponding to Embodiment 3, as shown in FIG. 12 , the device includes:

An acquisition module 80, configured to acquire all screenshot pictures within a predetermined time period after the screen capture operation is detected;

An output module 83, configured to output prompt information whether to splice screenshots when it is detected that there are screenshots in a common area among all the screenshots;

The splicing module 81 is configured to overlap and splice the public areas of the screenshots with common areas into one picture when receiving the instruction for confirming the picture splicing.

In another embodiment of the present disclosure, the device further includes:

The storage module 84 is configured to save the spliced pictures and delete the screenshots used for splicing the pictures.

Correspondingly, the present disclosure provides a device for capturing a screen picture corresponding to Embodiment 4, as shown in FIG. 13 , the device includes:

An acquisition module 80, configured to acquire all screenshot pictures within a predetermined time period after the screen capture operation is detected;

A clipping module 82, configured to clip the edge frame when at least two screenshots are detected to have the same edge frame;

An output module 83, configured to output prompt information whether to splice screenshots when it is detected that there are screenshots in a common area among all the screenshots;

The splicing module 81 is configured to overlap and splice the public areas of the screenshots with common areas into one picture when receiving an instruction confirming to perform picture splicing;

The storage module 84 is configured to save the spliced pictures and delete the screenshots used for splicing the pictures.

Fig. 14 is a schematic structural diagram of a terminal device (which may be a requester terminal or an associated terminal) in an embodiment of the present disclosure. Referring to FIG. 14 , the terminal can be used to implement the method for capturing a screen picture provided in the above embodiments.

The terminal device 800 may include a communication unit 110, a memory 120 including one or more computer-readable storage media, an input unit 130, a display unit 140, a sensor 150, an audio circuit 160, a WIFI (Wireless Fidelity, wireless fidelity) module 170, It includes a processor 180 with one or more processing cores, a power supply 190 and other components. Those skilled in the art can understand that the structure of the terminal device shown in the figure does not constitute a limitation on the terminal device, and may include more or less components than those shown in the figure, or combine some components, or arrange different components. in:

The communication unit 110 can be used to send and receive information or receive and send signals during a call. The communication unit 110 can be an RF (Radio Frequency, radio frequency) circuit, router, modem, and other network communication equipment. In particular, when the communication unit 110 is an RF circuit, after receiving the downlink information of the base station, it is processed by one or more processors 180; in addition, the uplink data is sent to the base station. Typically, an RF circuit as a communication unit includes, but is not limited to, an antenna, at least one amplifier, a tuner, one or more oscillators, a Subscriber Identity Module (SIM) card, a transceiver, a coupler, an LNA (Low Noise Amplifier, low noise amplifier), duplexer, etc. In addition, the communication unit 110 can also communicate with a network and other devices through wireless communication. The wireless communication can use any communication standard or protocol, including but not limited to GSM (Global System of Mobile communication, Global System for Mobile Communications), GPRS (General Packet Radio Service, general packet radio service), CDMA (Code Division Multiple Access, Code Division Multiple Access), WCDMA (Wideband Code Division Multiple Access, Wideband Code Division Multiple Access), LTE (Long Term Evolution, long-term evolution), email, SMS (Short Messaging Service, short message service), etc. The memory 120 can be used to store software programs and modules, and the processor 180 executes various functional applications and data processing by running the software programs and modules stored in the memory 120 . The memory 120 can mainly include a program storage area and a data storage area, wherein the program storage area can store an operating system, at least one application program required by a function (such as a sound playback function, an image playback function, etc.), etc.; Data created using the terminal device 800 (such as audio data, phonebook, etc.) and the like. In addition, the memory 120 may include a high-speed random access memory, and may also include a non-volatile memory, such as at least one magnetic disk storage device, flash memory device, or other volatile solid-state storage devices. Correspondingly, the memory 120 may further include a memory controller to provide access to the memory 120 by the processor 180 and the input unit 130 .

The input unit 130 can be used to receive input numbers or character information, and generate keyboard, mouse, joystick, optical or trackball signal input related to user settings and function control. Preferably, the input unit 130 may include a touch-sensitive surface 131 and other input devices 132 . The touch-sensitive surface 131, also referred to as a touch display screen or a touchpad, can collect user touch operations on or near it (for example, the user uses any suitable object or accessory such as a finger, a stylus, etc. on the touch-sensitive surface 131 or on operation near the touch-sensitive surface 131), and drive the corresponding connection device according to the preset program. Optionally, the touch-sensitive surface 131 may include two parts: a touch detection device and a touch controller. Among them, the touch detection device detects the user's touch orientation, and detects the signal brought by the touch operation, and transmits the signal to the touch controller; the touch controller receives the touch information from the touch detection device, converts it into contact coordinates, and sends it to the to the processor 180, and can receive and execute commands sent by the processor 180. In addition, the touch-sensitive surface 131 can be implemented in various types such as resistive, capacitive, infrared, and surface acoustic wave. In addition to the touch-sensitive surface 131 , the input unit 130 may also include other input devices 132 . Preferably, other input devices 132 may include, but are not limited to, one or more of physical keyboards, function keys (such as volume control keys, switch keys, etc.), trackballs, mice, joysticks, and the like.

The display unit 140 can be used to display information input by or provided to the user and various graphical user interfaces of the terminal device 800. These graphical user interfaces can be composed of graphics, text, icons, videos and any combination thereof. The display unit 140 may include a display panel 141. Optionally, the display panel 141 may be configured in the form of LCD (Liquid Crystal Display, liquid crystal display), OLED (Organic Light-Emitting Diode, organic light-emitting diode), and the like. Further, the touch-sensitive surface 131 may cover the display panel 141, and when the touch-sensitive surface 131 detects a touch operation on or near it, the touch operation is sent to the processor 180 to determine the type of the touch event, and then the processor 180 determines the type of the touch event according to the type of the touch event. The type provides a corresponding visual output on the display panel 141 . Although in FIG. 14 , the touch-sensitive surface 131 and the display panel 141 are used as two independent components to realize input and input functions, in some embodiments, the touch-sensitive surface 131 and the display panel 141 can be integrated to realize input. and output functions.

The terminal device 800 may further include at least one sensor 150, such as a light sensor, a motion sensor, and other sensors. The light sensor may include an ambient light sensor and a proximity sensor, wherein the ambient light sensor may adjust the brightness of the display panel 141 according to the brightness of the ambient light, and the proximity sensor may turn off the display panel 141 and/or when the terminal device 800 moves to the ear. backlight. As a kind of motion sensor, the gravitational acceleration sensor can detect the magnitude of acceleration in various directions (generally three axes), and can detect the magnitude and direction of gravity when it is stationary, and can be used for applications that recognize the posture of mobile phones (such as horizontal and vertical screen switching, related games, magnetometer attitude calibration), vibration recognition-related functions (such as pedometer, tap), etc.; as for other sensors such as gyroscope, barometer, hygrometer, thermometer, and infrared sensor that can also be configured on the terminal device 800, here No longer.

The audio circuit 160 , the speaker 161 and the microphone 162 can provide an audio interface between the user and the terminal device 800 . The audio circuit 160 can transmit the electrical signal converted from the received audio data to the loudspeaker 161, and the loudspeaker 161 converts it into an audio signal output; After being received, it is converted into audio data, and then the audio data is processed by the output processor 180, and then sent to another terminal device through the RF circuit 110, or the audio data is output to the memory 120 for further processing. The audio circuit 160 may also include an earplug jack to provide communication between an external earphone and the terminal device 800 .

In order to realize wireless communication, a wireless communication unit 170 may be configured on the terminal device, and the wireless communication unit 170 may be a WIFI module. WIFI belongs to the short-distance wireless transmission technology. Through the wireless communication unit 170, the terminal device 800 can help users send and receive emails, browse webpages, and access streaming media, etc., and it provides users with wireless broadband Internet access. Although the wireless communication unit 170 is shown in the figure, it can be understood that it is not an essential component of the terminal device 800, and can be completely omitted as required without changing the essence of the invention.

The processor 180 is the control center of the terminal device 800, and uses various interfaces and lines to connect various parts of the entire mobile phone, by running or executing software programs and/or modules stored in the memory 120, and calling data stored in the memory 120 , execute various functions and process data of the terminal device 800, so as to monitor the mobile phone as a whole. Optionally, the processor 180 may include one or more processing cores; preferably, the processor 180 may integrate an application processor and a modem processor, wherein the application processor mainly processes operating systems, user interfaces, and application programs, etc. , the modem processor mainly handles wireless communications. It can be understood that the foregoing modem processor may not be integrated into the processor 180 .

The terminal device 800 also includes a power supply 190 (such as a battery) for supplying power to various components. Preferably, the power supply can be logically connected to the processor 180 through the power management system, so that functions such as charging, discharging, and power consumption management can be realized through the power management system. . The power supply 190 may also include one or more DC or AC power supplies, recharging systems, power failure detection circuits, power converters or inverters, power status indicators, and other arbitrary components.

Although not shown, the terminal device 800 may also include a camera, a Bluetooth module, etc., which will not be repeated here. In this embodiment, the terminal device further includes a memory, and one or more programs, wherein one or more programs are stored in the memory, and are configured to be executed by one or more processors. The program includes the following instructions for performing the method for capturing screen pictures provided by the embodiments of the present disclosure:

After monitoring the screenshot operation, obtain all the screenshot pictures within the predetermined time;

When it is detected that there are screen capture pictures with common areas among all the screen capture pictures, the common areas of the screen capture pictures with common areas are overlapped and stitched into one picture.

Before the overlapping and splicing of public areas with screenshots with public areas into one picture, the instruction also includes:

When it is detected that at least two screenshots have the same edge frame, the edge frame is cropped.

At least two screenshots were detected with the same border frame, including:

group each of all screenshots in groups of two and list all grouping methods;

Check one by one whether every two screenshots have the same edge frame;

Obtain the absolute values of the pixel differences of the pixels at the same position on each screenshot in the same group, and form a scanned image according to the absolute values of the pixel differences of all the pixels;

Scanning the scanned picture, when the absolute value of the pixel difference on the scanning line is not greater than the preset threshold, it is determined that the pixel corresponding to the absolute value of the pixel difference is located in the edge frame; when the absolute value of the pixel difference on the scanning line is If the value is greater than the preset threshold, it is determined that the pixel corresponding to the absolute value of the pixel difference is outside the edge frame.

When it is detected that there is a screenshot with a common area among all the screenshots, the instruction further includes:

Output prompt information whether to stitch screenshot images;

Overlapping public areas with screenshots with public areas into one image, including:

When receiving an instruction for confirming image splicing, overlapping and splicing public areas with screenshots with public areas into one image.

The directive also includes:

Save the stitched picture and delete the screenshot used to stitch the picture.

Overlapping public areas with screenshots with public areas into one image, including:

Preprocess screenshots in public areas;

Perform image registration on the pre-processed screenshots in public areas;

Perform image reprojection on the registered screenshots in the public area;

Image fusion is performed on screenshots that exist in common areas.

In addition, typically, the mobile terminals described in the present disclosure can be various handheld terminal devices, such as mobile phones, personal digital assistants (PDAs), etc., therefore, the protection scope of the present disclosure should not be limited to a specific type of mobile terminals.

Furthermore, the method according to the present disclosure can also be implemented as a computer program executed by a CPU. When the computer program is executed by the CPU, the above-mentioned functions defined in the method of the present disclosure are performed.

In addition, the above-mentioned method steps and system units can also be implemented by using a controller and a computer-readable storage device for storing a computer program that enables the controller to realize the functions of the above-mentioned steps or units.

In addition, it should be appreciated that the computer readable storage devices (eg, memories) described herein can be either volatile memory or nonvolatile memory, or can include both volatile and nonvolatile memory. By way of example and not limitation, nonvolatile memory can include read only memory (ROM), programmable ROM (PROM), electrically programmable ROM (EPROM), electrically erasable programmable ROM (EEPROM), or flash memory memory. Volatile memory can include random access memory (RAM), which can act as external cache memory. By way of example and not limitation, RAM is available in various forms such as Synchronous RAM (DRAM), Dynamic RAM (DRAM), Synchronous DRAM (SDRAM), Double Data Rate SDRAM (DDR SDRAM), Enhanced SDRAM (ESDRAM), Synchronous Link DRAM (SLDRAM) and Direct RambusRAM (DRRAM). Storage devices of the disclosed aspects are intended to include, but are not limited to, these and other suitable types of memory.

Those of skill would also appreciate that the various illustrative logical blocks, modules, circuits, and algorithm steps described in connection with the disclosure herein may be implemented as electronic hardware, computer software, or combinations of both. To clearly illustrate this interchangeability of hardware and software, various illustrative components, blocks, modules, circuits, and steps have been described generally in terms of their functionality. Whether such functionality is implemented as software or as hardware depends upon the particular application and design constraints imposed on the overall system. Skilled artisans may implement the described functionality in varying ways for each particular application, but such implementation decisions should not be interpreted as causing a departure from the scope of the present disclosure.

The various exemplary logical blocks, modules, and circuits described in connection with the disclosure herein can be implemented or performed using the following components designed to perform the functions described herein: general-purpose processors, digital signal processors (DSPs), special-purpose Integrated circuits (ASICs), field programmable gate arrays (FPGAs) or other programmable logic devices, discrete gate or transistor logic, discrete hardware components, or any combination of these. A general-purpose processor may be a microprocessor, but in the alternative, the processor may be any conventional processor, controller, microcontroller, or state machine. A processor may also be implemented as a combination of computing devices, e.g., a combination of a DSP and a microprocessor, multiple microprocessors, one or more microprocessors in conjunction with a DSP core, or any other such configuration.

The steps of a method or algorithm described in connection with the disclosure herein may be embodied directly in hardware, in a software module executed by a processor, or in a combination of both. A software module may reside in RAM memory, flash memory, ROM memory, EPROM memory, EEPROM memory, registers, hard disk, a removable disk, a CD-ROM, or any other form of storage medium known in the art. An exemplary storage medium is coupled to the processor such the processor can read information from, and write information to, the storage medium. In an alternative, the storage medium may be integrated with the processor. The processor and storage medium can reside in an ASIC. The ASIC may reside in a user terminal. In an alternative, the processor and storage medium may reside as discrete components in the user terminal.

In one or more exemplary designs, the functions described may be implemented in hardware, software, firmware, or any combination thereof. If implemented in software, the functions may be stored on or transmitted over as one or more instructions or code on a computer-readable medium. Computer-readable media includes both computer storage media and communication media including any medium that facilitates transfer of a computer program from one place to another. Storage media may be any available media that can be accessed by a general purpose or special purpose computer. By way of example and not limitation, the computer readable medium may include RAM, ROM, EEPROM, CD-ROM or other optical disk storage device, magnetic disk storage device or other magnetic storage device, or may be used to carry or store instructions in Any other medium that can be accessed by a general purpose or special purpose computer or a general purpose or special purpose processor, and the required program code or data structure. Also, any connection is properly termed a computer-readable medium. For example, if the software is transmitted from a website, server, or other remote source using coaxial cable, fiber optic cable, twisted pair, digital subscriber line (DSL), or wireless technologies such as infrared, radio, and microwave, then the coaxial cable Cable, fiber optic cable, twisted pair, DSL, or wireless technologies such as infrared, radio, and microwave are included in the definition of media. Disk and disc, as used herein, includes compact disc (CD), laser disc, optical disc, digital versatile disc (DVD), floppy disk, blu-ray disc where disks usually reproduce data magnetically, while discs reproduce data optically with lasers . Combinations of the above should also be included within the scope of computer-readable media.

While the foregoing disclosure shows exemplary embodiments of the present disclosure, it should be noted that various changes and modifications can be made without departing from the scope of the present disclosure as defined in the claims. The functions, steps and/or actions of the method claims in accordance with the disclosed embodiments described herein need not be performed in any particular order. Furthermore, although elements of the disclosure may be described or claimed in individual form, multiples are also contemplated unless expressly limited to the singular.

The specific implementations described above further describe the purpose, technical solutions and beneficial effects of the present disclosure in detail. It should be understood that the above descriptions are only specific implementations of the present disclosure and are not intended to limit the scope of the present disclosure Protection scope, within the spirit and principles of the present disclosure, any modification, equivalent replacement, improvement, etc., shall be included in the protection scope of the present disclosure.

Claims (13)

1. a method for screen printing picture, is characterized in that, described method comprises:

Monitor after screenshotss operation, obtain all screenshotss pictures in scheduled duration;

Detecting while having the screenshotss picture that has public domain in described all screenshotss pictures, is a pictures by the described described public domain lap splice with the screenshotss picture that has public domain.

2. the method for claim 1, is characterized in that, described is before a pictures by the described described public domain lap splice with the screenshotss picture that has public domain, and described method also comprises:

When at least two screenshotss pictures being detected and there is identical edge frame, cut out described edge frame.

3. method as claimed in claim 2, is characterized in that, described at least two screenshotss pictures detected and there is identical edge frame, comprising:

By each the screenshotss picture in all screenshotss pictures take two divide into groups as one group, and list all packet modes;

Detect one by one every two screenshotss pictures and whether there is identical edge frame;

Obtain respectively in same grouping the absolute value of the pixel value difference of the pixel of same position on each screenshotss picture, and form scanned picture according to the absolute value of the pixel value difference of all pixels;

Described scanned picture is scanned, and the absolute value of the pixel value difference on sweep trace is not more than predetermined threshold value, judges that the pixel corresponding to absolute value of described pixel value difference is positioned at edge frame; The absolute value of the pixel value difference on sweep trace is greater than predetermined threshold value, judges that the pixel corresponding to absolute value of described pixel value difference is positioned at outside edge frame.

4. the method for claim 1, is characterized in that, described in detect while thering is the screenshotss picture that has public domain in described all screenshotss pictures, described method also comprises:

The information whether output carries out the splicing of screenshotss picture;

By the described described public domain lap splice with the screenshotss picture that has public domain, be a pictures, comprise:

While receiving the confirmation the instruction of carrying out picture splicing, by the described described public domain lap splice with the screenshotss picture that has public domain, be a pictures.

5. the method as described in claim 1 or 4, is characterized in that, described method also comprises:

Preserve spliced picture and delete for splicing the screenshotss picture of described picture.

6. the method for claim 1, is characterized in that, described is a pictures by the described described public domain lap splice with the screenshotss picture that has public domain, comprising:

The described screenshotss picture of public domain that exists is carried out to pre-service;

The pretreated described screenshotss picture of public domain that exists is carried out to image registration;

The described screenshotss picture of public domain that exists after registration is carried out to image reprojection;

The described screenshotss picture of public domain that exists is carried out to image co-registration.

7. a device for screen printing picture, is characterized in that, described device comprises:

Acquisition module, for monitoring after screenshotss operation, obtains all screenshotss pictures in scheduled duration;

Concatenation module when having the screenshotss picture that has public domain in described all screenshotss pictures, is a pictures by the described described public domain lap splice with the screenshotss picture that has public domain.

8. device as claimed in claim 7, is characterized in that, described device also comprises:

Cut out module, for when at least two screenshotss pictures being detected and there is identical edge frame, cut out described edge frame.

9. device as claimed in claim 8, is characterized in that, described in cut out module and comprise:

Grouped element, for each screenshotss picture of all screenshotss pictures be take two divide into groups as one group, and list all packet modes;

Whether detecting unit, have identical edge frame for detecting one by one every two screenshotss pictures;

Processing unit, for obtaining respectively the absolute value of the pixel value difference of the pixel of same position on each screenshotss picture of same grouping, and forms scanned picture according to the absolute value of the pixel value difference of all pixels;

Scanning element, for described scanned picture is scanned, the absolute value of the pixel value difference on sweep trace is not more than predetermined threshold value, judges that the pixel corresponding to absolute value of described pixel value difference is positioned at edge frame; The absolute value of the pixel value difference on sweep trace is greater than predetermined threshold value, judges that the pixel corresponding to absolute value of described pixel value difference is positioned at outside edge frame.

10. device as claimed in claim 7, is characterized in that, described device also comprises:

Output module, when thering is the screenshotss picture that has public domain in described all screenshotss pictures, the information whether output carries out the splicing of screenshotss picture;

When described concatenation module is used for receiving the confirmation the instruction of carrying out picture splicing, by the described described public domain lap splice with the screenshotss picture that has public domain, be a pictures.

11. devices as described in claim 7 or 10, is characterized in that, described device also comprises:

Memory module, for preserving spliced picture and deleting for splicing the screenshotss picture of described picture.

12. devices as claimed in claim 7, is characterized in that, described concatenation module comprises:

Image pretreatment unit, for carrying out pre-service to the described screenshotss picture of public domain that exists;

Image registration unit, for carrying out image registration to the pretreated described screenshotss picture of public domain that exists;

Image reprojection unit, carries out image reprojection for the described screenshotss picture of public domain that exists to after registration;

Image co-registration unit, for carrying out image co-registration to the described screenshotss picture of public domain that exists.

13. 1 kinds of terminal devices, it is characterized in that, terminal device includes storer, and one or more than one program, the above program of one of them or one is stored in storer, and is configured to carry out described one or above routine package containing for carrying out the instruction of following operation by one or above processor:

Monitor after screenshotss operation, obtain all screenshotss pictures in scheduled duration;

Detecting while having the screenshotss picture that has public domain in described all screenshotss pictures, is a pictures by the described described public domain lap splice with the screenshotss picture that has public domain.

Images