CN112035126A - Processing method and device for gray release, electronic equipment and storage medium - Google Patents

Abstract

The present application discloses a processing method for grayscale publishing, relates to the technical field of deep learning, and can be used in the fields of cloud computing, computer vision, natural language processing, and the like. The specific implementation scheme is: in response to the grayscale version of the application being released in grayscale, acquiring at least one of the following data: heatmap data, specific business data, crash data, and user feedback data, where the heatmap data is used to represent The user's usage of the grayscale version, the specific business data includes specific data generated by the user using the grayscale version; and the grayscale period of this grayscale release is controlled according to the acquired data.

Description

Processing method and device, electronic device and storage medium for grayscale publishing

technical field

The present application relates to the field of grayscale testing, and in particular, to a processing method and apparatus for grayscale release, an electronic device, and a storage medium.

Background technique

With the continuous development of the mobile Internet, there are more and more types of APPs on the mobile terminal, and their functions are getting stronger and stronger. At the same time, the number of users is also increasing. Before the APP is released in full, it will be released in grayscale. Grayscale release refers to a release method that can smoothly transition between black and white. A/B test can be carried out on it, that is, let some users continue to use product feature A, and some users start to use product feature B. If users have no objection to B, then gradually expand the scope and migrate all users to B. Come. Grayscale release can ensure the stability of the overall system, and problems can be found and adjusted in the grayscale release stage to ensure the performance of the APP.

SUMMARY OF THE INVENTION

The present application provides a processing method and apparatus for grayscale release, an electronic device, and a storage medium.

According to a first aspect, a processing method for grayscale publishing is provided, comprising: in response to grayscale publishing of a grayscale version of an application, acquiring at least one of the following data: heat map data, specific business data , crash data, and user feedback data, wherein the above-mentioned heat map data is used to represent the user's use of the above-mentioned grayscale version, and the above-mentioned specific business data includes specific data generated by the user using the above-mentioned grayscale version; The grayscale period of this grayscale release is controlled.

According to a second aspect, a processing device for grayscale publishing is provided, comprising: an acquisition module configured to acquire at least one of the following data in response to grayscale publishing of a grayscale version of an application: a heat map data, specific business data, crash data, and user feedback data, wherein the above-mentioned heat map data is used to represent the user's use of the above-mentioned grayscale version, and the above-mentioned specific business data includes specific data generated by the user using the above-mentioned grayscale version; and control The module is used to control the grayscale period of this grayscale release according to the acquired data.

According to a third aspect, an electronic device is provided, comprising: at least one processor; and a memory communicatively connected to the at least one processor; wherein the memory stores instructions executable by the at least one processor, the instructions is executed by the at least one processor, so that the at least one processor can execute the method of the embodiments of the present application.

According to a fourth aspect, a non-transitory computer-readable storage medium storing computer instructions is provided, including: the above-mentioned computer instructions are used to cause the above-mentioned computer to execute the method of the embodiments of the present application.

According to the technical solutions provided by the embodiments of the present application, the grayscale period released according to the grayscale is used to control the grayscale period released according to the grayscale (such as heat map data, specific business data, crash data, user feedback data, etc.) Experience sets the grayscale period for grayscale publishing to a fixed value. In the process of implementing the embodiments of the present application, the inventor found that: if the grayscale period is set too long, once there is a problem in the grayscale version, the experience of the grayscale user will be affected for a long time; if the grayscale period is set too short , there may be a large risk of deviation between the evaluation results and the actual situation. With the embodiments of the present application, since the grayscale period for grayscale release is controllable rather than fixed, the above problems caused by unreasonable setting of the grayscale period (eg, too long or too short) can be avoided.

It should be understood that the content described in this section is not intended to identify key or critical features of the embodiments of the application, nor is it intended to limit the scope of the application. Other features of the present application will become readily understood from the following description.

Description of drawings

The accompanying drawings are used for better understanding of the present solution, and do not constitute a limitation to the present application. in:

FIG. 1 schematically shows an exemplary application scenario to which the processing method and apparatus for grayscale publishing according to the embodiments of the present application can be applied;

FIG. 2 schematically shows a flowchart of a processing method for grayscale publishing according to an embodiment of the present application;

FIG. 3 schematically shows a schematic diagram of a heat map according to an embodiment of the present application;

FIG. 4 schematically shows a schematic diagram of a processing method for grayscale publishing according to another embodiment of the present application;

FIG. 5 schematically shows a block diagram of a processing method for grayscale publishing according to an embodiment of the present application;

FIG. 6 schematically shows a block diagram of an electronic device used to implement the processing method for grayscale publishing according to the embodiment of the present application.

Detailed ways

Exemplary embodiments of the present application are described below with reference to the accompanying drawings, which include various details of the embodiments of the present application to facilitate understanding, and should be considered as exemplary only. Accordingly, those of ordinary skill in the art will recognize that various changes and modifications of the embodiments described herein can be made without departing from the scope and spirit of the present application. Also, descriptions of well-known functions and constructions are omitted from the following description for clarity and conciseness.

To put it simply, grayscale release is to let some users use the newly released version for a period of time according to a certain release strategy, and observe the grayscale test indicators of these users using the new version. After a period of time, all grayscale test indicators are normal, then the new version will be released to all users. Otherwise, after fixing the problems in the new version, re-release in grayscale until the grayscale test indicators are normal.

It should be understood that grayscale publishing has three elements: the number of users of grayscale publishing, the grayscale publishing period, and the evaluation result of grayscale publishing.

In the process of implementing the embodiments of the present application, the inventor found that the grayscale publishing scheme provided in the related art has the following problems: (1) the grayscale period of grayscale publishing is generally fixed, such as 3 days; (2) grayscale publishing The number of users released is mainly determined based on experience, such as 100,000.

Regarding the above problem (1), the inventor further found that: since the grayscale period of the grayscale release is fixed, if the grayscale period is set too long, the grayscale version may be affected for a long time due to potential problems in the grayscale version. Or, if the grayscale time is set too short, there is a risk that the evaluation result deviates too much from the actual one.

Regarding the above-mentioned problem (2), the inventor further found that since the number of users published in grayscale is determined by experience, it is impossible to accurately estimate how many users are reasonable. If the grayscale samples are too small (that is, the number of users released by the grayscale is too small), there may be a risk that the evaluation results deviate too much from the actual due to insufficient grayscale samples; or, if the grayscale samples are too large (that is, Grayscale releases too many users), it may affect the experience of too many users due to potential problems in the grayscale version.

In this regard, the embodiment of the present application provides a scheme for grayscale publishing, which can be based on various grayscale test index data obtained after the grayscale publishing starts, such as heat map data, specific business data, crash data, and user feedback Data, etc., to control the life cycle (ie life period) of grayscale publishing, so as to achieve the purpose of reasonably determining the number of users of grayscale publishing and rationally planning the grayscale period of grayscale publishing, so as to achieve accurate and scientific evaluation of grayscale publishing. The technical effect of the result.

FIG. 1 schematically shows an exemplary application scenario to which the processing method and apparatus for grayscale publishing according to the embodiments of the present application can be applied. It should be noted that what is shown in FIG. 1 is only an example of an application scenario to which the embodiments of the present application can be applied, so as to help those skilled in the art to understand the technical content of the present application, but it does not mean that the embodiments of the present application cannot be used for other environment or scene.

As shown in FIG. 1 , in the application scenario of the embodiment of the present application, the application 100 may include an old version 101 and a new version 102 . During the transition period, while continuing to implement the old version 101, the new version 102 may be released in grayscale as a grayscale version (also known as grayscale testing).

In addition, in this embodiment of the present application, after the new version 102 is released in grayscale, various types of grayscale test indicator data (such as heat map data, specific business data, crash data, User feedback data, etc.) to control the grayscale period and the number of users of the grayscale release, so as to achieve the purpose of reasonably determining/planning the grayscale period and the number of users of the grayscale release.

It should be understood that, in this embodiment of the present application, the grayscale period refers to the time period from the start of the grayscale release to the end of the grayscale release, which may include the start of the grayscale release, the continuous increase of the grayscale user volume, and the end of the grayscale release. stage.

The present application will be described in detail below with reference to specific embodiments.

According to the embodiments of the present application, the present application provides a processing method for grayscale publishing.

FIG. 2 is a flowchart of a processing method for grayscale publishing according to an embodiment of the present application.

As shown in FIG. 2, the method 200 may include operations S210 and S220.

In operation S210, in response to the grayscale version of the application being released in grayscale, at least one of the following data is acquired: heat map data, specific service data, crash data, and user feedback data. The heat map data is used to represent the user's usage of the grayscale version. The specific service data includes specific data generated by the user using the grayscale version.

In operation S220, the grayscale period of the current grayscale release is controlled according to the acquired data.

It should be noted that, the processing method for grayscale release provided by the embodiment of the present application can be used to perform related processing of grayscale release for any application, which is not limited in the embodiment of the present application.

In one embodiment, various data (such as heat map data, specific business data, crash data, and user feedback data) during the gray-scale period can be acquired through the data collection and analysis subsystem for analysis and processing, and corresponding processing results are obtained, and then The grayscale period of the current grayscale release is controlled by the grayscale process control subsystem according to the above-mentioned processing results.

In this embodiment of the present application, after the grayscale release is performed, the user's usage of the grayscale version can be displayed through a heat map. Therefore, after the grayscale release is performed, the heat map data associated with the grayscale version can be requested in real time, so as to control the grayscale period of this grayscale release based on the data.

It should be noted that the heat map can show the usage of different functions in the grayscale version with different brightness. For example, the more usage times and the longer the access duration, the higher the brightness, the less usage times and the longer the access duration. Short function blocks are displayed with lower brightness. In one embodiment, after a period of time after the release of grayscale, the usage of each function (that is, the complete set of functions) in the grayscale version by grayscale users can be counted, including the number of visits and the duration of the visit, and the statistical results can be converted into The heatmap is displayed. Or, in another embodiment, after a period of time after the release of grayscale, the usage of each core function and each new function in the grayscale version by grayscale users can also be counted, including the number of visits, the visit duration, etc., And convert the statistical results into a heat map for display.

In one embodiment, in response to the grayscale user's usage coverage of all functions in the grayscale version reaching a coverage threshold, the current grayscale release may be controlled to end. In another embodiment, in response to the grayscale user's usage coverage of all core functions and all new functions in the grayscale version reaching a coverage threshold, the current grayscale release may be controlled to end.

It should be noted that, in addition to the heat map showing the usage of different functions in the grayscale version with different brightness, specific service data can also show the usage of different functions in the grayscale version by grayscale users. Therefore, in this embodiment of the present application, after the grayscale release is performed, specific service data associated with the grayscale version can also be requested in real time, so as to control the grayscale period of this grayscale release based on the data. It should be understood that the specific service data may be the call data of a grayscale user using a specific service (such as a navigation service of an electronic map).

In one embodiment, in response to the actual number of invocations of each function in the grayscale version by the grayscale user reaching the first invocation number threshold, the current grayscale release may be controlled to end. In another embodiment, in response to the actual number of calls made by the grayscale user to each core function and each newly added function in the grayscale version reaching the second calling number threshold, the current grayscale release may also be controlled to end.

In addition, it should be noted that, in the embodiment of the present application, the specific service data required by the embodiment of the present application may be obtained from the service end through a dedicated API interface. Specifically, after the business processing program of the application software (gray version) is executed, the specific business data can be reported to the gray publishing system through the API interface, and then the gray publishing system can report the specific service data to the gray publishing system according to the pre-configured test data (such as the first A threshold for the number of invocations and a threshold for the second invocation number) for analysis, so that this part of data can be analyzed and queried in real time.

In addition, it should be understood that the above-mentioned crash data is used to represent the situation that the software exits abnormally (including flashback) during the process of using the grayscale version by the grayscale user. By collecting the above-mentioned crash data of the grayscale version and analyzing the crash data, the crash rate of the grayscale version can be monitored in real time, and the grayscale period of this grayscale release can be controlled based on the crash rate.

In addition, it should be understood that the user feedback data (data fed back by the grayscale user) is a software problem that is actively reported by the grayscale user through the feedback portal in the process of using the grayscale version. By obtaining the data fed back by the grayscale users for the grayscale version, the quality of the grayscale version can be more accurately controlled, and at the same time, the grayscale period of this grayscale release can be controlled according to the data.

In the related art, the grayscale period of grayscale release is fixed, so it is unavoidable that related problems are easily caused due to unreasonable grayscale period settings (if the grayscale period is too long, once there is a problem in the grayscale version, it will take a long time. Affect the experience of grayscale users, or if the grayscale period is too short, there may be a risk of a greater deviation between the evaluation result and the actual situation.) Compared with the embodiment of the present application, the grayscale period released by the grayscale is not fixed. Instead, it can be controlled according to various grayscale index data, so it can overcome the above problems and achieve the purpose of reasonably planning the grayscale period and the number of grayscale users.

In one embodiment, according to the acquired data, controlling the grayscale period of the current grayscale release may include, for example, the following operations.

According to the obtained crash data, get the crash rate of the grayscale version.

If the crash rate reaches the crash rate threshold, the current grayscale release is controlled to end.

In this embodiment of the present application, if the obtained data includes crash data, and the crash rate of the grayscale version calculated according to the crash data reaches the crash rate threshold, the current grayscale release is controlled to end. Optionally, while controlling the end of this grayscale release, an alarm is performed, so as to notify the relevant person in charge of this grayscale release to handle the alarm event.

In addition, in the embodiment of the present application, if the crash rate of the gray-scale version calculated according to the above-mentioned crash data has not reached the crash rate threshold, it is determined whether to control the end of this gray-scale release based on other types of gray-scale index data. And continue to increase the volume of grayscale users.

Through the embodiments of the present application, after the grayscale version is released in grayscale, once it is found that the crash rate of the application reaches the preset crash rate threshold, the grayscale release can be ended, thereby avoiding potential problems in the grayscale version. Time affects the experience of grayscale users.

In another embodiment, according to the acquired data, controlling the grayscale period of the current grayscale release may include, for example, the following operations.

According to the user feedback data, the user's comment information and/or rating information on the grayscale version is obtained.

If the comment information and/or the rating information indicate a negative comment, the current grayscale publishing is controlled to end.

In this embodiment of the present application, the data fed back by the user can be analyzed, for example, including analyzing sensitive words therein, analyzing their categories (such as navigation, driving, etc. in an electronic map), etc. Analysis results are processed using built-in strategies. For example, if the analysis result indicates that the current comment is a negative comment, it is possible to control the end of this grayscale release. Optionally, while controlling the end of this grayscale release, an alarm is performed, so as to notify the relevant person in charge of this grayscale release to handle the alarm event.

In addition, in this embodiment of the present application, if the comment information and/or rating information obtained according to the above-mentioned user feedback data indicates a positive comment (a comment opposite to a negative comment), then the judgment is made based on other types of grayscale index data. Whether to control the end of this grayscale release and continue to increase the volume of grayscale users.

Through the embodiments of the present application, after the grayscale version is released in grayscale, once it is found that the application has received negative comments, the grayscale release can also be ended, thereby avoiding potential problems in the grayscale version that affect the grayscale for a long time. user experience.

In another embodiment, the method may further include the following operations.

According to the obtained crash data, get the crash rate of the grayscale version.

According to the obtained user feedback data, the user's comment information and/or rating information on the grayscale version is obtained.

If the crash rate has not reached the crash rate threshold, and the comment information and/or the rating information indicates a positive comment, it is determined whether the current actual number of users of the gray-scale version reaches the maximum number of users.

In response to determining that the actual number of users reaches the maximum number of users, the current grayscale release is controlled to end.

In the embodiment of the present application, in addition to pre-setting the above-mentioned crash rate threshold and positive and negative comment rules, the maximum number of users of the gray-scale version can also be set. Therefore, after the grayscale release starts, if it is determined according to the acquired crash data that the current crash rate has not reached the crash rate threshold, and based on the acquired user feedback data, it is determined that the grayscale user's comment information and/or rating information on the grayscale version is currently If it is presented as a positive comment, you can also control the end of this grayscale release according to the maximum number of users.

It should be understood that if the current crash rate has not reached the crash rate threshold and the grayscale user's comment information and/or rating information on the grayscale version is currently presented as a positive comment, it means that the grayscale version is presented as in good condition.

In addition, in this embodiment of the present application, if the comment information and/or rating information obtained according to the above-mentioned user feedback data indicates a positive comment (a comment opposite to a negative comment), then the judgment is made based on other types of grayscale index data. Whether to control the end of this grayscale release and continue to increase the volume of grayscale users.

Through the embodiments of the present application, after the grayscale version is released in grayscale, even if the crash rate of the application does not reach the preset value, the current comment is not negative, and the current grayscale can also be controlled according to the maximum number of users The release is over so that the application can be officially released, so that all users can enjoy the new functions of the application as soon as possible.

Further, in one embodiment, the method may further include the following operations.

In response to determining that the actual number of users of the gray version has not reached the preset maximum number of users, it is determined whether the actual usage coverage of the gray version by the user reaches the coverage threshold according to the acquired heat map data and/or specific service data.

In response to determining that the actual usage coverage reaches the coverage threshold, the current grayscale release is controlled to end.

In this embodiment of the present application, in addition to pre-setting the above-mentioned crash rate threshold, positive and negative comment rules, and the maximum number of users of the gray version, a usage coverage threshold of the gray version may also be set. Therefore, after the grayscale release starts, if it is determined according to the acquired crash data that the current crash rate has not reached the crash rate threshold, and based on the acquired user feedback data, it is determined that the grayscale user's comment information and/or rating information on the grayscale version is currently If it appears as a positive comment, and the actual number of users of the current grayscale version has not yet reached the preset maximum number of users, the end of this grayscale release can also be controlled according to the usage coverage threshold of the grayscale version.

It should be understood that if the current crash rate has not reached the crash rate threshold and the grayscale user's comment information and/or rating information on the grayscale version is currently presented as a positive comment, it means that the grayscale version is presented as in good condition. In this case, the preset maximum number of users can ensure that enough test samples can be obtained, and then it can be ensured that the results of this grayscale release can be scientifically evaluated based on the test samples. However, in the embodiment of the present application, by setting the coverage threshold, even if the current number of users has not reached the preset maximum number of users, in response to the actual use coverage of the gray version reaching the preset coverage threshold, you can also Control the end of this grayscale release. This is because the pre-set coverage threshold can also ensure that enough test samples are obtained, and then it can be ensured that the results of this grayscale release can be scientifically evaluated based on the test samples.

It should be noted that whether the grayscale user will feedback data for the grayscale version depends on the subjective behavior of the grayscale user, which may not be consistent with the objective reality. For example, in one case, there are obvious problems with the grayscale version, and many grayscale users have found these problems when using them, but not all grayscale users may be willing to report these problems. Therefore, if the user feedback data is only used as an indicator to control the grayscale period of this grayscale release or to evaluate the results of this grayscale release, it may lead to unreasonable control of the grayscale period, or the results of the grayscale comment may differ from does not actually match.

However, through the embodiment of the present application, after the grayscale version is released in grayscale, even if the crash rate of the application does not reach the preset value, the current comment is not negative, and the number of grayscale users has not reached the maximum amount. The end of this grayscale release is controlled according to the usage of the application by grayscale users, so that the application can be officially released, so that all users can enjoy the new functions of the application as soon as possible.

And through the embodiments of the present application, the results of the grayscale release can be evaluated scientifically and in a timely manner, so as to ensure the quality of the products released in full as much as possible.

Further, in one embodiment, the method may further include: in response to the actual usage coverage of the grayscale version not reaching a preset coverage threshold, controlling the number of users of the grayscale version to continue to increase.

In the embodiment of the present application, if the current crash rate has not reached the preset crash rate threshold, the current comments of the grayscale users on the grayscale version are presented as positive comments as a whole, and the actual number of users of the grayscale version has not reached the threshold. The preset maximum number of users, and the actual usage coverage of the grayscale version does not reach the preset coverage threshold, you can control the grayscale release to continue, and control the number of users of the grayscale version to continue in the process. increase.

Through the embodiments of the present application, the amount of users released in grayscale is not set based on experience, nor is it fixed, but can be controlled by controlling the grayscale period, so the following problems caused by unreasonable user amount settings can be avoided : That is, if the number of users is too large, once there is a problem in the grayscale version, it will affect the experience of a large number of grayscale users; or, if the number of users is too small, there may be a deviation between the evaluation results and the actual situation due to insufficient samples greater risk.

Or, further, in another embodiment, determining whether the actual usage coverage of the grayscale user with respect to the grayscale version reaches a preset coverage threshold, for example, may include at least one of the following. It is determined whether the actual usage coverage of the core functions and new functions of the gray-scale version by the user reaches the first coverage threshold. Determine whether the actual usage coverage of the grayscale version in different operating environments reaches the second coverage rate threshold, where the operating environment includes at least one of the following: hardware environment (eg, different models), operating system, system version, and service interface.

For the newly upgraded version, the software developer may pay more attention to the core functions and new functions of the new version. Therefore, in an embodiment of the present application, it can only be determined whether the actual usage coverage of the core functions and newly added functions of the gray version by the user reaches the first coverage rate threshold, without determining all the functions of the gray version by the user Whether the actual use coverage reaches the preset coverage threshold, which can improve the test efficiency.

In addition, in another embodiment of the present application, by determining whether the actual use coverage of the gray version in different operating environments reaches the second coverage threshold, multi-dimensional data can be aggregated and analyzed to draw a more objective conclusion, In this way, the grayscale period of the grayscale release can be controlled more accurately. Moreover, through the embodiments of the present application, multi-dimensional data can be aggregated and analyzed during the grayscale publishing process, and a more objective conclusion can be drawn, thereby avoiding the defect of one-sided test results.

In one embodiment, according to the heat map data, determining whether the user's actual usage coverage for the gray-scale version reaches a coverage threshold may, for example, include the following operations.

According to the heat map data, the corresponding heat map is generated.

Compare the heatmap to a baseline heatmap for similarity to determine if actual usage coverage is reaching a coverage threshold.

Exemplarily, as shown in FIG. 3 , the heat map 300 represents a reference heat map, wherein the usage of Func1 to Func5 can be represented by different colors under one color system (such as red), and the lighter the color, the lower the heat; The usage of Func6 to Func10 can be represented by a different color under another color system (such as green), similarly, the lighter the color, the lower the heat; the use of Func11 to Func15 can be represented by another color system (such as blue) The different colors under the color) indicate that the lighter the color, the lower the heat.

In an embodiment of the present application, by collecting the heat map data of the grayscale version, and performing intelligent matching analysis on the heatmap data with the reference heatmap data, the usage coverage of the grayscale version by the grayscale user is judged. In addition, the heat map data is converted to generate a heat map, and the similarity is compared with the reference heat map. Image recognition technology can also easily and intuitively judge the gray-scale user's usage coverage of the gray-scale version.

Through the embodiments of the present application, in the field of grayscale testing, a heat map is introduced to represent the use of grayscale versions by grayscale users, and the life cycle of grayscale is controlled through AI intelligent matching and image recognition technology. Accurately determine the number of users released by grayscale, reasonably plan the grayscale period, and scientifically evaluate the evaluation results released by grayscale.

In one embodiment, the method may further include the following operations.

Get real-time heatmap data, business-specific data, crash data, and user feedback data associated with the grayscale version.

According to the data acquired in real time, the grayscale version is analyzed and a grayscale release report is obtained.

Specifically, in this embodiment of the present application, the grayscale evaluation subsystem can comprehensively analyze the data obtained for the grayscale release, thereby generating a grayscale version of the grayscale report. The grayscale report can help testers to clearly and clearly understand the grayscale indicator data at various stages in the life cycle of the grayscale release. By summarizing, analyzing, machine evaluation and visual display of these data, it can help the person in charge of grayscale publishing to make correct decisions.

Further, in an embodiment, the method may further include: configuring at least one of the following parameters for the gray period of the subsequent grayscale release according to the above-mentioned data acquired in real time: a crash rate threshold, a maximum number of users, and a coverage threshold .

In the embodiment of the present application, the complete data of each grayscale release is analyzed and optimized through machine learning, which can provide more realistic parameters (such as crash rate threshold, maximum number of users and Coverage thresholds, etc.) to provide data support for reducing product risks and improving product quality.

Through the embodiments of the present application, through machine learning, relevant parameters of grayscale release are set within a more reasonable range, thereby providing more accurate grayscale period control for subsequent grayscale release.

The present application is described in detail below with a specific embodiment.

As shown in FIG. 4 , the grayscale system may include: a grayscale process control subsystem, a data collection and analysis subsystem, and a grayscale result evaluation subsystem. The grayscale process control subsystem includes two parts: console and API interface. The console is an application that runs on the server side.

Specifically, the console can manage the life cycle of grayscale publishing, and the console is also the entrance of grayscale publishing. When performing grayscale publishing, you can configure the relevant parameters of grayscale publishing in the console. Exemplarily, through the console, you can configure the initial volume (such as 0), incremental volume, and maximum volume (that is, the maximum number of users) of the grayscale user, and you can also configure the control conditions and other parameters of the grayscale period (such as Specific business parameters, including access times, access duration, service invocation data, etc.) Wherein, the initial volume number represents the first volume number of grayscale users (eg, 0) after the grayscale release starts. Incremental volume indicates the incremental volume counted per hour after Grayscale Publishing enters the continuous volume phase. The maximum volume number indicates the maximum number of users of grayscale publishing. When this value is reached, the current grayscale publishing can be ended. The control conditions for configuring the grayscale period (ie, the life cycle configuration) may include: (1) configuring the maximum number of users for grayscale users; (2) configuring positive comment rules and negative comment rules for user feedback data; (3) for When the crash rate threshold of the gray version is configured; (4) the coverage threshold is configured according to the usage of the gray version by gray users, and so on.

In this embodiment of the present application, the grayscale life cycle may include four stages: grayscale start (grayscale release start), continuous volume increase, grayscale pause, and grayscale end (grayscale release end). It should be understood that, in this embodiment of the present application, the grayscale end stage can be directly entered after the grayscale is suspended.

It should be noted that, in the embodiment of the present application, the parameter configuration can be implemented manually through the console when the parameter configuration is performed for the first time, and the subsequent automatic configuration can be performed according to the machine learning result. Further, the automatically configured parameters can also be manually adjusted.

The API interface is a set of programming interfaces provided by this grayscale system. The ability of other external systems to access the grayscale system can be realized through this set of interfaces. After the specific business of other external systems is executed, the specific business data can be written into the grayscale system through the API interface.

The data collection and analysis subsystem can read all life cycle data released by Grayscale, such as user feedback data, crash data, heat map data and specific business data, so that the Grayscale process control subsystem can obtain these data and based on the obtained data. The data controls the grayscale life cycle (that is, the grayscale period of the grayscale release) in real time.

The grayscale result evaluation subsystem can generate a grayscale report based on the data collected by the data collection and analysis subsystem in the grayscale release of the entire life cycle, and at the same time through the grayscale release of the data collected by the data collection and analysis subsystem. Through analysis and system learning optimization, an optimized grayscale parameter model can be obtained by training, so that the relevant parameters of subsequent grayscale releases can be more accurately controlled.

With the rapid development of the mobile Internet and the rapid iteration of software today, the embodiments of the present application can greatly improve the efficiency of grayscale testing, and significantly improve the commercial value of software products (for example, enabling users to use new versions of APPs earlier) .

In addition, through the embodiments of the present application, the number of grayscale users can be accurately determined to avoid risks caused by samples that are too small or too large; the grayscale period of the grayscale release can be reasonably planned to avoid a problem version, because the fixed The grayscale period affects the user experience for a long time; the results of the grayscale can be scientifically evaluated, and the data of all dimensions can be collected and analyzed in real time to avoid one-sided drawing of wrong conclusions.

According to an embodiment of the present application, the present application further provides a processing apparatus for grayscale release.

FIG. 5 is a block diagram of a processing apparatus for grayscale distribution according to an embodiment of the present application.

As shown in FIG. 5 , the processing device 500 for grayscale publishing includes an acquisition module 501 (a first acquisition module) and a control module 502 .

In one embodiment, the obtaining module 501 is configured to obtain at least one of the following data in response to the grayscale release of the grayscale version of the application: heat map data, specific business data, crash data, and user feedback data, The above-mentioned heat map data is used to represent the user's usage of the above-mentioned gray-scale version, and the above-mentioned specific service data includes specific data generated by the user using the above-mentioned gray-scale version.

The control module 502 is configured to control the grayscale period of the current grayscale release according to the acquired data.

In one embodiment, the control module may include: a first acquisition unit and a first control unit. The first obtaining unit is configured to obtain the crash rate of the grayscale version according to the crash data. The first control unit is configured to control the end of this grayscale release when the collapse rate reaches the threshold of the collapse rate.

In another embodiment, the control module may include: a second acquisition unit and a second control unit. The second obtaining unit is configured to obtain the user's comment information and/or rating information on the grayscale version according to the user feedback data. The second control unit is configured to control the end of this grayscale release when the comment information and/or the rating information indicate a negative comment.

In another embodiment, the control module may further include: a third obtaining unit, a fourth obtaining unit, a first determining unit, and a third controlling unit. The third obtaining unit is configured to obtain the crash rate of the grayscale version according to the crash data. The fourth obtaining unit is configured to obtain the user's comment information and/or rating information on the grayscale version according to the user feedback data. A first determination unit, configured to determine whether the current actual number of users of the gray-scale version reaches the maximum number of users when the crash rate has not yet reached the crash rate threshold, and the comment information and/or the rating information indicate positive comments quantity. The third control unit is configured to, in response to determining that the actual number of users reaches the maximum number of users, control the end of this grayscale release.

In one embodiment, the control module may further include: a second determination unit and a fourth control unit. A second determining unit, configured to, in response to determining that the actual number of users has not reached the maximum number of users, determine whether the actual usage coverage of the gray-scale version by the user has reached the coverage threshold according to the heat map data and/or the specific service data . The fourth control unit is configured to control the current grayscale release to end in response to determining that the actual use coverage reaches the coverage threshold.

In one embodiment, the control module may further include: a fifth control unit. A fifth control unit, configured to control the number of users of the gray-scale version to continue to increase in response to the actual usage coverage not reaching the coverage threshold.

In one embodiment, the second determining unit is further configured to perform at least one of the following operations. It is determined whether the actual usage coverage of the core functions and new functions of the grayscale version of the user reaches the first coverage threshold. Determine whether the actual usage coverage of the grayscale version in different operating environments reaches a second coverage rate threshold, where the operating environment includes at least one of the following: a hardware environment, an operating system, a system version, and a service interface.

In one embodiment, the second determining unit is further configured to perform the following operations: generate a corresponding heat map according to the heat map data; and compare the heat map with the reference heat map for similarity to determine the actual usage coverage Whether the coverage threshold is reached.

In one embodiment, the apparatus may further include: a second obtaining module and a third obtaining module. The second acquisition module is configured to acquire the heat map data, specific business data, crash data and user feedback data associated with the grayscale version in real time. The third acquisition module is configured to analyze the grayscale version according to the real-time acquired data and obtain a grayscale release report.

In one embodiment, the apparatus may further include: a configuration module. The configuration module is configured to configure at least one of the following parameters according to the real-time acquired data for the gray period of the subsequent grayscale release: a crash rate threshold, a maximum number of users, and a coverage threshold.

It should be noted that the apparatus embodiments of the present application are the same or similar to the method embodiments of the present application, and the technical problems solved and technical effects achieved are also the same or similar, which are not repeated in this application.

According to the embodiments of the present application, the present application further provides an electronic device and a readable storage medium.

As shown in FIG. 6 , it is a block diagram of an electronic device for a method for processing grayscale publishing according to an embodiment of the present application. Electronic devices are intended to represent various forms of digital computers, such as laptops, desktops, workstations, personal digital assistants, servers, blade servers, mainframe computers, and other suitable computers. Electronic devices may also represent various forms of mobile devices, such as personal digital processors, cellular phones, smart phones, wearable devices, and other similar computing devices. The components shown herein, their connections and relationships, and their functions are by way of example only, and are not intended to limit implementations of the application described and/or claimed herein.

As shown in FIG. 6, the electronic device includes: one or more processors 601, a memory 602, and interfaces for connecting various components, including a high-speed interface and a low-speed interface. The various components are interconnected using different buses and may be mounted on a common motherboard or otherwise as desired. The processor may process instructions executed within the electronic device, including instructions stored in or on memory to display graphical information of the GUI on an external input/output device, such as a display device coupled to the interface. In other embodiments, multiple processors and/or multiple buses may be used with multiple memories and multiple memories, if desired. Likewise, multiple electronic devices may be connected, each providing some of the necessary operations (eg, as a server array, a group of blade servers, or a multiprocessor system). A processor 601 is taken as an example in FIG. 6 .

The memory 602 is the non-transitory computer-readable storage medium provided by the present application. Wherein, the memory stores instructions executable by at least one processor, so that the at least one processor executes the processing method for grayscale publishing provided by the present application. The non-transitory computer-readable storage medium of the present application stores computer instructions, and the computer instructions are used to cause the computer to execute the processing method for grayscale publishing provided by the present application.

As a non-transitory computer-readable storage medium, the memory 602 can be used to store non-transitory software programs, non-transitory computer-executable programs and modules, such as program instructions/ modules (eg, acquisition module 501 and control module 502 shown in FIG. 5 ). The processor 601 executes various functional applications and data processing of the server by running the non-transitory software programs, instructions and modules stored in the memory 602, that is, implementing the processing method for grayscale publishing in the above method embodiments.

The memory 602 may include a storage program area and a storage data area, wherein the storage program area may store an operating system, an application program required for at least one function; the storage data area may store the use of the electronic device according to the processing method for grayscale publishing created data, etc. Additionally, memory 602 may include high-speed random access memory, and may also include non-transitory memory, such as at least one magnetic disk storage device, flash memory device, or other non-transitory solid state storage device. In some embodiments, the memory 602 may optionally include memory disposed remotely relative to the processor 601, and these remote memories may be connected to the electronic device for the processing method for grayscale publishing through a network. Examples of such networks include, but are not limited to, the Internet, an intranet, a local area network, a mobile communication network, and combinations thereof.

The electronic device for implementing the processing method for grayscale publishing of the present application may further include: an input device 603 and an output device 604 . The processor 601 , the memory 602 , the input device 603 and the output device 604 may be connected by a bus or in other ways, and the connection by a bus is taken as an example in FIG. 6 .

The input device 603 can receive input numerical or character information, and generate key signal input related to user settings and function control of the electronic device for the processing method for grayscale publishing, such as touch screen, keypad, mouse, trackpad, touch Input devices such as pads, pointing sticks, one or more mouse buttons, trackballs, joysticks, etc. Output devices 604 may include display devices, auxiliary lighting devices (eg, LEDs), haptic feedback devices (eg, vibration motors), and the like. The display device may include, but is not limited to, a liquid crystal display (LCD), a light emitting diode (LED) display, and a plasma display. In some implementations, the display device may be a touch screen.

Various implementations of the systems and techniques described herein can be implemented in digital electronic circuitry, integrated circuit systems, application specific ASICs (application specific integrated circuits), computer hardware, firmware, software, and/or combinations thereof. These various embodiments may include being implemented in one or more computer programs executable and/or interpretable on a programmable system including at least one programmable processor that The processor, which may be a special purpose or general-purpose programmable processor, may receive data and instructions from a storage system, at least one input device, and at least one output device, and transmit data and instructions to the storage system, the at least one input device, and the at least one output device an output device.

These computational programs (also referred to as programs, software, software applications, or codes) include machine instructions for programmable processors, and may be implemented using high-level procedural and/or object-oriented programming languages, and/or assembly/machine languages calculation program. As used herein, the terms "machine-readable medium" and "computer-readable medium" refer to any computer program product, apparatus, and/or apparatus for providing machine instructions and/or data to a programmable processor ( For example, magnetic disks, optical disks, memories, programmable logic devices (PLDs), including machine-readable media that receive machine instructions as machine-readable signals. The term "machine-readable signal" refers to any signal used to provide machine instructions and/or data to a programmable processor.

To provide interaction with a user, the systems and techniques described herein may be implemented on a computer having a display device (eg, a CRT (cathode ray tube) or LCD (liquid crystal display) monitor) for displaying information to the user ); and a keyboard and pointing device (eg, a mouse or trackball) through which a user can provide input to the computer. Other kinds of devices can also be used to provide interaction with the user; for example, the feedback provided to the user can be any form of sensory feedback (eg, visual feedback, auditory feedback, or tactile feedback); and can be in any form (including acoustic input, voice input, or tactile input) to receive input from the user.

The systems and techniques described herein may be implemented on a computing system that includes back-end components (eg, as a data server), or a computing system that includes middleware components (eg, an application server), or a computing system that includes front-end components (eg, a user's computer having a graphical user interface or web browser through which a user may interact with implementations of the systems and techniques described herein), or including such backend components, middleware components, Or any combination of front-end components in a computing system. The components of the system may be interconnected by any form or medium of digital data communication (eg, a communication network). Examples of communication networks include: Local Area Networks (LANs), Wide Area Networks (WANs), and the Internet.

A computer system can include clients and servers. Clients and servers are generally remote from each other and usually interact through a communication network. The relationship of client and server arises by computer programs running on the respective computers and having a client-server relationship to each other; the server may be a server of a distributed system, or a server incorporating a blockchain. The server can also be a cloud server, or an intelligent cloud computing server or intelligent cloud host with artificial intelligence technology.

According to the technical solutions provided by the embodiments of the present application, the grayscale period released according to the grayscale is used to control the grayscale period released according to the grayscale (such as heat map data, specific business data, crash data, user feedback data, etc.) Experience sets the grayscale period for grayscale publishing to a fixed value. In the process of implementing the embodiments of the present application, the inventor found that: if the grayscale period is set too long, once there is a problem in the grayscale version, the experience of the grayscale user will be affected for a long time; if the grayscale period is set too short , there may be a large risk of deviation between the evaluation results and the actual situation. With the embodiments of the present application, since the grayscale period for grayscale release is controllable rather than fixed, the above problems caused by unreasonable setting of the grayscale period (eg, too long or too short) can be avoided.

It should be understood that steps may be reordered, added or deleted using the various forms of flow shown above. For example, the steps described in the present application can be performed in parallel, sequentially or in different orders, and as long as the desired results of the technical solutions disclosed in the present application can be achieved, no limitation is imposed herein.

The above-mentioned specific embodiments do not constitute a limitation on the protection scope of the present application. It should be understood by those skilled in the art that various modifications, combinations, sub-combinations and substitutions may occur depending on design requirements and other factors. Any modifications, equivalent replacements and improvements made within the spirit and principles of this application shall be included within the protection scope of this application.

Claims (13)

1. a processing method for grayscale release, is characterized in that, comprises: In response to the grayscale version of the application being released in grayscale, at least one of the following data is acquired: heatmap data, specific business data, crash data, and user feedback data, wherein the heatmap data is used to represent the user's response to all the data. the usage of the grayscale version, the specific service data includes specific data generated by the user using the grayscale version; and According to the acquired data, the grayscale period of this grayscale release is controlled. 2. The method according to claim 1, wherein, according to the acquired data, controlling the grayscale period of this grayscale release comprises: obtaining a crash rate of the grayscale version according to the crash data; and If the crash rate reaches the crash rate threshold, the current grayscale release is controlled to end. 3. The method according to claim 1, wherein, according to the acquired data, controlling the grayscale period of this grayscale release comprises: According to the user feedback data, obtain the user's comment information and/or rating information on the grayscale version; and If the comment information and/or the rating information indicate a negative comment, the current grayscale publishing is controlled to end. 4. The method of claim 1, further comprising: obtaining the crash rate of the grayscale version according to the crash data; According to the user feedback data, obtain the user's comment information and/or rating information on the grayscale version; If the crash rate has not reached the crash rate threshold, and the comment information and/or the rating information indicates a positive comment, determining whether the current actual number of users of the grayscale version has reached the maximum number of users; and In response to determining that the actual number of users reaches the maximum number of users, the current grayscale release is controlled to end. 5. The method of claim 4, further comprising: In response to determining that the actual number of users has not reached the maximum number of users, according to the heat map data and/or the specific service data, determining whether the actual usage coverage of the gray-scale version by the user has reached a coverage threshold; and In response to determining that the actual use coverage ratio reaches the coverage ratio threshold, the current grayscale release is controlled to end. 6. The method of claim 5, further comprising: In response to the actual usage coverage not reaching the coverage threshold, the amount of users of the grayscale version is controlled to continue to increase. 7. The method according to claim 5, wherein the determining whether the actual usage coverage of the gray-scale version by the user reaches a coverage threshold comprises at least one of the following: Determine whether the actual usage coverage of the core functions and new functions of the grayscale version by the user reaches a first coverage threshold; Determine whether the actual usage coverage of the grayscale version in different operating environments reaches a second coverage rate threshold, where the operating environment includes at least one of the following: a hardware environment, an operating system, a system version, and a service interface. 8 . The method according to claim 5 , wherein, according to the heat map data, determining whether the actual usage coverage of the gray-scale version by the user reaches a coverage threshold, comprising: 8 . generating a corresponding heat map according to the heat map data; and The heatmap is compared for similarity to a baseline heatmap to determine whether the actual usage coverage reaches the coverage threshold. 9. The method of claim 5, further comprising: obtain heat map data, specific business data, crash data, and user feedback data associated with the grayscale version in real time; and According to the data acquired in real time, the grayscale version is analyzed and a grayscale release report is obtained. 10. The method of claim 9, further comprising: According to the real-time acquired data, configure at least one of the following parameters for the gray period of the subsequent grayscale release: a crash rate threshold, a maximum number of users, and a coverage threshold. 11. A processing device for grayscale distribution, characterized in that it comprises: The obtaining module is configured to obtain at least one of the following data in response to the grayscale release of the grayscale version of the application: heatmap data, specific business data, crash data, and user feedback data, wherein the heatmap data is used for characterizing the usage of the grayscale version by the user, the specific service data includes specific data generated by the user using the grayscale version; and The control module is used to control the grayscale period of this grayscale release according to the acquired data. 12. An electronic device, characterized in that, comprising: at least one processor; and a memory communicatively coupled to the at least one processor; wherein, The memory stores instructions executable by the at least one processor, the instructions being executed by the at least one processor to enable the at least one processor to perform the execution of any of claims 1-10 Methods. 13. A non-transitory computer-readable storage medium storing computer instructions, wherein the computer instructions are used to cause the computer to perform the method of any one of claims 1-10.

Images