CN114153872A

CN114153872A - Data processing method and device based on measurement indexes

Info

Publication number: CN114153872A
Application number: CN202111490883.5A
Authority: CN
Inventors: 杨艳红; 王清华
Original assignee: China Construction Bank Corp
Current assignee: China Construction Bank Corp
Priority date: 2021-12-08
Filing date: 2021-12-08
Publication date: 2022-03-08

Abstract

The present disclosure provides a data processing method and device based on metric index, which relates to the field of big data, and comprises: generating a user's metric requirement for indicating a user's need to acquire data satisfying the metric requirement according to a user's clicking operation, obtaining a target data set from a preset database according to the measurement index requirement, and obtaining a target data set from a preset configuration rule packet, determining configuration rule information corresponding to the measurement index requirement, wherein the configuration rule packet is a rule packet which is pre-configured with one or more of basic operation, logic operation, comparison operation and regular operation, processing the target data set according to the configuration rule information to obtain a data processing result, the data processing result is output and processed, the defects of high cost and the like caused by the related technology are avoided, the flexibility and the diversity of the applied scene of the data processing are realized, and the interference and the influence of human factors can not be caused, and the accuracy and the reliability of data processing are improved.

Description

Data processing method and device based on measurement indexes

Technical Field

The present disclosure relates to the field of big data, and in particular, to a data processing method and apparatus based on metric.

Background

With the advent of the big data era, the data volume is rapidly increased, and in order to realize that a user acquires data meeting the requirement from massive data, the data can be realized in a mode of measuring indexes.

However, different users, or the same user at different stages, may have different data-related information to be obtained, and in the prior art, for different data processing requests, such as a request for obtaining conversion rate and a request for obtaining yield rate, the following methods are adopted: and respectively developing logic flows aiming at different data processing requests.

However, the above method has high cost, long implementation period, and may affect the stability of the system.

Disclosure of Invention

The embodiment of the disclosure provides a data processing method and device based on a metric index, which are used for solving the problem of low efficiency of data processing.

In one aspect, an embodiment of the present disclosure provides a data processing method based on a metric, including:

generating a measurement index requirement of a user according to clicking operation of the user, wherein the measurement index requirement is used for indicating the requirement of the user for acquiring data meeting the measurement index requirement;

acquiring a target data set from a preset database according to the measurement index requirement, and determining configuration rule information corresponding to the measurement index requirement from a preset configuration rule packet, wherein the configuration rule packet is a rule packet which is configured with one or more of basic operation, logic operation, comparison operation and regular operation in advance;

and processing the target data set according to the configuration rule information to obtain a data processing result, and outputting and processing the data processing result.

In some embodiments, generating the metric requirement of the user according to the click operation of the user includes:

determining basic data, an operator and a target measurement index selected by the click operation according to the click operation;

and acquiring a creating record of creating the measurement index, and if the creating record comprises creating information of the target measurement index, generating the measurement index requirement according to the basic data, the operator and the target measurement index with the creating information.

In some embodiments, further comprising:

if the creation record does not include the creation information of the target metric index, generating the creation information of the target metric quality according to the creation operation of the user;

and generating the measurement index requirement according to the basic data, the operator and a target measurement index comprising the generated creation information, and storing the creation information of the target measurement index into the creation record.

In some embodiments, before obtaining the target data set from the preset database according to the metric requirement, the method further includes:

acquiring service data generated when each business service is provided based on a data interface for providing each business service;

and performing format unified processing on service data generated when each service is provided to obtain data after format unified processing, wherein the preset database comprises the data after format unified processing.

In some embodiments, the method is applied to a server, and performs format unification processing on service data generated when each service is provided, to obtain data after format unification processing, and includes:

performing data filtering processing and data cleaning processing on service data generated when each service is provided to obtain processed service data;

and converting the format of the processed service data into a uniform format which can be recognized by the server to obtain the data processed by the uniform format.

In some embodiments, further comprising:

if the configuration rule packet does not have configuration rule information corresponding to the measurement index requirement, updating the configuration rule packet according to the measurement index requirement and the configuration rule information included in the configuration rule, wherein the updated configuration rule packet includes the configuration rule information corresponding to the measurement index requirement;

and determining configuration rule information corresponding to the measurement index requirement from the updated configuration rule packet.

In some embodiments, updating the configuration rule package according to the metric indicator requirement and configuration rule information included in the configuration rule includes:

determining configuration rule information included in the configuration rule packet, and determining difference information between the configuration rule information included in the configuration rule packet and configuration rule information corresponding to the measurement index requirement;

and updating the configuration rule packet according to the difference information.

In a second aspect, an embodiment of the present disclosure provides a data processing apparatus based on a metric, including:

the generating unit is used for generating a metric index requirement of a user according to clicking operation of the user, wherein the metric index requirement is used for indicating the requirement of the user for acquiring data meeting the metric index requirement;

the first acquisition unit is used for acquiring a target data set from a preset database according to the measurement index requirement;

the first determining unit is used for determining configuration rule information corresponding to the measurement index requirement from a preset configuration rule packet, wherein the configuration rule packet refers to a rule packet which is configured with one or more of basic operation, logic operation, comparison operation and regular operation in advance;

and the first processing unit is used for processing the target data set according to the configuration rule information to obtain a data processing result and outputting and processing the data processing result.

In some embodiments, the generating unit includes:

the first determining subunit is used for determining basic data, an operator and a target measurement index selected by the click operation according to the click operation;

the acquisition subunit is used for acquiring a creation record of the creation metric index;

a first generating subunit, configured to generate the metric requirement according to the basic data, the operator, and the target metric having the creation information if the creation record includes the creation information of the target metric.

In some embodiments, the generating unit further includes:

a second generating subunit, configured to, if the creation record does not include creation information of the target metric, generate creation information of the target metric quality according to a creation operation of the user, and generate the metric requirement according to the basic data, an operator, and a target metric including the generated creation information;

and the storage subunit is used for storing the creation information of the target metric index into the creation record.

In some embodiments, the apparatus further comprises:

a second obtaining unit, configured to obtain service data generated when each service is provided, based on a data interface providing each service;

and the second processing unit is used for carrying out format unified processing on the service data generated when each service is provided to obtain data after format unified processing, wherein the preset database comprises the data after format unified processing.

In some embodiments, the method is applied to a server; the second processing unit comprises

The processing subunit is used for performing data filtering processing and data cleaning processing on the service data generated when each service is provided to obtain the processed service data;

and the conversion subunit is used for converting the format of the processed service data into a unified format which can be recognized by the server, so as to obtain the data processed by the unified format.

In some embodiments, the apparatus further comprises:

an updating unit, configured to update the configuration rule packet according to the metric index requirement and configuration rule information included in the configuration rule if there is no configuration rule information corresponding to the metric index requirement in the configuration rule packet, where the updated configuration rule packet includes configuration rule information corresponding to the metric index requirement;

and a second determining unit, configured to determine configuration rule information corresponding to the metric index requirement from the updated configuration rule packet.

In some embodiments, an update unit, comprising:

a second determining subunit, configured to determine configuration rule information included in the configuration rule packet, and determine difference information between the configuration rule information included in the configuration rule packet and configuration rule information corresponding to the metric requirement;

and the updating subunit is used for updating the configuration rule packet according to the difference information.

In a third aspect, an embodiment of the present disclosure provides an electronic device, including: a memory, a processor;

a memory for storing the processor-executable instructions;

wherein the processor is configured to perform the method of the first aspect.

In a fourth aspect, the present disclosure provides a computer-readable storage medium having stored therein computer-executable instructions for implementing the method according to the first aspect when executed by a processor.

In a fifth aspect, the disclosed embodiments provide a computer program product comprising a computer program that, when executed by a processor, implements the method according to the first aspect.

In a sixth aspect, an embodiment of the present disclosure provides a data processing system based on a metric, including:

the system comprises a user configuration platform, a data processing engine and a data processing module, wherein the user configuration platform is used for outputting an operable interface, generating a measurement index requirement of a user according to the click operation of the user on the operable interface and transmitting the measurement index requirement to the index configuration processing engine, wherein the measurement index requirement is used for indicating the requirement of the user for acquiring data meeting the measurement index requirement;

the index configuration table is used for generating a configuration rule packet and transmitting the configuration rule packet to the index configuration processing engine, wherein the configuration rule packet is a rule packet which is configured with one or more of basic operation, logic operation, comparison operation and regular operation in advance;

the data warehouse is used for acquiring service data generated when each service is provided based on a data interface for providing each service, performing format unified processing on the service data generated when each service is provided to obtain data after format unified processing, and transmitting the data after format unified processing to the index configuration processing engine;

the index configuration processing engine is used for acquiring a target data set from the data subjected to format unified processing according to a measurement index requirement, determining configuration rule information corresponding to the measurement index requirement from the configuration rule packet, processing the target data set according to the configuration rule information to obtain a data processing result, and transmitting the data processing result to an index view device;

and the index view device is used for graphically outputting the data processing result.

The embodiment of the disclosure provides a data processing method and device based on a measurement index, comprising the following steps: according to the click operation of a user, generating a measurement index requirement of the user, wherein the measurement index requirement is used for indicating the requirement of the user for acquiring data meeting the measurement index requirement, acquiring a target data set from a preset database according to the measurement index requirement, and determining configuration rule information corresponding to the measurement index requirement from a preset configuration rule packet, wherein the configuration rule packet is one or more rule packets configured in advance with basic operation, logic operation, comparison operation and regular operation, and the target data set is processed according to the configuration rule information to obtain a data processing result and output and process the data processing result, in the embodiment, the method includes the following steps: the method and the device have the advantages that the measurement index requirements are generated according to the click operation of the user, the target data set and the configuration rule information are determined according to the measurement index requirements, the target data set is processed based on the configuration rule information, the technical characteristics of a data processing result are obtained, the defects that in the related technology, the cost is high due to the fact that the analysis, the development and other operations need to be repeatedly executed aiming at different data processing requests are overcome, the flexibility and the diversity of a scene where data processing is applied are achieved, the interference and the influence of human factors cannot be caused, and the technical effects of accuracy and reliability of data processing are improved.

Drawings

The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the present disclosure and together with the description, serve to explain the principles of the disclosure.

FIG. 1 is a schematic diagram of a metric-based data processing method according to one embodiment of the present disclosure;

FIG. 2 is a diagram of a data processing method based on metrics according to another embodiment of the present disclosure;

FIG. 3 is a schematic diagram of a metric-based data processing system according to an embodiment of the present disclosure;

FIG. 4 is a schematic diagram of a metric-based data processing apparatus according to one embodiment of the present disclosure;

FIG. 5 is a schematic diagram of a metric-based data processing apparatus according to another embodiment of the present disclosure;

fig. 6 is a block diagram of an electronic device for a metric-based data processing method according to an embodiment of the present disclosure.

With the foregoing drawings in mind, certain embodiments of the disclosure have been shown and described in more detail below. These drawings and written description are not intended to limit the scope of the disclosed concepts in any way, but rather to illustrate the concepts of the disclosure to those skilled in the art by reference to specific embodiments.

Detailed Description

Reference will now be made in detail to the exemplary embodiments, examples of which are illustrated in the accompanying drawings. When the following description refers to the accompanying drawings, like numbers in different drawings represent the same or similar elements unless otherwise indicated. The implementations described in the exemplary embodiments below are not intended to represent all implementations consistent with the present disclosure. Rather, they are merely examples of apparatus and methods consistent with certain aspects of the present disclosure, as detailed in the appended claims.

With the advent of the big data era, the amount of data is rapidly increasing, and how to improve the processing efficiency, flexibility and pertinence of data so as to meet different data requirements of the same user at different stages or meet different data requirements of different users becomes a problem to be solved urgently.

In the related art, data processing is generally implemented based on a metric, and the data processing is generally implemented by the following two data processing methods. Wherein a metric refers to an index, specification, standard, such as conversion rate, growth rate, etc., that describes a property of an object or thing.

The first method comprises the following steps: and respectively developing logic flows aiming at different data processing requests. For example, for different data processing requests, the flow steps from the requirement analysis, design, coding, test to production are executed once.

However, with this method, operations such as analysis and development need to be performed again for different data processing requests, which results in a high cost and a long implementation period, and the system stability may be affected due to frequent development and modification.

The second method comprises the following steps: the general attributes of the measurement indexes, such as names, interfaces, timing collection settings and the like, are collected and set manually, and a Structured Query Language (SQL) script, an Operating System (OS) script, a Simple Network Management Protocol (SNMP), a Java Management Extensions (JMX) script and the like are compiled to generate a plurality of measurement indexes, so that corresponding data can be obtained based on the measurement indexes, and data processing is realized.

However, with this method, since the data processing is performed manually, the data processing is easily interfered by human factors, which consumes large human resources and costs, and requires a relatively experienced worker to perform the processing, otherwise the accuracy of the data processing is easily low.

To avoid one or more of the above technical problems, the inventors of the embodiments of the present disclosure have made creative efforts to obtain the inventive concept of the present disclosure: the method comprises the steps of presetting a configuration rule packet, determining corresponding configuration rule information based on clicking operation of a user, and processing a data set based on the configuration rule information to obtain and output a processing result.

The following describes the technical solutions of the present disclosure and how to solve the above technical problems in specific embodiments. The following several specific embodiments may be combined with each other, and details of the same or similar concepts or processes may not be repeated in some embodiments. Embodiments of the present disclosure will be described below with reference to the accompanying drawings.

Referring to fig. 1, fig. 1 is a schematic diagram illustrating a data processing method based on metric index according to an embodiment of the present disclosure. As shown in fig. 1, the method includes:

s101: and generating the measurement index requirement of the user according to the clicking operation of the user. Wherein the metric requirement is used to indicate a user's requirement to obtain data that satisfies the metric requirement.

In some embodiments, the execution main body of the embodiment may be an integrated data processing device based on the metric index (hereinafter, referred to as a data processing device for short), and the data processing device may be a server (such as a cloud server or a local server), a computer, a processor, or a chip, and the embodiment is not limited.

In other embodiments, the execution subject of this embodiment may also include different electronic devices, such as a user device that obtains a click operation of a user, a server that generates a requirement for a metric index, and the like.

That is to say, in this embodiment, an execution main body for implementing the method of the embodiment of the present disclosure may be an integrated device, or may be a processing system composed of a plurality of different electronic devices, and this embodiment is not limited.

For example, if the execution process of the embodiment is an integrated whole device, the whole device includes a display device to output various metrics through the display device, and a user may perform a click operation on the display device, for example, select a corresponding metric based on the click operation, and accordingly, the whole device generates a metric requirement according to the click operation, that is, determines a requirement for data acquired by the user or for data review.

For another example, if the execution main body of this embodiment is a processing system composed of a plurality of electronic devices, an operable interface may be output through one of the electronic devices, a user may perform a click operation on the operable interface, and correspondingly, the electronic device may transmit position information of the operable interface corresponding to the click operation of the user to another electronic device, and the other electronic device generates a measurement index requirement according to the position information. Of course, the electronic device outputting the operable interface may generate the measurement index requirement and transmit the measurement index requirement to another electronic device.

S102: and acquiring a target data set from a preset database according to the measurement index requirement, and determining configuration rule information corresponding to the measurement index requirement from a preset configuration rule packet. The rule packet is configured by pre-configuring one or more of a basic operation, a logical operation, a comparison operation, and a regular operation.

Illustratively, the basic operations include addition operations, subtraction operations, multiplication operations, division operations, variance operations, and the like.

The logical operation may include sorting or sorting the data corresponding to the metric, such as: positive or negative sequence; or may include logical operations on time attributes such as time periods, frequencies, time comparisons (parity, ring, custom, etc.); the method can also comprise index thresholds corresponding to the measurement indexes, such as targets, average values, specification lines and the like; logic early warning can also be included, for example, different measurement indexes correspond to different early warning rules and the like; logical transformations may also be included, such as converting parameters to metrics, and the like.

S103: and processing the target data set according to the configuration rule information to obtain a data processing result, and outputting and processing the data processing result.

Based on the above analysis, an embodiment of the present disclosure provides a data processing method based on a metric index, including: according to the click operation of a user, generating a measurement index requirement of the user, wherein the measurement index requirement is used for indicating the requirement of the user for acquiring data meeting the measurement index requirement, acquiring a target data set from a preset database according to the measurement index requirement, and determining configuration rule information corresponding to the measurement index requirement from a preset configuration rule packet, wherein the configuration rule packet is one or more rule packets configured in advance with basic operation, logic operation, comparison operation and regular operation, and the target data set is processed according to the configuration rule information to obtain a data processing result and output and process the data processing result, in the embodiment, the method includes the following steps: the method and the device have the advantages that the measurement index requirements are generated according to the click operation of the user, the target data set and the configuration rule information are determined according to the measurement index requirements, the target data set is processed based on the configuration rule information, the technical characteristics of a data processing result are obtained, the defects that in the related technology, the cost is high due to the fact that the analysis, the development and other operations need to be repeatedly executed aiming at different data processing requests are overcome, the flexibility and the diversity of a scene where data processing is applied are achieved, the interference and the influence of human factors cannot be caused, and the technical effects of accuracy and reliability of data processing are improved.

Referring to fig. 2, fig. 2 is a schematic diagram illustrating a data processing method based on metric index according to another embodiment of the present disclosure. As shown in fig. 2, the method includes:

s201: and determining basic data, an operator and a target measurement index selected by the click operation according to the click operation of the user.

The same technical features as those in the above embodiments are not described again in this embodiment.

Based on the above analysis, the execution subject may be different depending on different application scenarios, and may be an integrated overall device or a processing system composed of a plurality of electronic devices. In the present embodiment, for the convenience of understanding of the reader, an application scenario and a principle of the present embodiment are exemplarily described with reference to fig. 3 by taking a processing system as an example.

As shown in fig. 3, the user configuration table includes a display device, the display device may output an operable interface, and the user may perform a click operation on the operable interface, such as a click operation on the basic data, the operator, and the target metric based on the data acquisition or reading requirement of the user.

Correspondingly, the user configuration platform determines basic data, operators and target measurement indexes which meet the requirement of a user for reading or reading data according to the clicking operation of the user.

S202: and obtaining a creating record of the created measurement index, and if the creating record comprises creating information of the target measurement index, generating a measurement index requirement according to the basic data, the operator and the target measurement index with the creating information.

For example, the target metric may be a metric that has already been created, or may be a metric that has not been created, where the metric that has been created has corresponding creation information in the created record, and the metric that has not been created has no corresponding creation information in the created record.

The creation information includes the name of the metric and the attribute of the metric. The attributes of the metric include data type, format, and may also include data unit, and may also include data reference line, and may also include warning rule, etc., which are not listed here one by one.

In this embodiment, if the creation record already includes creation information of the target metric, a metric requirement may be generated based on the creation information, the basic data, and the operator, that is, a requirement related to the data acquired or read by the user is determined, and the metric requirement is transmitted to the metric configuration processing engine.

In other embodiments, if the creation record does not include the creation information of the target metric, the creation information of the target metric quality is generated according to the creation operation of the user, the metric requirement is generated according to the basic data, the operator and the target metric including the generated creation information, and the creation information of the target metric is stored in the creation record.

With reference to the above analysis and fig. 3, if the creation record does not have creation information of the target metric, the user may perform a creation operation on the operable interface, and accordingly, the user configuration table generates creation information according to the creation operation of the user, stores the creation information in the creation record, generates a metric requirement in accordance with the creation information, and transmits the metric requirement to the index configuration processing engine.

In this embodiment, different ways are adopted to generate the measurement index requirements for different scenes, so that the technical effects of flexibility and effectiveness of generating the measurement index requirements can be achieved.

S203: service data generated when each service is provided is acquired based on a data interface providing each service.

In conjunction with the above analysis and fig. 3, the data warehouse obtains service data, such as transfer service, for example, remittance service, generated when each data interface provides service.

S204: and carrying out format unified processing on the service data generated when each service is provided to obtain the data after the format unified processing. And the preset database comprises data processed in a unified format.

Based on the analysis, after the data warehouse acquires the service data corresponding to each data interface through different data interfaces, because the formats of the service data acquired based on different data interfaces may not be the same, the data warehouse may perform format unification processing on each service data in order to facilitate subsequent data processing, so that the data with different data formats have the same data format.

In some embodiments, the database is arranged in the data warehouse, and the data after the format unified processing can be stored in the database, so that the data in the database has stronger comprehensiveness and the uniformity of subsequent data processing is facilitated, and different processing methods do not need to be configured for different data formats, thereby improving the technical effects of universality and flexibility.

In some embodiments, in combination with the analysis and fig. 3, the process of processing the target data set according to the configuration rule information may be processed by an index configuration processing engine, and accordingly, when the data warehouse generates data with a unified format, the following steps may be implemented:

the first step is as follows: and performing data filtering processing and data cleaning processing on the service data generated when each service is provided to obtain the processed service data.

The second step is as follows: and converting the format of the processed service data into a uniform format which can be recognized by an index configuration processing engine to obtain the data with the uniformly processed format.

For example, the data warehouse obtains a format of data that can be recognized by the index configuration processing engine, and after performing other processing such as filtering processing and cleaning processing on each service data, converts each service data obtained after the processing into the format of data that can be recognized by the index configuration processing engine, and stores each service data after the format conversion into the database and transmits the data to the index configuration processing engine.

It should be noted that, in the embodiment, by performing format unification processing on each service data, each service data has operability and realizability when being processed, thereby improving the accuracy and reliability of data processing.

S205: and acquiring a target data set from a preset database according to the measurement index requirement, and determining configuration rule information corresponding to the measurement index requirement from a preset configuration rule packet. The rule packet is configured by pre-configuring one or more of a basic operation, a logical operation, a comparison operation, and a regular operation.

In conjunction with the above analysis and fig. 3, the configuration rule package may be determined by the index configuration platform, and after the index configuration platform generates the configuration rule package, the configuration rule package is transmitted to the index configuration processing engine.

That is, on the one hand, the index configuration processing engine receives the measurement index requirement transmitted by the user configuration platform, on the other hand, the index configuration processing engine receives the configuration rule packet transmitted by the index configuration platform, and on the other hand, the index configuration processing engine receives the uniformly processed format data transmitted by the data warehouse.

Correspondingly, the index configuration processing engine may determine configuration rule information from the configuration rule packet according to the measurement index requirement, that is, the configuration rule information is configuration rule information of one or more of basic operation, logical operation, comparison operation, and regular operation corresponding to the measurement index requirement. The index configuration processing engine may also select a target data set from the data after format unification processing according to the metric index requirement, that is, the target data set is data related to the metric index requirement (which may be understood as data that a user wishes to acquire or refer to).

The index configuration platform may generate a configuration rule packet for a history record based on data processing, and for example, select a basic operation, a logical operation, a comparison operation, a regular operation, and the like having a high relative frequency of use from the history record to generate the configuration rule packet.

In other embodiments, there may be no configuration rule information corresponding to the metric index requirement in the configuration rule package, and for the scenario, the configuration rule package may be updated according to the metric index requirement and the configuration rule information included in the configuration rule, so that the updated configuration rule package includes the configuration rule information corresponding to the metric index requirement, and the configuration rule information corresponding to the metric index is determined from the updated configuration rule package.

In this embodiment, the requirement of the user for acquiring or browsing data is met by updating the configuration rule package, so that the user experience is improved, different requirements of different users are met, and the flexibility and diversity of data processing are improved.

In some embodiments, updating the configuration rules includes the steps of:

the first step is as follows: determining configuration rule information included in the configuration rule packet, and determining difference information between the configuration rule information included in the configuration rule packet and configuration rule information corresponding to the measurement index requirement.

The second step is as follows: and updating the configuration rule packet according to the difference information.

In this embodiment, by determining the difference information and performing update processing on the configuration rule packet based on the difference information, the configuration rule packet can be updated with pertinence, so as to improve the effectiveness and efficiency of the update.

S206: and processing the target data set according to the configuration rule information to obtain a data processing result, and outputting and processing the data processing result.

In conjunction with the above analysis and fig. 3, the index configuration processing engine may transmit the data processing result to the index view device, and accordingly, the index view device may graphically display the data processing result.

In some embodiments, a user may perform a click operation on a display interface of the indicator view device, and accordingly, the indicator view device may generate view configuration information, such as information related to color, information related to font, and the like, according to the click operation.

Referring to fig. 4, fig. 4 is a schematic diagram of a data processing apparatus based on metric index according to an embodiment of the present disclosure.

As shown in fig. 4, the data processing apparatus 400 based on metric includes:

a generating unit 401, configured to generate a metric requirement of a user according to a click operation of the user, where the metric requirement is used to indicate a requirement of the user for acquiring data that meets the metric requirement.

A first obtaining unit 402, configured to obtain a target data set from a preset database according to the metric requirement.

A first determining unit 403, configured to determine configuration rule information corresponding to the metric index requirement from a preset configuration rule packet, where the configuration rule packet is a rule packet in which one or more of basic operation, logical operation, comparison operation, and regular operation are pre-configured.

A first processing unit 404, configured to process the target data set according to the configuration rule information to obtain a data processing result, and output the data processing result.

Referring to fig. 5, fig. 5 is a schematic diagram of a data processing apparatus based on metric index according to another embodiment of the present disclosure.

As shown in fig. 5, the data processing apparatus 500 based on metric includes:

a generating unit 501, configured to generate a metric requirement of a user according to a click operation of the user, where the metric requirement is used to indicate a requirement of the user for acquiring data that meets the metric requirement.

As can be seen in fig. 5, in some embodiments, the generating unit 501 includes:

the first determining subunit 5011 is configured to determine, according to the click operation, basic data, an operator, and a target metric selected by the click operation.

The acquisition subunit 5012 is configured to acquire a creation record of the creation metric.

The first generating subunit 5013 is configured to, if the creation record includes creation information of the target metric, generate the metric requirement according to the basic data, the operator, and the target metric having the creation information.

A second generating subunit 5014, configured to, if the creation record does not include creation information of the target metric, generate creation information of the target metric quality according to the creation operation of the user, and generate the metric requirement according to the basic data, the operator, and the target metric including the generated creation information.

A storage subunit 5015, configured to store the creation information of the target metric into the creation record.

A second obtaining unit 502, configured to obtain service data generated when each service is provided, based on the data interface providing each service.

The second processing unit 503 is configured to perform format unification processing on service data generated when each service is provided, so as to obtain data after format unification processing, where the preset database includes the data after format unification processing.

As can be appreciated in conjunction with fig. 5, in some embodiments, the method is applied to a server; a second processing unit 503, comprising:

the processing subunit 5031 is configured to perform data filtering processing and data cleaning processing on the service data generated when each service is provided, so as to obtain processed service data.

A converting subunit 5032, configured to convert the format of the processed service data into a unified format that can be recognized by the server, so as to obtain data after format unified processing.

A first obtaining unit 504, configured to obtain a target data set from a preset database according to the metric index requirement.

The first determining unit 505 is configured to determine configuration rule information corresponding to the metric index requirement from a preset configuration rule packet, where the configuration rule packet is a rule packet in which one or more of basic operation, logical operation, comparison operation, and regular operation are pre-configured.

An updating unit 506, configured to update the configuration rule packet according to the metric index requirement and configuration rule information included in the configuration rule if there is no configuration rule information corresponding to the metric index requirement in the configuration rule packet, where the updated configuration rule packet includes the configuration rule information corresponding to the metric index requirement.

As can be seen in fig. 5, in some embodiments, the updating unit 506 includes:

a second determining subunit 5061, configured to determine configuration rule information included in the configuration rule packet, and determine difference information between the configuration rule information included in the configuration rule packet and the configuration rule information corresponding to the metric indicator requirement;

an updating subunit 5062, configured to update the configuration rule packet according to the difference information.

A second determining unit 507, configured to determine configuration rule information corresponding to the metric index requirement from the updated configuration rule packet.

The first processing unit 508 is configured to process the target data set according to the configuration rule information to obtain a data processing result, and output the data processing result.

According to another aspect of the embodiments of the present disclosure, there is also provided a data processing system based on metric index, as shown in fig. 3, the system may include:

and the user configuration platform is used for outputting the operable interface, generating the measurement index requirement of the user according to the click operation of the user on the operable interface, and transmitting the measurement index requirement to the index configuration processing engine. Wherein the metric requirement is used to indicate a user's requirement to obtain data that satisfies the metric requirement.

And the index configuration table is used for generating a configuration rule packet and transmitting the configuration rule packet to the index configuration processing engine. The rule packet is configured by pre-configuring one or more of a basic operation, a logical operation, a comparison operation, and a regular operation.

And the data warehouse is used for acquiring service data generated when each service is provided based on the data interface for providing each service, performing format unified processing on the service data generated when each service is provided, acquiring data after format unified processing, and transmitting the data after format unified processing to the index configuration processing engine.

And the index configuration processing engine is used for acquiring a target data set from the data subjected to format unified processing according to the measurement index requirements, determining configuration rule information corresponding to the measurement index requirements from the configuration rule packet, processing the target data set according to the configuration rule information to obtain a data processing result, and transmitting the data processing result to the index view device.

For the implementation principle of each component in the system, reference may be made to the description in the method embodiment, and details are not described here.

The present disclosure also provides an electronic device and a readable storage medium according to an embodiment of the present disclosure.

According to an embodiment of the present disclosure, the present disclosure also provides a computer program product comprising: a computer program, stored in a readable storage medium, from which at least one processor of the electronic device can read the computer program, the at least one processor executing the computer program causing the electronic device to perform the solution provided by any of the embodiments described above.

As shown in fig. 6, it is a block diagram of an electronic device of a data processing method based on metric index according to an embodiment of the present disclosure. Electronic devices are intended to represent various forms of digital computers, such as laptops, desktops, workstations, personal digital assistants, servers, blade servers, mainframes, and other appropriate computers. The electronic device may also represent various forms of mobile devices, such as personal digital processing, cellular phones, smart phones, wearable devices, and other similar computing devices. The components shown herein, their connections and relationships, and their functions, are meant to be examples only, and are not meant to limit implementations of the disclosure described and/or claimed herein.

As shown in fig. 6, the electronic apparatus includes: one or more processors 601, memory 602, and interfaces for connecting the various components, including a high-speed interface and a low-speed interface. The various components are interconnected using different buses and may be mounted on a common motherboard or in other manners as desired. The processor may process instructions for execution within the electronic device, including instructions stored in or on the memory to display graphical information of a GUI on an external input/output apparatus (such as a display device coupled to the interface). In other embodiments, multiple processors and/or multiple buses may be used, along with multiple memories and multiple memories, as desired. Also, multiple electronic devices may be connected, with each device providing portions of the necessary operations (e.g., as a server array, a group of blade servers, or a multi-processor system). In fig. 6, one processor 601 is taken as an example.

The memory 602 is a non-transitory computer readable storage medium provided by the present disclosure. Wherein the memory stores instructions executable by at least one processor to cause the at least one processor to perform the metric-based data processing methods provided by the present disclosure. The non-transitory computer-readable storage medium of the present disclosure stores computer instructions for causing a computer to perform the metric-based data processing method provided by the present disclosure.

The memory 602, which is a non-transitory computer readable storage medium, may be used to store non-transitory software programs, non-transitory computer executable programs, and modules, such as program instructions/modules corresponding to the metric-based data processing method in the embodiments of the present disclosure. The processor 601 executes various functional applications of the server and data processing by running non-transitory software programs, instructions and modules stored in the memory 602, that is, implements the data processing method based on the metric index in the above method embodiments.

The memory 602 may include a storage program area and a storage data area, wherein the storage program area may store an operating system, an application program required for at least one function; the storage data area may store data created according to use of the electronic device based on the data processing method of the metric index, and the like. Further, the memory 602 may include high speed random access memory, and may also include non-transitory memory, such as at least one magnetic disk storage device, flash memory device, or other non-transitory solid state storage device. In some embodiments, the memory 602 optionally includes memory remotely located from the processor 601, and these remote memories may be connected over a network to the electronic device of the metric-based data processing method. Examples of such networks include, but are not limited to, the internet, intranets, local area networks, mobile communication networks, and combinations thereof.

The electronic device of the data processing method based on the metric index may further include: an input device 603 and an output device 604. The processor 601, the memory 602, the input device 603 and the output device 604 may be connected by a bus or other means, and fig. 6 illustrates the connection by a bus as an example.

The input device 603 may receive input numeric or character information and generate key signal inputs related to user settings and function control of the electronic device based on the metric-based data processing method, such as a touch screen, a keypad, a mouse, a track pad, a touch pad, a pointing stick, one or more mouse buttons, a track ball, a joystick, or other input devices. The output devices 604 may include a display device, auxiliary lighting devices (e.g., LEDs), and tactile feedback devices (e.g., vibrating motors), among others. The display device may include, but is not limited to, a Liquid Crystal Display (LCD), a Light Emitting Diode (LED) display, and a plasma display. In some implementations, the display device can be a touch screen.

Various implementations of the systems and techniques described here can be realized in digital electronic circuitry, integrated circuitry, application specific ASICs (application specific integrated circuits), computer hardware, firmware, software, and/or combinations thereof. These various embodiments may include: implemented in one or more computer programs that are executable and/or interpretable on a programmable system including at least one programmable processor, which may be special or general purpose, receiving data and instructions from, and transmitting data and instructions to, a storage system, at least one input device, and at least one output device.

These computer programs (also known as programs, software applications, or code) include machine instructions for a programmable processor, and may be implemented using high-level procedural and/or object-oriented programming languages, and/or assembly/machine languages. As used herein, the terms "machine-readable medium" and "computer-readable medium" refer to any computer program product, apparatus, and/or device (e.g., magnetic discs, optical disks, memory, Programmable Logic Devices (PLDs)) used to provide machine instructions and/or data to a programmable processor, including a machine-readable medium that receives machine instructions as a machine-readable signal. The term "machine-readable signal" refers to any signal used to provide machine instructions and/or data to a programmable processor.

To provide for interaction with a user, the systems and techniques described here can be implemented on a computer having: a display device (e.g., a CRT (cathode ray tube) or LCD (liquid crystal display) monitor) for displaying information to a user; and a keyboard and a pointing device (e.g., a mouse or a trackball) by which a user can provide input to the computer. Other kinds of devices may also be used to provide for interaction with a user; for example, feedback provided to the user can be any form of sensory feedback (e.g., visual feedback, auditory feedback, or tactile feedback); and input from the user may be received in any form, including acoustic, speech, or tactile input.

The systems and techniques described here can be implemented in a computing system that includes a back-end component (e.g., as a data server), or that includes a middleware component (e.g., an application server), or that includes a front-end component (e.g., a user computer having a graphical user interface or a web browser through which a user can interact with an implementation of the systems and techniques described here), or any combination of such back-end, middleware, or front-end components. The components of the system can be interconnected by any form or medium of digital data communication (e.g., a communication network). Examples of communication networks include: local Area Networks (LANs), Wide Area Networks (WANs), and the Internet.

The computer system may include clients and servers. A client and server are generally remote from each other and typically interact through a communication network. The relationship of client and server arises by virtue of computer programs running on the respective computers and having a client-server relationship to each other.

Other embodiments of the disclosure will be apparent to those skilled in the art from consideration of the specification and practice of the disclosure disclosed herein. This disclosure is intended to cover any variations, uses, or adaptations of the disclosure following, in general, the principles of the disclosure and including such departures from the present disclosure as come within known or customary practice within the art to which the disclosure pertains. It is intended that the specification and examples be considered as exemplary only, with a true scope and spirit of the disclosure being indicated by the following claims.

It will be understood that the present disclosure is not limited to the precise arrangements described above and shown in the drawings and that various modifications and changes may be made without departing from the scope thereof. The scope of the present disclosure is limited only by the appended claims.

Claims

1. A data processing method based on metric index comprises the following steps:

2. The method of claim 1, wherein generating a metric requirement of a user according to a click operation of the user comprises:

3. The method of claim 2, further comprising:

4. The method of any of claims 1-3, further comprising, prior to obtaining a target data set from a pre-set database according to the metric requirement:

5. The method of claim 4, wherein the method is applied to a server; the method for processing the service data generated when providing each service in a unified format to obtain the data processed in the unified format includes:

6. The method of any of claims 1-3, further comprising:

7. The method of claim 6, wherein updating the configuration rule package according to the metric index requirement and configuration rule information included in the configuration rule comprises:

8. A metric-based data processing apparatus, comprising:

9. An electronic device, comprising: a memory, a processor;

a memory for storing the processor-executable instructions;

wherein the processor is configured to perform the method of any one of claims 1-7.

10. A computer-readable storage medium having stored therein computer-executable instructions for implementing the method of any one of claims 1-7 when executed by a processor.

11. A computer program product comprising a computer program which, when executed by a processor, implements the method according to any one of claims 1-7.

12. A metric-based data processing system, comprising: