CN116303418A - Massive rule processing method, system and storage medium based on Internet of Things platform - Google Patents

Abstract

The embodiment of the invention discloses a mass rule processing method, a mass rule processing system and a mass rule processing storage medium based on an Internet of things platform. The method belongs to the technical field of the Internet of things, and comprises the following steps: the rule distribution management service calculates rule hash values of all rules according to the acquired user identifications and stores the rule hash values into a database rule table; the rule distribution management service generates a rule hash partition list which is required to be loaded by each rule processing service in a banding mode according to a preset hash partition rule, stores the rule configuration information to obtain, sends the rule configuration information to the corresponding rule processing service, and sends the total rule configuration information to the message dispatching service; the rule processing service obtains rules corresponding to the rule hash partition list from the database rule table according to the rule configuration information and loads the rules; and the message dispatch service distributes the received reported information according to the full rule configuration information and the user identification in the reported information. The embodiment of the application can improve the processing efficiency of the mass rules.

Description

Massive rule processing method, system and storage medium based on Internet of Things platform

technical field

The present invention relates to the technical field of the Internet of Things, in particular to a massive rule processing method, system and storage medium based on the Internet of Things platform.

Background technique

IoT platforms generally have common basic capabilities such as terminal access, terminal management, message push, and rule engines. After the IoT terminal is connected to the IoT platform, the message push module pushes the message reported by the terminal to the IoT application according to the user message push rules; or the rule engine module cleans and filters the information reported by the terminal based on the user-defined processing rules and processing.

The message push module and the rule engine module of the Internet of Things platform generally load the rules configured by the user into the memory to improve the efficiency of rule calculation and processing. With the large-scale development of the Internet of Things, the number of terminals and applications connected to the Internet of Things platform continues to increase, and the number of terminals reporting messages, user-customized message push rules, and rule engine processing rules are all increasing. The rule processing service is deployed in a cluster mode. Generally, the reported message is randomly sent to a rule processing service for processing. To ensure normal business, the rule processing service needs to load all the rules into the memory, and the memory loading of massive rules will cause the memory capacity of the server to be affected. limit, reducing the efficiency of rule processing.

Contents of the invention

Embodiments of the present invention provide a massive rule processing method, system and storage medium based on an Internet of Things platform, aiming at improving the processing efficiency of massive rules in an existing Internet of Things platform.

In the first aspect, the embodiment of the present invention provides a massive rule processing method based on the Internet of Things platform, which includes:

The rule distribution management service obtains the user ID from the database rule table, calculates the rule hash value of each rule according to the user ID and the preset rule hash upper limit value, and saves the rule hash value to the database rule table;

The rule distribution management service generates a list of rule hash partitions to be loaded by each rule processing service in a striped manner according to the preset hash sharding rules, and saves them to obtain rule configuration information;

The rule distribution management service sends the rule configuration information to the corresponding rule processing service, and sends the full amount of rule configuration information to the message dispatch service;

The rule processing service obtains and loads rules corresponding to the rule hash partition list from the rule table of the database according to the rule configuration information;

If the message dispatch service receives the reported information, it distributes the reported information according to the full rule configuration information and the user identifier in the reported information.

In the second aspect, the embodiment of the present invention also provides a massive rule processing system based on the Internet of Things platform, which includes: an acquisition computing unit configured in the rule distribution management service and a generating first sending unit configured in the rule processing service The first acquisition and loading unit of and the allocation unit configured in the message dispatch service, wherein,

The obtaining calculation unit is used for the rule distribution management service to obtain the user identifier from the database rule table, and calculate the rule hash value of each rule according to the user identifier and the preset rule hash upper limit value, and hash the rule Save the hash value to the database rule table;

The generation and storage unit is used for the rule distribution management service to generate a list of rule hash partitions that need to be loaded by each rule processing service in a striped manner according to the preset hash sharding rules, and store them to obtain the rule configuration information;

The first sending unit is used for the rule distribution management service to send the rule configuration information to the corresponding rule processing service, and send the full amount of rule configuration information to the message dispatch service;

The first obtaining and loading unit is used for the rule processing service to obtain and load rules corresponding to the rule hash partition list from the database rule table according to the rule configuration information;

The allocating unit is configured to allocate the reported information according to the full rule configuration information and the user identifier in the reported information if the message dispatch service receives the reported information.

In the third aspect, the embodiment of the present invention also provides a massive rule processing system based on the Internet of Things platform, which includes rule distribution management service, rule processing service and message dispatch service, and the rule distribution management service, rule processing service and message The dispatch service includes a memory and a processor, the memory stores a computer program, and the processors of the rule distribution management service, rule processing service, and message dispatch service implement the above method when executing the computer program.

In a fourth aspect, an embodiment of the present invention further provides a computer-readable storage medium, the storage medium stores a computer program, and the computer program can implement the above method when executed by a processor.

The embodiment of the present invention provides a massive rule processing method, system and storage medium based on the Internet of Things platform. Wherein, the method includes: the rule distribution management service obtains the user identifier from the database rule table, and calculates the rule hash value of each rule according to the user identifier and the preset rule hash upper limit value, and hashes the rule The hash value is saved to the database rule table; the rule distribution management service generates a list of rule hash partitions that each rule processing service needs to load in a striped manner according to the preset hash sharding rules, and saves them to Obtain rule configuration information; the rule distribution management service sends the rule configuration information to the corresponding rule processing service, and sends the full amount of rule configuration information to the message dispatch service; the rule processing service sends the rule configuration information from Obtain and load the rules corresponding to the rule hash partition list in the database rule table; if the message dispatch service receives the reported information, configure the information according to the full amount of rules and the described information in the reported information The user ID allocates the reported information. According to the technical solution of the embodiment of the present invention, the rule distribution management service generates the rule hash partition list required to be loaded by each rule processing service according to the preset rule hash upper limit value, and saves and obtains the rule configuration information, so that each rule processing service only Part of the rules need to be loaded into the memory instead of the full amount of rules; when the message dispatch service receives the reported information, it distributes the reported information according to the full rule configuration information and the user ID in the reported information, so that only the rule processing service with the user ID is in the The reported information is processed, so the processing efficiency of massive rules can be improved.

Description of drawings

In order to illustrate the technical solutions of the embodiments of the present invention more clearly, the drawings that need to be used in the description of the embodiments will be briefly introduced below. Obviously, the drawings in the following description are some embodiments of the present invention. Ordinary technicians can also obtain other drawings based on these drawings on the premise of not paying creative work.

FIG. 1 is a sequence diagram of a massive rule processing method based on an Internet of Things platform provided by an embodiment of the present invention;

FIG. 2 is a schematic flow diagram of a massive rule processing method based on an Internet of Things platform provided by an embodiment of the present invention;

FIG. 3 is a schematic flow diagram of a massive rule processing method based on an Internet of Things platform provided by another embodiment of the present invention;

FIG. 4 is a schematic block diagram of a massive rule processing system based on an Internet of Things platform provided by an embodiment of the present invention; and

Fig. 5 is a schematic block diagram of a computer device provided by an embodiment of the present invention.

Detailed ways

The following will clearly and completely describe the technical solutions in the embodiments of the present invention with reference to the accompanying drawings in the embodiments of the present invention. Obviously, the described embodiments are some of the embodiments of the present invention, but not all of them. Based on the embodiments of the present invention, all other embodiments obtained by persons of ordinary skill in the art without making creative efforts belong to the protection scope of the present invention.

It should be understood that when used in this specification and the appended claims, the terms "comprising" and "comprises" indicate the presence of described features, integers, steps, operations, elements and/or components, but do not exclude one or Presence or addition of multiple other features, integers, steps, operations, elements, components and/or collections thereof.

It should also be understood that the terminology used in the description of the present invention is for the purpose of describing particular embodiments only and is not intended to be limiting of the present invention. As used in this specification and the appended claims, the singular forms "a", "an" and "the" are intended to include plural referents unless the context clearly dictates otherwise.

It should also be further understood that the term "and/or" used in the description of the present invention and the appended claims refers to any combination and all possible combinations of one or more of the associated listed items, and includes these combinations .

As used in this specification and the appended claims, the term "if" may be construed as "when" or "once" or "in response to determining" or "in response to detecting" depending on the context . Similarly, the phrase "if determined" or "if [the described condition or event] is detected" may be construed, depending on the context, to mean "once determined" or "in response to the determination" or "once detected [the described condition or event] ]” or “in response to detection of [described condition or event]”.

Please refer to FIG. 1 . FIG. 1 is a sequence diagram of a method for processing massive rules based on an Internet of Things platform provided by an embodiment of the present invention. The massive rule processing system based on the Internet of Things platform includes a rule distribution management service 10 , a rule processing service 20 and a message dispatch service 30 . Wherein, the rule distribution management service 10 communicates with the rule processing service 30 to issue rule configuration information to the rule processing service 20; the rule distribution management service 10 communicates with the message dispatch service 30 to send the full amount of rule configuration information to the message dispatch service 30; the rule processing service 20 and the message dispatch service 30 to receive the report information sent by the message dispatch service 30.

Fig. 2 is a schematic flowchart of a method for processing massive rules based on an Internet of Things platform provided by an embodiment of the present invention. The massive rule processing method based on the Internet of Things platform in the embodiment of the present invention can be applied in a rule processing system, for example, the massive rule processing method based on the Internet of Things platform can be realized by a software program configured on the rule processing system, so as to improve the rule processing method. processing efficiency. As shown in Fig. 2, the method includes the following steps S110-S150.

S110. The rule distribution management service obtains the user identifier from the database rule table, calculates the rule hash value of each rule according to the user identifier and the preset rule hash upper limit value, and saves the rule hash value to the The database rule table described above.

In the embodiment of the present invention, the database rule table is created in the database service, mainly including fields such as serial number, user ID, rule information, update time, hashTag, etc., wherein, hashTag is used to save the hashValue value corresponding to the rule, and the hashValue value is based on User ID is calculated. Specifically, the rule distribution management service obtains the user identifier from the database rule table, and calculates the rule hash value of each rule according to the user identifier and the preset rule hash upper limit. More specifically, the user ID is obtained, and a hash calculation is performed on the user ID by a hash algorithm to obtain a first hash value; The remainder is calculated to obtain a second hash value, and the second hash value is used as a regular hash value. For the convenience of understanding, it is assumed that the maximum number of rule processing service instances is SNmax; the upper limit value of the preset rule hash value is hashMax. Rule processing service, that is, set hashMax>=10*SNmax, the user identifier is uId, the rule hash value of each rule is hashValue, hashValue=|hashCode(uId)|% hashMax, wherein, the value space of hashValue is [0 , hashMax), hashCode(uId) is the first hash value, |hashCode(uId)| is the first hash value after taking the absolute value. After the rule hash value is calculated, the rule hash value is stored in the hashTag field in the rule table of the database. It should be noted that, in this embodiment, the rules corresponding to the hashValue value are stored in the rule information field in the database rule table. Understandably, in this embodiment, the reason why the hashValue needs to be calculated is to It is convenient for subsequent segmentation and partitioning of the hashValue value.

S120. The rule distribution management service generates a list of rule hash partitions to be loaded by each rule processing service in a striped manner according to the preset hash sharding rule, and saves the list to obtain rule configuration information.

In the embodiment of the present invention, the rule distribution management service identifies n rule processing services, and divides the range of the preset rule hash upper limit value into M rule hash partition lists, where m≥n ; configure m rule hash partition lists to n rule processing services in a striping method; for each rule processing service, combine the rule processing service and the rule hash partition list Save the corresponding relationship to obtain the rule configuration information. For the convenience of understanding, the steps of generating the rule hash partition list are described in detail as follows:

(a) Identify the rule processing service, assuming that there are n rule processing services, each rule processing service is respectively marked as S0, S1, S2...Sn, where n<=SNmax, SNmax is the rule processing service the maximum number of instances;

(b) segment the hashValue value space [0, hashMax) into M hashRange, wherein, M>=SNmax, hashMax is the hash upper limit value of the preset rule, and hashRange is the hash partition list of the rule, Understandably,

hashRange[0]=[0,hashMax/M];

hashRange[1]=[hashMax/M+1, 2*hashMax/M]; and so on until hashRange[M].

(c) Configure M hashRange to n rule processing services in a striped manner, that is, hashRange[0] is allocated to S0, hashRange[1] is allocated to S1, hashRange[n] is allocated to Sn, hashRange[n+ 1] Circular allocation to S1, and so on, until the configuration of hashRange[M] is completed, each rule processing service will be allocated to at least one hashRange list.

(d) Save the relationship between each rule processing service and its hashRange list as rule configuration information.

It should be noted that, in this embodiment, a rule processing service list is set in the rule distribution management service, and n rule processing service identifiers are managed through the rule processing service list, which facilitates the expansion of subsequent rule processing services; Segmentation and sharding are performed to obtain M hashRange, and the corresponding hashRange of each processing service is distributed, so that each rule processing service only needs to load a part of the rules into the memory, without loading all the rules, and avoids the rule processing service from processing massive rules. When the memory capacity limit.

S130. The rule distribution management service sends the rule configuration information to the corresponding rule processing service, and sends the full amount of rule configuration information to the message dispatch service.

In the embodiment of the present invention, after the rule distribution management service calculates and obtains the rule configuration information of each rule processing service, it will send the rule configuration information to the corresponding rule processing service, and send the full amount of rule configuration information to the message dispatching Serve. Understandably, the full amount of rule configuration information is the sum of the rule configuration information.

S140. The rule processing service obtains and loads the rules corresponding to the rule hash partition list from the database rule table according to the rule configuration information.

In the embodiment of the present invention, the rule processing service obtains and loads the rule corresponding to the rule hash partition list from the rule table of the database according to the rule configuration information. Specifically, the rule processing service obtains the rule hash partition list from the rule configuration information; obtains the rule corresponding to the rule hash partition list from a preset field of the rule table of the database and loads , wherein the preset field is hashTag. Understandably, the rule hash partition list includes multiple hashValue values, and the rule processing service can obtain multiple rules based on multiple hashValue values for loading.

S150. If the message dispatch service receives the reported information, distribute the reported information according to the full rule configuration information and the user identifier in the reported information.

In the embodiment of the present invention, if the message dispatch service receives the reported information sent by the Internet of Things terminal, it will obtain the user ID from the reported information, and perform hash calculation on the user ID through a hash algorithm to obtain the The rule hash value; comparing the rule hash value with the rule hash partition list in the full rule configuration information one by one to determine the rule hash partition list where the rule hash value is located; Distributing the reported information to the rule processing service corresponding to the rule hash partition list. Specifically, the distribution of the reported information by the message dispatch service is as follows:

(a) Obtain the user identifier uId from the reported message;

(b) hashValue=|hashCode(uId)|%hashMax;

(c) Through the rule configuration information in the rule service, compare the hashRange list of each rule processing service one by one, and query the rule processing service Sa whose hashRange range includes the hashValue;

(d) The message dispatch service sends the message to the rule processing service Sa for processing.

FIG. 3 is a schematic flowchart of a method for processing massive rules based on an Internet of Things platform provided by another embodiment of the present invention. As shown in FIG. 3 , in this embodiment, the method includes steps S110-S190. That is, in this embodiment, the method further includes steps S160-S190 after step S150 in the above embodiment.

S160. The rule distribution management service expands the rule processing service to obtain a change rule configuration information list;

S170. The rule distribution management service sends the change rule configuration information in the change rule configuration information list to the corresponding rule processing service, and sends the full change rule configuration information to the message dispatch service;

S180. The rule processing service obtains a rule corresponding to the rule hash value from the database rule table according to the change rule configuration information, and loads it;

S190. The message dispatch service updates the full rule configuration information according to the content in the modified full rule configuration information.

In the embodiment of the present invention, if a new rule processing service is added, the rule distribution management service expands the rule processing service to obtain a list of changed rule configuration information. Specifically, the rule distribution management service adds the newly added The rule processing service identifies, and calculates the average number of rule hash partition lists that the newly added rule processing service can carry; and processes the rule according to the number of rule hash partition lists in each of the rule processing services. The services are sorted from large to small to obtain a rule processing service sorting list; the rule distribution management service divides the rules on the rule processing service sorting list that meet the preset conditions according to the average number of rule hash partition lists The list is migrated to the newly added rule processing service until the rule hash partition list on the newly added rule processing service is not less than the number of the average rule hash partition lists, wherein the preset condition is The number of rule hash partition lists on the rule processing service is greater than the number of the average rule hash partition lists; Save the rule configuration information to get the change rule configuration information list. The rule distribution management service sends the change rule configuration information in the change rule configuration information list to the corresponding rule processing service, and sends the full change rule configuration information to the message dispatch service; the rule processing service Obtain and load the rule corresponding to the rule hash value from the database rule table according to the changed rule configuration information; the message dispatch service performs the full rule according to the content in the changed full rule configuration information The configuration information is updated. For the convenience of understanding, now take adding a rule processing service as an example, and introduce the steps of the expansion method in detail as follows:

(a) The newly added rule processing service is identified as Sx, where x is the total number of current rule processing services plus 1;

(b) Add the newly added rule processing service Sx in the rule processing service list of the rule distribution management service;

(c) Calculate the number of average rule hash partition lists avgHashRange carried by the newly added rule processing services S1, S2, ..., Sx, wherein, avgHashRange=M/total number of rule processing services, M is The number of hash Range;

(d) sort the rule processing services from large to small according to the hashRange number carried by each rule processing service, and obtain the rule processing service sorting list listS;

(e) Starting from the first rule processing service in the rule processing service sorting list listS, the hashRange on it is migrated to Sx one by one in a loop until the condition fx is satisfied: the number of hashRange on Sx >= avgHashRange or the rule processing service The number of hashRange on <= avgHashRange;

(f) If the condition fx cannot be satisfied, continue to select the next rule processing service from the rule processing service ranking list listS, and perform the processing steps in e), until fx is satisfied or there is no rule processing service in listS;

(g) mark the rule processing service whose hashRange number has changed to the list listSc, and change the rule processing configuration information;

(h) sending the rule processing configuration information of each rule processing service in the listSc to the corresponding rule processing service one by one, and sending all the rule processing configuration information in the listSc to the message dispatching service;

(i) The rule processing service that receives the rule configuration information loads and updates the rules according to the received rule configuration information, and the message dispatch service updates the full rule configuration information according to the rule content in listSc.

It should be noted that, in this embodiment, the rule processing service can be expanded through the above expansion method, thereby further improving the efficiency of rule processing. It should also be noted that in this embodiment, the database service, rule distribution management service, message dispatch service, and each rule processing service are all deployed on different virtual machines.

FIG. 4 is a schematic block diagram of a massive rule processing system 200 based on an Internet of Things platform provided by an embodiment of the present invention. As shown in FIG. 4, corresponding to the massive rule processing method based on the Internet of Things platform applied to the rule distribution management service 10, rule processing service 20, and message dispatch service 30 above, the massive rule processing system 200 based on the Internet of Things platform It includes a unit for executing the above-mentioned massive rule processing method based on the Internet of Things platform. Specifically, please refer to FIG. 4 , the massive rule processing system 200 based on the Internet of Things platform includes an acquisition and calculation unit 101 configured in the rule distribution management service 10, a generation and storage unit 102, and a first sending unit 103, which are configured in the rule processing service The first acquisition and loading unit 201 in 20 and the distribution unit 301 configured in the message distribution service 30 .

Wherein, the acquisition calculation unit 101 is used for the rule distribution management service to acquire the user identifier from the database rule table, and calculate the rule hash value of each rule according to the user identifier and the preset rule hash upper limit value, and convert the The rule hash value is stored in the database rule table; the generation and storage unit 102 is used for the rule distribution management service to generate the load required for each rule processing service in a striped manner according to the preset hash sharding rule The rule hash partition list, and save it to obtain the rule configuration information; the first sending unit 103 is used for the rule distribution management service to send the rule configuration information to the corresponding rule processing service, and send all rules The configuration information is sent to the message dispatching service; the first obtaining and loading unit 201 is used for the rule processing service to obtain the rules corresponding to the rule hash partition list from the database rule table according to the rule configuration information to perform Loading; the allocating unit 301 is used for the message dispatch service to allocate the reported information according to the full rule configuration information and the user identifier in the reported information if the message dispatch service receives the reported information.

In some embodiments, such as this embodiment, the acquisition calculation unit 101 includes a first calculation unit and a second calculation unit.

Wherein, the first computing unit is used to obtain the user ID, and performs hash calculation on the user ID through a hash algorithm to obtain a first hash value; the second computing unit is used to obtain the absolute value of the The second hash value is obtained by calculating the modulus of the preset regular hash upper limit value from the first hash value, and the second hash value is used as the regular hash value.

In some embodiments, such as this embodiment, the generation and storage unit 102 includes an identification unit, a configuration unit, and a first storage unit.

Wherein, the identification unit is used for the rule distribution management service to identify n rule processing services, and divides the range of the preset rule hash upper limit value into M rule hash partition lists, where m ≥n; the configuration unit is used to configure m rule hash partition lists to n rule processing services in a striping method; the first storage unit is used for each rule processing service , saving the correspondence between the rule processing service and the rule hash partition list to obtain rule configuration information.

In some embodiments, such as this embodiment, the first acquiring and loading unit 201 includes an acquiring unit and a loading unit.

Wherein, the obtaining unit is used for the rule processing service to obtain the rule hash partition list from the rule configuration information; The rules corresponding to the rule hash partition list are loaded.

In some embodiments, such as this embodiment, the allocating unit 301 includes a third computing unit, a comparing unit, and an allocating subunit.

Wherein, the third calculation unit is used to obtain the user ID from the reported information, and perform hash calculation on the user ID through a hash algorithm to obtain the regular hash value; the comparison unit is used to comparing the rule hash value with the rule hash partition list in the full rule configuration information one by one to determine the rule hash partition list where the rule hash value is; Distributing the reported information to the rule processing service corresponding to the rule hash partition list.

The massive rule processing system 200 based on the Internet of Things platform in another embodiment of the present invention is based on the above embodiment, adding the expansion unit 104 and the second sending unit 105 configured in the rule distribution management service 10, and configured in the rule distribution management service 10. The second acquiring and loading unit 202 of the rule processing service 20 and the updating unit 302 configured in the message dispatch service.

Wherein, the expansion unit 104 is used for the rule distribution management service to expand the rule processing service to obtain a change rule configuration information list; the second sending unit 105 is used for the rule distribution management service to convert the change rule The change rule configuration information in the configuration information list is sent to the corresponding rule processing service, and the full change rule configuration information is sent to the message dispatch service; the second acquisition and loading unit 202 is used for the rule processing service according to The change rule configuration information is loaded from the rule table of the database corresponding to the rule corresponding to the rule hash value; the update unit 302 is used for the message dispatch service according to The content updates the full rule configuration information.

In some embodiments, such as this embodiment, the expansion unit 104 includes an identification calculation unit, a sorting unit, a migration unit, and a second storage unit.

Wherein, the identification calculation unit is used for the rule distribution management service to identify the newly added rule processing service, and calculate the average number of rule hash partition lists that the newly added rule processing service can carry The sorting unit is used to sort the rule processing services from large to small according to the number of rule hash partition lists in each of the rule processing services to obtain a rule processing service sorting list; the migration unit is used for the rule The distribution management service migrates the rule hash partition list on the sorted list of the rule processing service that meets the preset condition to the newly added rule processing service according to the number of the average rule hash partition list, until the newly added The rule hash partition list on the rule processing service is not less than the number of the average rule hash partition list; the second storage unit is used for the rule distribution management service to migrate the rule hash partition list The rule processing service saves the rule configuration information to obtain a change rule configuration information list.

It should be noted that those skilled in the art can clearly understand that the above-mentioned massive rule processing system 200 based on the Internet of Things platform and the specific implementation process of each unit can refer to the corresponding descriptions in the foregoing method embodiments. For the convenience of description and brevity, will not be repeated here.

The above-mentioned massive rule processing system based on the Internet of Things platform can be realized in the form of a computer program, and the computer program can run on the computer device as shown in FIG. 5 .

Please refer to FIG. 5 . FIG. 5 is a schematic block diagram of a computer device provided by an embodiment of the present application. The computer device 900 is a device built with rule distribution management service, rule processing service and message dispatch service.

Referring to FIG. 5 , the computer device 900 includes a processor 902 connected through a system bus 901 , a memory and an interface 907 , where the memory may include a storage medium 903 and an internal memory 904 .

The storage medium 903 can store an operating system 9031 and a computer program 9032 . When the computer program 9032 is executed, the processor 902 can execute a massive rule processing method based on the Internet of Things platform.

The processor 902 is used to provide computing and control capabilities to support the operation of the entire computer device 900 .

The internal memory 904 provides an environment for running the computer program 9032 in the storage medium 903. When the computer program 9032 is executed by the processor 902, the processor 902 can execute a massive rule processing method based on the Internet of Things platform.

The interface 905 is used to communicate with other devices. Those skilled in the art can understand that the structure shown in FIG. 5 is only a block diagram of a partial structure related to the solution of this application, and does not constitute a limitation on the computer device 900 on which the solution of this application is applied. The specific computer device 900 may include more or fewer components than shown, or combine certain components, or have a different arrangement of components.

Wherein, the respective processors 902 of the rule distribution management service, rule processing service and message dispatch service are configured to run a computer program 9032 stored in a memory, so as to realize the process steps of the embodiments of the above method.

It should be understood that in the embodiment of the present application, the processor 902 may be a central processing unit (Central Processing Unit, CPU), and the processor 902 may also be other general-purpose processors, digital signal processors (Digital Signal Processor, DSP), dedicated integrated Circuit (terminal lication Specific Integrated Circuit, ASIC), off-the-shelf programmable gate array (Field-Programmable Gate Array, FPGA) or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components, etc. Wherein, the general-purpose processor may be a microprocessor or the processor may be any conventional processor or the like.

Those of ordinary skill in the art can understand that all or part of the processes in the methods of the above embodiments can be implemented by instructing related hardware through computer programs. The computer program can be stored in a storage medium, which is a computer-readable storage medium. The computer program is executed by at least one processor in the wireless communication system, so as to implement the process steps of the above method embodiments.

Therefore, the present invention also provides a storage medium. The storage medium may be a computer readable storage medium. The storage medium stores a computer program. When the computer program is executed by the processor, the processor executes any embodiment of the above-mentioned massive rule processing method based on the Internet of Things platform.

The storage medium may be various computer-readable storage media capable of storing program codes, such as a U disk, a mobile hard disk, a read-only memory (Read-Only Memory, ROM), a magnetic disk, or an optical disk.

Those of ordinary skill in the art can realize that the units and algorithm steps of the examples described in conjunction with the embodiments disclosed herein can be implemented by electronic hardware, wireless communication software, or a combination of the two. In order to clearly illustrate the hardware and software In the above description, the components and steps of each example have been generally described according to their functions. Whether these functions are executed by hardware or software depends on the specific application and design constraints of the technical solution. Skilled artisans may use different methods to implement the described functions for each specific application, but such implementation should not be regarded as exceeding the scope of the present invention.

In the several embodiments provided by the present invention, it should be understood that the disclosed system and method can be implemented in other ways. For example, the system embodiments described above are illustrative only. For example, the division of each unit is only a logical function division, and there may be another division method in actual implementation. For example, several units or components may be combined or integrated into another system, or some features may be omitted, or not implemented.

The steps in the methods of the embodiments of the present invention can be adjusted, combined and deleted according to actual needs. The units in the system of the embodiment of the present invention can be merged, divided and deleted according to actual needs. In addition, each functional unit in each embodiment of the present invention may be integrated into one processing unit, each unit may exist separately physically, or two or more units may be integrated into one unit.

If the integrated unit is realized in the form of a software function unit and sold or used as an independent product, it can be stored in a storage medium. Based on this understanding, the technical solution of the present invention is essentially or the part that contributes to the prior art, or all or part of the technical solution can be embodied in the form of a software product, and the wireless communication software product is stored in a storage In the medium, several instructions are included to make a computer device (which may be a personal wireless communication device, a terminal, or a network device, etc.) execute all or part of the steps of the method described in each embodiment of the present invention.

In the foregoing embodiments, the descriptions of each embodiment have their own emphases, and for parts not described in detail in a certain embodiment, reference may be made to relevant descriptions of other embodiments.

Obviously, those skilled in the art can make various changes and modifications to the present invention without departing from the spirit and scope of the present invention. Thus, even if these modifications and variations of the present invention fall within the scope of the claims of the present invention and equivalent technologies, the present invention is also intended to include these modifications and variations.

The above is only a specific embodiment of the present invention, but the protection scope of the present invention is not limited thereto. Any person familiar with the technical field can easily think of various equivalents within the technical scope disclosed in the present invention. Modifications or replacements shall all fall within the protection scope of the present invention. Therefore, the protection scope of the present invention should be based on the protection scope of the claims.

Claims (10)

1. A massive rule processing method based on the Internet of Things platform, characterized in that, comprising: The rule distribution management service obtains the user ID from the database rule table, calculates the rule hash value of each rule according to the user ID and the preset rule hash upper limit value, and saves the rule hash value to the database rule table; The rule distribution management service generates a list of rule hash partitions to be loaded by each rule processing service in a striped manner according to the preset hash sharding rules, and saves them to obtain rule configuration information; The rule distribution management service sends the rule configuration information to the corresponding rule processing service, and sends the full amount of rule configuration information to the message dispatch service; The rule processing service obtains and loads rules corresponding to the rule hash partition list from the rule table of the database according to the rule configuration information; If the message dispatch service receives the reported information, it distributes the reported information according to the full rule configuration information and the user identifier in the reported information. 2. The massive rule processing method based on the Internet of Things platform according to claim 1, wherein the step of calculating the rule hash value according to the user identification and the preset rule hash upper limit value includes: Obtain a user ID, and perform hash calculation on the user ID by a hash algorithm to obtain a first hash value; The second hash value is obtained by taking the remainder of the first hash value after taking the absolute value and the preset regular hash upper limit value, and using the second hash value as the regular hash value. 3. The massive rule processing method based on the Internet of Things platform according to claim 1, wherein the rule distribution management service generates each rule processing service station in a striped manner according to the preset hash fragmentation rules. The steps to load the hash partition list of rules and save them to obtain the rule configuration information include: The rule distribution management service identifies n rule processing services, and divides the range of the preset rule hash upper limit into M rule hash partition lists, where m≥n; configuring the m rule hash partition lists to the n rule processing services in a striping method; For each rule processing service, the corresponding relationship between the rule processing service and the rule hash partition list is stored to obtain rule configuration information. 4. The massive rule processing method based on the Internet of Things platform according to claim 1, wherein the rule processing service obtains the hash partition list of the rule from the database rule table according to the rule configuration information The steps for loading the corresponding rules include: The rule processing service obtains the rule hash partition list from the rule configuration information; Obtain and load the rule corresponding to the rule hash partition list from the preset field of the database rule table. 5. The massive rule processing method based on the Internet of Things platform according to claim 1, characterized in that, the step of distributing the reported information according to the full amount of rule configuration information and the user identification in the reported information ,include: Obtain the user ID from the reported information, and perform hash calculation on the user ID by a hash algorithm to obtain the regular hash value; comparing the rule hash value one by one with the rule hash partition list in the full rule configuration information to determine the rule hash partition list where the rule hash value is located; Distributing the reported information to the rule processing service corresponding to the rule hash partition list. 6. the massive rule processing method based on the Internet of Things platform according to claim 1, is characterized in that, described method also comprises: The rule distribution management service expands the rule processing service to obtain a change rule configuration information list; The rule distribution management service sends the change rule configuration information in the change rule configuration information list to the corresponding rule processing service, and sends the full change rule configuration information to the message dispatch service; The rule processing service obtains and loads the rule corresponding to the rule hash value from the rule table of the database according to the change rule configuration information; The message dispatch service updates the full rule configuration information according to the content in the changed full rule configuration information. 7. The massive rule processing method based on the Internet of Things platform according to claim 6, wherein the rule distribution management service expands the rule processing service to obtain the step of changing the rule configuration information list, comprising: The rule distribution management service identifies the newly added rule processing service, and calculates the average number of rule hash partition lists that the newly added rule processing service can carry; Sorting the rule processing services from large to small according to the number of rule hash partition lists in each of the rule processing services to obtain a rule processing service sorting list; The rule distribution management service migrates the rule hash partition list on the sorted list of the rule processing service that meets the preset condition to the newly added rule processing service according to the average number of rule hash partition lists, until The newly added rule hash partition list on the rule processing service is not less than the number of the average rule hash partition list; The rule distribution management service saves the rule configuration information of the rule processing service that has been migrated from the rule hash partition list to obtain a changed rule configuration information list. 8. A massive rule processing system based on the Internet of Things platform, characterized in that it includes: an acquisition calculation unit configured in the rule distribution management service, a generation storage unit and a first sending unit, and a first sending unit configured in the rule processing service Obtain the loading unit and the allocation unit configured in the message dispatch service, wherein, The obtaining calculation unit is used for the rule distribution management service to obtain the user identifier from the database rule table, and calculate the rule hash value of each rule according to the user identifier and the preset rule hash upper limit value, and hash the rule Save the hash value to the database rule table; The generation and storage unit is used for the rule distribution management service to generate a list of rule hash partitions that need to be loaded by each rule processing service in a striped manner according to the preset hash sharding rules, and store them to obtain the rule configuration information; The first sending unit is used for the rule distribution management service to send the rule configuration information to the corresponding rule processing service, and send the full amount of rule configuration information to the message dispatch service; The first obtaining and loading unit is used for the rule processing service to obtain and load rules corresponding to the rule hash partition list from the database rule table according to the rule configuration information; The allocating unit is configured to allocate the reported information according to the full rule configuration information and the user identifier in the reported information if the message dispatch service receives the reported information. 9. A massive rule processing system based on the Internet of Things platform, characterized in that it includes rule distribution management services, rule processing services, and message dispatch services, and the rule distribution management services, rule processing services, and message dispatch services all include memory and A processor, a computer program is stored on the memory, and when the processor of the rule distribution management service, rule processing service, and message dispatch service executes the computer program, it realizes any one of claims 1-7 Methods. 10. A computer-readable storage medium, wherein the storage medium stores a computer program, and when the computer program is executed by a processor, the method according to any one of claims 1-7 can be implemented.

Images