CN112052104A - Management method and electronic equipment of message queue based on multi-room implementation - Google Patents

Abstract

The invention discloses a management method of message queues based on multi-computer room realization and an electronic device, wherein the method comprises the following steps: responding to a message writing request triggered by a message production end corresponding to a first machine room by a first machine room in a plurality of machine rooms, writing message data contained in the message writing request into a message queue corresponding to the first machine room, and storing a mapping relation between the message queue corresponding to the first machine room and a queue machine room between the first machine rooms into configuration metadata; and a second machine room in the plurality of machine rooms responds to the message consumption request triggered by the message consumption end corresponding to the second machine room, determines the message queue corresponding to the message consumption request as a target message queue, determines the machine room where the target message queue is located as a target machine room according to the configuration metadata, and transmits the message data of the target message queue in the target machine room to the second machine room. The method avoids the delay problem caused by the production of the message across the machine room, and is suitable for service scenes with high real-time performance.

Description

Management method and electronic equipment of message queue based on multi-room implementation

technical field

The invention relates to the field of computers, in particular to a method for managing message queues and electronic equipment based on multi-room implementation.

Background technique

A message queue is used to store data to be transmitted into the queue. Among them, the business end that writes data to the queue is called the message producer, and the business end that reads data from the queue is called the message consumer. The orderly storage of multiple message data can be achieved through the message queue, which is conducive to the reliable transmission of messages.

With the increasing complexity of business scenarios, many business systems include multiple computer rooms. In the implementation plan across computer rooms, the message producer needs to pre-determine the computer room where the message consumer is located, and when the message consumer and the message producer are separated When located in different computer rooms, in order to ensure smooth consumption by the message consumer, the message data produced by the message producer in the first computer room needs to be transmitted to the second computer room where the message consumer is located for storage.

However, in the process of implementing the present invention, the inventor found that the above solutions in the prior art have at least the following defects: On the one hand, in a complex business scenario, one message producer may correspond to multiple message consumers. Predetermining the number of message consumers and the computer room where each message consumer is located has become an urgent technical problem to be solved; on the other hand, the message producer needs to transmit the generated message data across the computer room to the computer room where the message consumer is located. Defects such as data transmission delay may be caused by line reasons between individual computer rooms or network reasons, which cannot be applied in business scenarios with high real-time requirements.

SUMMARY OF THE INVENTION

In view of the above problems, the present invention is proposed to provide a method and electronic device for managing message queues based on multi-machine room implementations that overcome the above problems or at least partially solve the above problems.

According to one aspect of the present invention, a method for managing message queues based on multiple computer rooms is provided, including:

In response to a message write request triggered by a message producer corresponding to the first computer room, the first computer room in the plurality of computer rooms writes the message data contained in the message write request into the first computer room. corresponding message queue, and store the message queue corresponding to the first computer room and the queue-computer room mapping relationship between the first computer room in the configuration metadata;

The second computer room in the plurality of computer rooms determines the message queue corresponding to the message consumption request as the target message queue in response to the message consumption request triggered by the message consumption terminal corresponding to the second computer room, and according to the configuration The metadata determines the computer room where the target message queue is located as the target computer room, and transmits the message data of the target message queue in the target computer room to the second computer room for consumption by the message consumer.

According to another aspect of the present invention, an electronic device is provided, comprising: a processor, a memory, a communication interface, and a communication bus, and the processor, the memory, and the communication interface can communicate with each other through the communication bus. communication;

The memory is used to store at least one executable instruction, and the executable instruction causes the processor to perform the following operations:

In response to a message write request triggered by a message producer corresponding to the first computer room, the first computer room in the plurality of computer rooms writes the message data contained in the message write request into the first computer room. corresponding message queue, and store the message queue corresponding to the first computer room and the queue-computer room mapping relationship between the first computer room in the configuration metadata;

The second computer room in the plurality of computer rooms determines the message queue corresponding to the message consumption request as the target message queue in response to the message consumption request triggered by the message consumption terminal corresponding to the second computer room, and according to the configuration The metadata determines the computer room where the target message queue is located as the target computer room, and transmits the message data of the target message queue in the target computer room to the second computer room for consumption by the message consumer.

According to yet another aspect of the present invention, a computer storage medium is provided, and at least one executable instruction is stored in the storage medium, and the executable instruction causes the processor to perform the following operations:

In response to a message write request triggered by a message producer corresponding to the first computer room, the first computer room in the plurality of computer rooms writes the message data contained in the message write request into the first computer room. corresponding message queue, and store the message queue corresponding to the first computer room and the queue-computer room mapping relationship between the first computer room in the configuration metadata;

The second computer room in the plurality of computer rooms determines the message queue corresponding to the message consumption request as the target message queue in response to the message consumption request triggered by the message consumption terminal corresponding to the second computer room, and according to the configuration The metadata determines the computer room where the target message queue is located as the target computer room, and transmits the message data of the target message queue in the target computer room to the second computer room for consumption by the message consumer.

In the method and electronic device for managing message queues based on the implementation of multiple computer rooms provided by the present invention, the message data generated by the message producing end is directly written into the local computer room where the message producing end is located, and it is not necessary to determine the computer room where the message consuming end is located. In the process of message production, there is no need to perform data transmission operations across computer rooms, which improves the real-time performance of operations and avoids the impact caused by network jitter; The queue computer room mapping relationship determines the computer room where the message queue to be consumed is located, so as to obtain data asynchronously for consumption. It can be seen that this method avoids the tedious operation of pre-determining the number of consumers and the computer room where they are located, and avoids the delay problem caused by the production of messages across computer rooms, and can be applied to business scenarios with high real-time requirements.

The above description is only an overview of the technical solutions of the present invention, in order to be able to understand the technical means of the present invention more clearly, it can be implemented according to the content of the description, and in order to make the above and other purposes, features and advantages of the present invention more obvious and easy to understand , the following specific embodiments of the present invention are given.

Description of drawings

Various other advantages and benefits will become apparent to those of ordinary skill in the art upon reading the following detailed description of the preferred embodiments. The drawings are for the purpose of illustrating preferred embodiments only and are not to be considered limiting of the invention. Also, the same components are denoted by the same reference numerals throughout the drawings. In the attached image:

FIG. 1 shows a flowchart of a method for managing message queues based on a multi-machine room implementation provided by an embodiment of the present invention;

2 shows a flowchart of a method for managing message queues based on a multi-machine room implementation provided by another embodiment of the present invention;

FIG. 3 shows a schematic structural diagram of an electronic device according to another embodiment of the present invention.

Detailed ways

Exemplary embodiments of the present disclosure will be described in more detail below with reference to the accompanying drawings. While exemplary embodiments of the present disclosure are shown in the drawings, it should be understood that the present disclosure may be embodied in various forms and should not be limited by the embodiments set forth herein. Rather, these embodiments are provided so that the present disclosure will be more thoroughly understood, and will fully convey the scope of the present disclosure to those skilled in the art.

Example 1

FIG. 1 shows a flowchart of a method for managing message queues based on a multi-machine room implementation provided by an embodiment of the present invention. As shown in Figure 1, the method includes the following steps:

Step S110: In response to a message writing request triggered by a message producer corresponding to the first computer room, the first computer room among the plurality of computer rooms writes the message data contained in the message writing request into a message corresponding to the first computer room queue, and store the message queue corresponding to the first computer room and the mapping relationship between the queues and computer rooms in the configuration metadata.

Wherein, the multiple computer rooms in this embodiment refer to: at least two computer rooms. Correspondingly, the first computer room in the multiple computer rooms may be any one of the multiple computer rooms. Specifically, each computer room corresponds to one or more services. Wherein, a service may correspond to a project or an application, or may correspond to a function in an application, which is not limited in the present invention. The service corresponding to each computer room may be a message producer, a message consumer, or a message producer and a message consumer at the same time, depending on the business function currently performed by the service.

When a service is used to generate message data, the service, as a message producer, sends a message write request to the computer room corresponding to the service. In this embodiment, the computer room corresponding to the service that sends the message write request is used as the first A machine room. In essence, for any computer room, as long as the service corresponding to the computer room triggers a message writing request as a message producer, the computer room is called the first computer room.

After the first computer room receives the message write request sent by the service of the local computer room, it writes the message data contained in the message write request into the message queue corresponding to the first computer room (that is, the local computer room), and writes the message data in the first computer room. The corresponding message queues and the queue-machine room mapping relationship between the first machine rooms are stored in the configuration metadata. It can be seen that, after receiving a message write request in any computer room, it does not need to determine the corresponding message consumer, but directly writes the received message data to the message queue corresponding to the computer room. This method does not need to go through the network transmission process across the computer room, so it can greatly improve the writing efficiency.

The message queue corresponding to the first computer room refers to a message queue stored in a storage space corresponding to the first computer room. The storage space corresponding to the first computer room may be a local storage space of the first computer room, or may be a storage space in a database connected to the first computer room. Specifically, the message queue corresponding to the first computer room may be set by The queue server in the first computer room is responsible for maintenance.

In addition, the queue computer room mapping relationship is used to store the corresponding relationship between the message queue produced by the message producer and the computer room where the message queue is located. Of course, the queue computer room mapping relationship may further store the ternary correspondence between the message producer, the message queue produced by the message producer, and the computer room where the message queue is located. The configuration metadata is used to uniformly store the above-mentioned mapping relationship between the queues and computer rooms, wherein the configuration metadata can be stored in the configuration server connected to each computer room in a unified manner, or stored in each computer room and shared by each computer room.

Step S120: In response to the message consumption request triggered by the message consumer corresponding to the second computer room, the second computer room in the plurality of computer rooms determines the message queue corresponding to the message consumption request as the target message queue, and according to the configuration metadata The computer room where the target message queue is located is determined as the target computer room, and the message data of the target message queue in the target computer room is transmitted to the second computer room for consumption by the message consumer.

Specifically, the second computer room in the multiple computer rooms may be any computer room in the multiple computer rooms. Since each computer room corresponds to one or more services, when a service is used to consume message data, the service, as a message consumer, sends a message consumption request to the computer room corresponding to the service. In this embodiment, the The computer room corresponding to the service for sending the message consumption request is used as the second computer room. In essence, for any computer room, as long as the service corresponding to the computer room triggers a message consumption request as a message consumer, the computer room is called the second computer room.

After the second computer room receives the message consumption request sent by the service of the local computer room, firstly, it determines the message queue corresponding to the message consumption request, and determines it as the target message queue; then, it queries the configuration metadata and determines the target according to the query result. The computer room where the message queue is located is determined as the target computer room; finally, the message data of the target message queue in the target computer room is transmitted to the second computer room for the message consumer to consume locally. It can be seen that after any computer room receives a message consumption request, it determines the computer room where the message queue to be consumed is located according to the configuration metadata, and then obtains data from the computer room.

The target computer room may be any computer room among multiple computer rooms. For example, the target computer room may be the above-mentioned first computer room, or may be a third computer room different from the first computer room and the second computer room. Of course, it may also be The second computer room itself, at this time, can directly obtain the message data in this computer room. In a word, the present invention does not limit the specific location of the target message queue and the target computer room, which completely depends on the actual needs of the business. In addition, when the message data of the target message queue in the target computer room is transmitted to the second computer room, the transmission can be performed through a dedicated data line between the two computer rooms.

In addition, it should also be noted that the above-mentioned first computer room and second computer room may be different computer rooms, or may be the same computer room, which is not limited in the present invention.

It can be seen that, in the method for managing message queues based on the implementation of multiple computer rooms provided by the present invention, the message data generated by the message producer is directly written into the computer room where the message producer is located, and there is no need to determine the computer room where the message consumer is located. In the process of message production, there is no need to perform data transmission operations across computer rooms, which improves the real-time performance of operations and avoids the impact caused by network jitter; The included queue computer room mapping relationship determines the computer room where the message queue to be consumed is located, thereby asynchronously acquiring data for consumption. It can be seen that this method avoids the tedious operation of pre-determining the number of consumers and the computer room where they are located, and avoids the delay problem caused by the production of messages across computer rooms, and can be applied to business scenarios with high real-time requirements.

Embodiment 2

FIG. 2 shows a flowchart of a method for managing message queues based on a multi-machine room implementation provided by another embodiment of the present invention. As shown in Figure 2, the method includes the following steps:

Step S200: Set proxy modules in each computer room respectively, and the proxy modules in each computer room jointly maintain configuration metadata.

Specifically, a proxy module is set in each computer room of the multiple computer rooms, and the proxy module in each computer room is used to process the message writing request and the message consumption request from each service, and according to the message writing request and the message consumption request Maintain configuration metadata. For example, the message writing request includes the ternary correspondence between the message producer, the message queue to be written, and the computer room where the message producer is located; the message consumption request includes the message consumer, the message queue to be consumed, and the message consumption The ternary correspondence of the computer room where the terminal is located. It can be seen that the proxy module of each computer room can establish and maintain the service (including the message producer and the message consumer) in the process of processing message writing requests and message consumption requests. The triple relationship group composed of message queue and computer room constitutes configuration metadata for subsequent processing.

In specific implementation, the proxy module of each computer room is used to process the message writing request and message consumption request sent by each service based on the extension protocol, and obtain and dynamically maintain the above-mentioned ternary relationship by analyzing the content of the message during the processing. Group.

It should be noted that this step is an optional step. In other embodiments of the present invention, an agent module may not be set, and related functions such as maintaining configuration metadata are implemented by changing the source code inside the computer room. The present invention The specific implementation details are not limited.

Step S210: The first computer room in the plurality of computer rooms writes the message data contained in the message write request into the message corresponding to the first computer room in response to the message writing request triggered by the message producer corresponding to the first computer room queue, and store the message queue corresponding to the first computer room and the mapping relationship between the queues and computer rooms in the configuration metadata.

Wherein, the multiple computer rooms in this embodiment refer to: at least two computer rooms. Correspondingly, the first computer room in the multiple computer rooms may be any one of the multiple computer rooms. Specifically, each computer room corresponds to one or more services. Wherein, a service may correspond to a project or an application, or may correspond to a function in an application, which is not limited in the present invention. The service corresponding to each computer room may be a message producer, a message consumer, or a message producer and a message consumer at the same time, depending on the business function currently performed by the service.

When a service is used to generate message data, the service, as a message producer, sends a message write request to the computer room corresponding to the service. In this embodiment, the computer room corresponding to the service that sends the message write request is used as the first A machine room. In essence, for any computer room, as long as the service corresponding to the computer room triggers a message writing request as a message producer, the computer room is called the first computer room. After the first computer room receives the message write request sent by the service of the local computer room, it writes the message data contained in the message write request into the message queue corresponding to the first computer room (that is, the local computer room), and writes the message data in the first computer room. The corresponding message queues and the queue-machine room mapping relationship between the first machine rooms are stored in the configuration metadata. It can be seen that, after receiving a message write request in any computer room, it does not need to determine the corresponding message consumer, but directly writes the received message data to the message queue corresponding to the computer room. This method does not need to go through the network transmission process across the computer room, so it can greatly improve the writing efficiency. The message queue corresponding to the first computer room refers to a message queue stored in a storage space corresponding to the first computer room. The storage space corresponding to the first computer room may be a local storage space of the first computer room, or may be a storage space in a database connected to the first computer room. Specifically, the message queue corresponding to the first computer room may be set by The queue server in the first computer room is responsible for maintenance.

In addition, the queue computer room mapping relationship is used to store the corresponding relationship between the message queue produced by the message producer and the computer room where the message queue is located. Of course, the queue computer room mapping relationship may further store the ternary correspondence between the message producer, the message queue produced by the message producer, and the computer room where the message queue is located. Configuration metadata is used to uniformly store the above queue room mapping relationship.

Among them, the configuration metadata can be stored in various ways: for example, in an optional implementation, the configuration metadata from each computer room is uniformly stored in the configuration server connected to each computer room, and the configuration server maintains it uniformly The configuration metadata from each computer room, correspondingly, the configuration server can implement functions such as deduplication and inspection for the configuration metadata, so as to ensure the accuracy of the configuration metadata. For another example, in another optional implementation manner, the configuration metadata generated by each computer room is stored in each computer room and shared by each computer room. Sharing, a computer room can request configuration metadata related to the currently received message consumption request from other computer rooms through a broadcast mechanism.

Wherein, on the premise that each computer room is provided with an agent module, this step is performed by the agent module in the first computer room. Specifically, the proxy module is responsible for parsing the received message write request, and constructs a ternary relationship according to the message producer identifier (ie, the service identifier), the message queue identifier to be written, and the computer room identifier of the computer room contained in the parsing result. group, so as to obtain the corresponding configuration metadata according to the ternary relationship group.

Among them, in order to facilitate communication, in this embodiment, each service sends various request data through the local computer room where the service is located. Correspondingly, the message writing request received by each computer room is obviously sent by the service from the local computer room. , therefore, when constructing a triple relation group corresponding to a message write request, the computer room ID included in the triple relation group is the identification of the computer room, and the message queue is also the message queue of the computer room.

Step S220: In response to the message consumption request triggered by the message consumer corresponding to the second computer room, the second computer room in the plurality of computer rooms determines the message queue corresponding to the message consumption request as the target message queue, and according to the configuration metadata The computer room where the target message queue is located is determined as the target computer room.

Specifically, the second computer room in the multiple computer rooms may be any computer room in the multiple computer rooms. Since each computer room corresponds to one or more services, when a service is used to consume message data, the service, as a message consumer, sends a message consumption request to the computer room corresponding to the service. In this embodiment, the The computer room corresponding to the service for sending the message consumption request is used as the second computer room. In essence, for any computer room, as long as the service corresponding to the computer room triggers a message consumption request as a message consumer, the computer room is called the second computer room.

Wherein, on the premise that each computer room is provided with an agent module, this step is performed by the agent module in the second computer room. Specifically, after receiving the message consumption request sent by the service in the second computer room, the proxy module in the second computer room performs the following operations:

First, the message consumption request is parsed to determine the message queue corresponding to the message consumption request (that is, the message queue to be consumed), which is determined as the target message queue. Then, the configuration metadata is queried, the computer room where the target message queue is located is determined according to the query result, and the computer room is determined as the target computer room. Since the configuration metadata records the correspondence between the message queue and the computer room where it is located, the computer room where the target message queue is located, that is, the target computer room, can be accurately determined based on the configuration metadata.

The target computer room may be any computer room among multiple computer rooms. For example, the target computer room may be the above-mentioned first computer room, or may be a third computer room different from the first computer room and the second computer room. Of course, it may also be The second computer room itself (in this case, the message data can be obtained directly in the own computer room of the second computer room). In a word, the present invention does not limit the specific location of the target message queue and the target computer room, which completely depends on the actual needs of the business.

Step S230: Transmit the message data of the target message queue in the target computer room to the second computer room for consumption by the message consumer.

Specifically, after the target computer room is determined, the message data of the target message queue in the target computer room is transmitted to the second computer room for the message consumer to consume locally. It can be seen that after any computer room receives a message consumption request, it determines the computer room where the message queue to be consumed is located according to the configuration metadata, and then obtains data from the computer room.

During specific implementation, the message data of the target message queue in the target computer room is transmitted to the second computer room through the computer room dedicated line between the target computer room and the second computer room. The network communication between any two computer rooms is through the computer room dedicated line. Therefore, the message data of the target message queue in the target computer room can be transmitted to the second computer room through the computer room dedicated line between the target computer room and the second computer room.

Specifically, the data transmission operation can be triggered by the second computer room sending a transmission request to the target computer room. Accordingly, the target computer room returns the message queue to the second computer room according to the identifier of the message queue included in the received transmission request. message data.

Optionally, in this embodiment, in order to improve the transmission efficiency of message data, a synchronization module is set in each computer room, and the synchronization module in each computer room communicates with the proxy module in the local computer room, which can be performed under the control of the proxy module. Data synchronization operation. Correspondingly, when transmitting the message data of the target message queue in the target computer room to the second computer room, the synchronization module in the target computer room transmits the message data of the target message queue in the target computer room to the second computer room.

In addition, the inventor found in the process of implementing the present invention that there is usually a fixed mapping relationship between the message consumer and the message queue to be consumed. For example, services A and B both serve as consumers to consume messages in the first message queue, As long as the first message queue is updated, services A and B will act as consumers to trigger a message consumption request. In addition, under the premise that services A and B are not relocated, the computer rooms where services A and B are located are also fixed. For example, service A is in computer room 1 and service B is in computer room 2. If the first message queue is located in computer room 3, Then, the content of the first message queue located in the computer room 3 needs to be transmitted to the computer room 1 and the computer room 2 respectively. In order to prevent the delay in the subsequent transmission process, based on the above-mentioned corresponding relationship, when monitoring the update of the first message queue in the computer room 3, the updated first message queue can be synchronized to the computer room 1 and the computer room 2 respectively, so as to facilitate subsequent consumption.

In order to achieve the above purpose, in this embodiment, it is necessary to determine the corresponding relationship between each consumer and the message queue to be consumed. When a message consumption request is triggered by the message consumption end, a set of three messages is generated according to the message consumption end corresponding to the message consumption request, the target message queue corresponding to the message consumption request, and the identifier of the second computer room corresponding to the message consumption end. Meta relationship group, which is added to the configuration metadata. It can be seen that the triple relation group generated according to the message consumption request is used to represent the correspondence between the message consumer, the message queue to be consumed, and the computer room where the message consumer is located. The subsequent synchronization direction can be determined according to the corresponding relationship.

Correspondingly, in order to improve the synchronization efficiency and reduce the transmission delay in the subsequent consumption process, the synchronization module in any computer room is further used to: determine any message queue in the computer room as the message queue to be synchronized, according to the configuration metadata. The ternary relationship group of the message queue to be synchronized determines the computer room corresponding to each message consumer of the message queue to be synchronized, and synchronizes the message data in the message queue to be synchronized to the computer room corresponding to each message consumer. Specifically, the synchronization module in each computer room can periodically poll whether each message queue in the computer room is updated, and when any message queue is updated, according to the ternary relationship group in the configuration metadata, determine the message related to the updated message. The consumer terminal corresponding to the queue and the computer room where it is located, and then the updated message queue is synchronized to the computer room where the consumer terminal is located.

In addition, although the above-mentioned ternary relationship group can store the correspondence between the message consumer, the message queue to be consumed, and the identifier of the computer room where the message consumer is located, the inventor found in the process of implementing the present invention that the message consumer The relationship with the message queue to be consumed may change, and the computer room where the message consumer is located may also change due to the computer room migration operation. Therefore, in order to adapt to the above changes, the ternary relationship group in this embodiment can be dynamically updated. For example, it can be dynamically updated according to the received message consumption request triggered by the message consumer after switching the computer room, and can also be dynamically updated according to when the message consumer adds a new message queue to be consumed.

In order to perceive the change of the corresponding relationship in the ternary relationship group, in this embodiment, every time the second computer room in the multiple computer rooms generates a set of ternary relationship groups according to the message consumption request, it is further judged whether the configuration metadata is The triple relation group corresponding to the message consumer included in the message consumption request has been stored. If so, further obtain the stored triple relation group corresponding to the message consumer included in the message consumption request. Computer room information, compare the acquired computer room information with the computer room information in the ternary relationship group generated this time, and judge whether the message consumer included in the message consumption request has undergone computer room migration according to the comparison result. For example, if the acquired computer room information is inconsistent with the computer room information in the ternary relationship group generated this time, it is determined that the message consumer included in the message consumption request has undergone computer room migration. When it is determined that the computer room is to be migrated, it is necessary to delete the ternary relationship group corresponding to the migration from the configuration metadata, and only retain the ternary relationship group corresponding to the migration, so as to realize the dynamic update of the corresponding relationship.

Similarly, every time the second computer room in the multiple computer rooms generates a set of ternary relationship groups according to the message consumption request, it is further judged whether the configuration metadata has stored the corresponding message consumer included in the message consumption request. If there is a ternary relationship group, further obtain the stored information of the message queue to be consumed in the ternary relationship group corresponding to the message consumer included in the message consumption request, and compare the obtained message queue information with this Compare the information of the message queues in the ternary relationship group generated for the second time, and judge whether the message consumer included in the message consumption request has added a new message queue to be consumed according to the comparison result. If so, add a new message queue to the configuration metadata. the above-mentioned correspondence.

All in all, the configuration metadata in this embodiment can be dynamically updated according to each received message consumption request, so as to dynamically maintain the computer room to which each message consumer currently belongs and the message queue to be consumed corresponding to each message consumer. Correspondingly, the synchronization module in each computer room dynamically determines each message consumer corresponding to each message queue in the computer room and its corresponding computer room based on the dynamically changing configuration metadata, so as to synchronize the message data in the message queue to each The computer room corresponding to the message consumer. For example, a message queue M is stored in a computer room. Correspondingly, the synchronization module of the computer room determines that there are two consumers of the message queue M by analyzing the configuration metadata, namely the first consumer located in the computer room 1 and the consumer located in the computer room. 2, the synchronization module synchronizes the updated content to the computer room 1 and the computer room 2 after the message queue M is updated, so as to provide convenience for the subsequent consumption process.

During specific synchronization, the synchronization module consumes instead of the consumer of the message queue, and writes the consumed data into the computer room to be synchronized. For example, the synchronization module consumes the data in the message queue M instead of the consumer of the message queue M, and writes the consumed data content into the computer room 1 and the computer room 2 respectively.

In a specific example, the message producer corresponds to the real-time service, and the message consumer corresponds to the non-real-time service associated with the real-time service. Due to the high real-time requirements of real-time services, no matter which computer room the service as the message producer is located in, the message queue is directly written to the local computer room, thus avoiding the delay and jitter problems of cross-computer room transmission through the special line of the computer room, and, There is no need to care about the location of the computer room where the consumer end is located, especially for complex business scenarios with a large number of services. Since the message consumer corresponds to a non-real-time service, the data transmission process via the dedicated line in the computer room will not affect the business.

For example, when the method in this embodiment is applied to an e-book application, the message producing end can serve for book collection in the e-book. After the user receives the book, a new data record is added to the corresponding message queue to record the user The correspondence between the book collection and the book collection operation is very real-time. In order to avoid users waiting for a long time for the result feedback of the book collection operation, the response is improved by writing the data records into the local computer room where the book collection service is located. speed, avoiding long waits for users. Correspondingly, the message consumer can update the points in the e-book. When the user receives the book, the user points will be updated accordingly. Since the point update operation can be completed asynchronously, the consumption process is designed as a cross-border transaction through the computer room dedicated line. The transmission method in the computer room will not affect the use of users, thus effectively solving the problem of real-time service freezes in e-book applications.

In addition, in a specific example, the message queue may be implemented based on the Advanced Message Queuing Protocol (AMQP), for example, may be implemented using RabbitMQ. Among them, the synchronization module can be controlled by the synchronization switch. When the synchronization switch is turned on, the synchronization service can be realized; when the synchronization switch is turned off, the synchronization service will not be performed temporarily. By setting the synchronization switch for controlling each synchronization module in each computer room , which can flexibly determine whether to perform the synchronization operation of the message queue according to the business situation, so that the synchronization operation can be suspended when the business is busy, and the synchronization operation can be performed when the business is idle, thereby minimizing the impact of the synchronization operation on the business system.

The method in this embodiment is especially suitable for cross-project production scenarios, where there are a large number of producers and consumers, and one producer may correspond to multiple consumers, and one consumer may also correspond to multiple producers. In complex business scenarios, it is difficult to pre-determine the number of consumers corresponding to the produced message queues and the computer room where each consumer is located. Therefore, the above problems can be well solved by dynamically maintaining configuration metadata by the proxy module, and , After the consumer side switches the computer room, the configuration metadata can be automatically updated dynamically, so that it is not affected by the switch of the computer room, and the message data can be synchronized to the switched computer room in time for consumption.

The agent module in this embodiment may also be called an agent component or an agent element, which may be implemented in a software programming manner, or may also be implemented in a hardware manner, which is not limited in the present invention. Similarly, the synchronization module in this embodiment may also be referred to as a synchronization component or a synchronization element, which may be implemented in a software programming manner, or may also be implemented in a hardware manner, which is not limited in the present invention.

To sum up, the method in this embodiment avoids the tedious operation of pre-determining the number of consumers and the computer room where they are located, and avoids the delay problem caused by the production of messages across computer rooms, and can be applied to business scenarios with high real-time requirements. . By setting the proxy module, the message processing process can be taken over by the proxy module, thereby facilitating the unified maintenance of configuration metadata. Moreover, based on the configuration metadata, the consumer end corresponding to each message queue and the computer room where it is located can be determined, and then the synchronization module can complete the synchronization operation in advance, thereby improving the efficiency of subsequent consumption.

Embodiment 3

An embodiment of the present application provides a non-volatile computer storage medium, where the computer storage medium stores at least one executable instruction, and the computer-executable instruction can execute the message queue implemented based on multiple computer rooms in any of the foregoing method embodiments management method.

Executable instructions can specifically be used to cause the processor to perform the following operations:

In response to a message write request triggered by a message producer corresponding to the first computer room, the first computer room in the plurality of computer rooms writes the message data contained in the message write request into the first computer room. corresponding message queue, and store the message queue corresponding to the first computer room and the queue-computer room mapping relationship between the first computer room in the configuration metadata;

The second computer room in the plurality of computer rooms determines the message queue corresponding to the message consumption request as the target message queue in response to the message consumption request triggered by the message consumption terminal corresponding to the second computer room, and according to the configuration The metadata determines the computer room where the target message queue is located as the target computer room, and transmits the message data of the target message queue in the target computer room to the second computer room for consumption by the message consumer.

In an optional implementation manner, the executable instructions can specifically be used to cause the processor to perform the following operations: respectively setting proxy modules in each computer room, and the proxy modules in each computer room jointly maintain the configuration metadata; The message data contained in the message write request is written into the message queue corresponding to the first computer room, and the message queue corresponding to the first computer room and the queue-computer room mapping relationship between the first computer rooms The step of storing the configuration metadata is performed by an agent module in the first computer room; and the message queue corresponding to the message consumption request is determined as a target message queue, and the target message is stored according to the configuration metadata. The step of determining the computer room where the queue is located as the target computer room is performed by the agent module in the second computer room.

In an optional implementation manner, the executable instructions can specifically be used to cause the processor to perform the following operations: setting up synchronization modules in each computer room, and each synchronization module communicates with the agent module in the computer room; The transmission of the message data of the target message queue in the target computer room to the second computer room includes: transmitting the message data of the target message queue in the target computer room to the second computer room through the synchronization module in the target computer room. engine room.

In an optional implementation manner, the executable instructions may specifically be used to cause the processor to perform the following operations: according to the message consumer corresponding to the message consumption request, the target message queue corresponding to the message consumption request and the identifier of the second computer room corresponding to the message consumer, generate a set of ternary relationship groups, and add the ternary relationship groups to the configuration metadata.

In an optional implementation manner, the executable instructions may specifically be used to cause the processor to perform the following operations: the synchronization module determines any message queue in the local computer room as the message queue to be synchronized, and according to the configuration metadata The ternary relationship group in determines the computer room corresponding to each message consumer of the message queue to be synchronized, and synchronizes the message data in the message queue to be synchronized to the computer room corresponding to each message consumer.

In an optional implementation manner, the ternary relationship group is used to store the correspondence between the message consumer, the message queue to be consumed, and the identifier of the computer room where the message consumer is located; and, the ternary The relationship group can be dynamically updated according to the received message consumption request triggered by the message consumer after switching the computer room.

In an optional implementation manner, the executable instructions may specifically be used to cause the processor to perform the following operations:

The message data of the target message queue in the target computer room is transmitted to the second computer room through a computer room dedicated line located between the target computer room and the second computer room.

In an optional implementation manner, the message producer corresponds to a real-time service, and the message consumer corresponds to a non-real-time service associated with the real-time service.

Embodiment 4

FIG. 3 shows a schematic structural diagram of an electronic device according to another embodiment of the present invention. The specific embodiment of the present invention does not limit the specific implementation of the electronic device.

As shown in FIG. 3 , the electronic device may include: a processor (processor) 302 , a communication interface (Communications Interface) 304 , a memory (memory) 306 , and a communication bus 308 .

The processor 302 , the communication interface 304 , and the memory 306 communicate with each other through the communication bus 308 . The communication interface 304 is used for communicating with network elements of other devices such as clients or other servers. The processor 302 is configured to execute the program 310, and may specifically execute the relevant steps in the above-mentioned embodiments of the method for managing message queues implemented based on multiple computer rooms.

Specifically, the program 310 may include program code including computer operation instructions.

The processor 302 may be a central processing unit (CPU), or an application specific integrated circuit (ASIC), or one or more integrated circuits configured to implement embodiments of the present invention. The one or more processors included in the electronic device may be the same type of processors, such as one or more CPUs; or may be different types of processors, such as one or more CPUs and one or more ASICs.

The memory 306 is used to store the program 310 . Memory 306 may include high-speed RAM memory, and may also include non-volatile memory, such as at least one disk memory.

The program 310 can specifically be used to cause the processor 302 to perform the following operations:

In response to a message write request triggered by a message producer corresponding to the first computer room, the first computer room in the plurality of computer rooms writes the message data contained in the message write request into the first computer room. corresponding message queue, and store the message queue corresponding to the first computer room and the queue-computer room mapping relationship between the first computer room in the configuration metadata;

In response to the message consumption request triggered by the message consumer corresponding to the second computer room, the second computer room in the plurality of computer rooms determines the message queue corresponding to the message consumption request as the target message queue, and according to the configuration The metadata determines the computer room where the target message queue is located as the target computer room, and transmits the message data of the target message queue in the target computer room to the second computer room for consumption by the message consumer.

In an optional implementation manner, the executable instructions can specifically be used to cause the processor to perform the following operations: respectively setting proxy modules in each computer room, and the proxy modules in each computer room jointly maintain the configuration metadata; The message data contained in the message write request is written into the message queue corresponding to the first computer room, and the message queue corresponding to the first computer room and the queue-computer room mapping relationship between the first computer rooms The step of storing the configuration metadata is performed by the agent module in the first computer room; and the message queue corresponding to the message consumption request is determined as the target message queue, and the target message is stored according to the configuration metadata. The step of determining the computer room where the queue is located as the target computer room is performed by the agent module in the second computer room.

In an optional implementation manner, the executable instructions can specifically be used to cause the processor to perform the following operations: setting up synchronization modules in each computer room, and each synchronization module communicates with the agent module in the computer room; The transmission of the message data of the target message queue in the target computer room to the second computer room includes: transmitting the message data of the target message queue in the target computer room to the second computer room through the synchronization module in the target computer room. engine room.

In an optional implementation manner, the executable instructions may specifically be used to cause the processor to perform the following operations: according to the message consumer corresponding to the message consumption request, the target message queue corresponding to the message consumption request and the identifier of the second computer room corresponding to the message consumer, generate a set of ternary relationship groups, and add the ternary relationship groups to the configuration metadata.

In an optional implementation manner, the executable instructions may specifically be used to cause the processor to perform the following operations: the synchronization module determines any message queue in the local computer room as the message queue to be synchronized, and according to the configuration metadata The ternary relationship group in determines the computer room corresponding to each message consumer of the message queue to be synchronized, and synchronizes the message data in the message queue to be synchronized to the computer room corresponding to each message consumer.

In an optional implementation manner, the ternary relationship group is used to store the correspondence between the message consumer, the message queue to be consumed, and the identifier of the computer room where the message consumer is located; and, the ternary The relationship group can be dynamically updated according to the received message consumption request triggered by the message consumer after switching the computer room.

In an optional implementation manner, the executable instructions may specifically be used to cause the processor to perform the following operations:

The message data of the target message queue in the target computer room is transmitted to the second computer room through a computer room dedicated line located between the target computer room and the second computer room.

In an optional implementation manner, the message producer corresponds to a real-time service, and the message consumer corresponds to a non-real-time service associated with the real-time service.

The algorithms and displays provided herein are not inherently related to any particular computer, virtual system, or other device. Various general-purpose systems can also be used with teaching based on this. The structure required to construct such a system is apparent from the above description. Furthermore, the present invention is not directed to any particular programming language. It is to be understood that various programming languages may be used to implement the inventions described herein, and that the descriptions of specific languages above are intended to disclose the best mode for carrying out the invention.

In the description provided herein, numerous specific details are set forth. It will be understood, however, that embodiments of the invention may be practiced without these specific details. In some instances, well-known methods, structures and techniques have not been shown in detail in order not to obscure an understanding of this description.

Similarly, it is to be understood that in the above description of exemplary embodiments of the invention, various features of the invention are sometimes grouped together into a single embodiment, figure, or its description. This disclosure, however, should not be construed as reflecting an intention that the invention as claimed requires more features than are expressly recited in each claim. Rather, as the following claims reflect, inventive aspects lie in less than all features of a single foregoing disclosed embodiment. Thus, the claims following the Detailed Description are hereby expressly incorporated into this Detailed Description, with each claim standing on its own as a separate embodiment of this invention.

Those skilled in the art will understand that the modules in the device in the embodiment can be adaptively changed and arranged in one or more devices different from the embodiment. The modules or units or components in the embodiments may be combined into one module or unit or component, and further they may be divided into multiple sub-modules or sub-units or sub-assemblies. All features disclosed in this specification (including accompanying claims, abstract and drawings) and any method so disclosed may be employed in any combination, unless at least some of such features and/or procedures or elements are mutually exclusive. All processes or units of equipment are combined. Each feature disclosed in this specification (including accompanying claims, abstract and drawings) may be replaced by alternative features serving the same, equivalent or similar purpose, unless expressly stated otherwise.

Furthermore, it will be understood by those skilled in the art that although some of the embodiments herein include certain features, but not others, included in other embodiments, that combinations of features of the different embodiments are intended to be within the scope of the present invention And form different embodiments. For example, in the following claims, any of the claimed embodiments may be used in any combination.

It should be noted that the above-described embodiments illustrate rather than limit the invention, and that alternative embodiments may be devised by those skilled in the art without departing from the scope of the appended claims. In the claims, any reference signs placed between parentheses shall not be construed as limiting the claim. The word "comprising" does not exclude the presence of elements or steps not listed in a claim. The word "a" or "an" preceding an element does not exclude the presence of a plurality of such elements. The invention can be implemented by means of hardware comprising several different elements and by means of a suitably programmed computer. In a unit claim enumerating several means, several of these means may be embodied by one and the same item of hardware. The use of the words first, second, and third, etc. do not denote any order. These words can be interpreted as names.

Claims (10)

1. A management method of message queues realized based on multiple machine rooms comprises the following steps:

responding to a message writing request triggered by a message production end corresponding to a first machine room by a first machine room in a plurality of machine rooms, writing message data contained in the message writing request into a message queue corresponding to the first machine room, and storing a message queue corresponding to the first machine room and a queue machine room mapping relation between the first machine room into configuration metadata;

responding to a message consumption request triggered by a message consumption end corresponding to a second machine room, determining a message queue corresponding to the message consumption request as a target message queue by the second machine room in the plurality of machine rooms, determining the machine room where the target message queue is located as a target machine room according to the configuration metadata, and transmitting message data of the target message queue in the target machine room to the second machine room for consumption by the message consumption end.

2. The method of claim 1, wherein prior to performing the method, further comprising: respectively setting agent modules in each machine room, wherein the agent modules of the machine rooms maintain the configuration metadata together;

the step of writing the message data contained in the message write request into the message queue corresponding to the first machine room, and storing the message queue corresponding to the first machine room and the queue machine room mapping relationship between the first machine rooms into configuration metadata is executed by an agent module in the first machine room;

and the step of determining the message queue corresponding to the message consumption request as a target message queue and determining the machine room where the target message queue is located as a target machine room according to the configuration metadata is executed by an agent module in a second machine room.

3. The method of claim 2, wherein prior to performing the method, further comprising: setting synchronous modules in each machine room respectively, wherein each synchronous module is communicated with the agent module in the machine room;

the transmitting the message data of the target message queue in the target machine room to the second machine room includes: and transmitting the message data of the target message queue in the target machine room to a second machine room through a synchronization module in the target machine room.

4. The method of claim 3, wherein a second one of the plurality of kiosks responding to a message consumption request triggered by a message consumption peer corresponding to the second one further comprises:

and generating a group of ternary relationship groups according to a message consumption end corresponding to the message consumption request, a target message queue corresponding to the message consumption request and a second machine room identifier corresponding to the message consumption end, and adding the ternary relationship groups into the configuration metadata.

5. The method of claim 4, wherein the method further comprises: and the synchronization module determines any message queue in the machine room as a message queue to be synchronized, determines the machine room corresponding to each message consumption end of the message queue to be synchronized according to the ternary relationship group in the configuration metadata, and synchronizes the message data in the message queue to be synchronized to the machine room corresponding to each message consumption end.

6. The method according to claim 4 or 5, wherein the ternary relationship group is used for storing the corresponding relationship between a message consumption end, a message queue to be consumed and a machine room identifier where the message consumption end is located; and the three-element relation group can be dynamically updated according to a received message consumption request triggered by the message consumption end after the machine room is switched.

7. The method of any of claims 1-6, wherein the transmitting message data of the target message queue in the target room to the second room comprises:

and transmitting the message data of the target message queue in the target machine room to the second machine room through a machine room special line between the target machine room and the second machine room.

8. The method of any of claims 1-7, wherein the message producer corresponds to a real-time service and the message consumer corresponds to a non-real-time service associated with the real-time service.

9. An electronic device, comprising: the system comprises a processor, a memory, a communication interface and a communication bus, wherein the processor, the memory and the communication interface complete mutual communication through the communication bus;

the memory is configured to store at least one executable instruction that causes the processor to perform the method of any of claims 1-8.

10. A computer storage medium having stored therein at least one executable instruction that causes a processor to perform the method of any one of claims 1-8.

Images