CN118426963A - Distributed cache hot spot data processing method and device - Google Patents

Abstract

The present application discloses a distributed cache hotspot data processing method and device. The distributed cache hotspot data processing method includes: obtaining the key to be tested uploaded by each server; determining whether the key to be tested uploaded by each server is hotspot data, and if so, obtaining the event information corresponding to the key to be tested belonging to the hotspot data; and sending processing instructions to each server according to the event information or hotspot data corresponding to the key to be tested belonging to the hotspot data. The distributed cache hotspot data processing method of the present application performs corresponding processing instructions according to the event information or hotspot data corresponding to the key to be tested after the key to be tested is hotspot data, so that different servers can have different processing measures in response to different event information or hotspot data, rather than planning a single rule for each server to use.

Description

A distributed cache hotspot data processing method and device

Technical Field

The present application relates to the technical field of hotspot data processing, and in particular to a distributed cache hotspot data processing method and a distributed cache hotspot data processing device.

Background technique

Hot Data: refers to data that is frequently accessed in a distributed system.

Auto Degradation: Automatically taking measures to reduce system performance requirements when the system load is too high.

Faced with massive data explosion, traditional centralized storage systems are no longer the best choice. Distributed storage systems are now more commonly used to store massive data explosions. Distributed storage systems use a scale-out architecture to achieve ultra-large cluster deployment, starting with a 3-node storage cluster and flexibly expanding to thousands of nodes. The storage capacity can achieve a cluster EB (Exa Byte, a storage unit) level data space. At the same time, due to the distributed architecture, each storage node can provide independent performance support. In high-concurrency data processing, higher storage performance, higher bandwidth throughput and IOPS (Input/Output Operations Per Second, read and write times per second) can be achieved, effectively solving the high-scalability and high-performance storage requirements for massive data.

However, even distributed storage systems may encounter problems such as insufficient cache space when faced with hot data. Traditional solutions often rely on scheduled tasks or pre-set rules to perform data degradation in real time, which is not flexible and efficient enough when faced with burst traffic.

Summary of the invention

The object of the present invention is to provide a distributed cache hotspot data processing method to solve at least one of the above-mentioned technical problems.

One aspect of the present invention provides a distributed cache hotspot data processing method, the distributed cache hotspot data processing method comprising:

Get the key to be tested uploaded by each server;

Determine whether the key to be tested uploaded by each server is hot data. If so,

Get the event information corresponding to the key to be tested belonging to the hot data;

A processing instruction is sent to each server according to event information or hot data corresponding to the key to be tested belonging to the hot data, so that one or more of the servers perform storage adjustment according to the obtained processing instruction.

Optionally, determining whether the key to be tested uploaded by the server is hotspot data includes:

Determine whether the number of the same key to be tested uploaded by any server exceeds a first preset threshold within a preset time period, and if so, determine that the key to be tested is the first hotspot data;

The step of determining whether the key to be tested uploaded by the server is hotspot data includes:

It is determined whether the number of the same key to be tested uploaded by any multiple servers exceeds a second preset threshold within a preset time period. If so, it is determined that the key to be tested is the second hotspot data.

Optionally, the obtaining of event information corresponding to the key to be tested includes:

Acquire a corresponding association relationship database, wherein the corresponding association relationship database includes at least one preset key to be tested and event information corresponding to each preset key to be tested;

Get the event information corresponding to the preset key to be tested that is the same as the key to be tested belonging to the hot data.

Optionally, the hotspot data includes hotspot information, hot user information and hot interface information;

When the hotspot data is first hotspot data and the hotspot data is hotspot information, sending a processing instruction to each server according to the event information corresponding to the key to be tested belonging to the hotspot data, so that one or more of the servers perform storage adjustment according to the acquired processing instruction includes:

Acquire, according to the event information, relationship information between the server transmitting the first hotspot data and other servers respectively, wherein the relationship information includes a first intimate relationship and a first general relationship;

If the relationship information between the server that obtains the first hotspot data and other servers includes intimate relationships and general relationships, then

Generate a short-time fuse instruction, a first migration instruction, and a second migration instruction;

Sending the short-time fuse instruction to the server that transmits the first hotspot data;

Transmitting the first migration instruction to a server having a first intimate relationship with the server of the acquired first hotspot data;

The second migration instruction is transmitted to a server having a first general relationship with the server of the acquired first hotspot data.

Optionally, when the hotspot data is first hotspot data and the hotspot data is thermal interface information, sending a processing instruction to each server according to the hotspot data corresponding to the key to be tested belonging to the hotspot data, so that one or more of the servers perform storage adjustment according to the acquired processing instruction includes:

Acquire relationship information between other servers and the thermal interface information according to the thermal interface information, wherein the relationship information includes a second intimate relationship and a second general relationship;

If the relationship information between the other servers and the hot interface information includes a second intimate relationship and a second general relationship, then

Generate a short-time fuse instruction, a first migration instruction, and a second migration instruction;

Sending the short-time fuse instruction to the server that transmits the first hotspot data;

Transmitting the first migration instruction to a server having a second intimate relationship with the hot interface information;

The second migration instruction is transmitted to a server whose relationship information with the hot interface information is a second general relationship.

Optionally, when the hotspot data is first hotspot data and the hotspot data is hot user information, sending a processing instruction to each server according to the hotspot data corresponding to the key to be tested belonging to the hotspot data, so that one or more of the servers perform storage adjustment according to the acquired processing instruction includes:

Acquire relationship information between other servers and the hot user information according to the hot user information, wherein the relationship information includes a third intimate relationship and a third general relationship;

If the relationship information between other servers and the hot user information includes a third intimate relationship and a third general relationship, then

Generate a short-time fuse instruction, a first migration instruction, and a second migration instruction;

Sending the short-time fuse instruction to the server that transmits the first hotspot data;

Transmitting the first migration instruction to a server having a third intimate relationship with the hot user information;

The second migration instruction is transmitted to a server whose relationship information with the hot user information is a third general relationship.

Optionally, when the hotspot data is second hotspot data and the hotspot data is hotspot information, sending a processing instruction to each server according to the hotspot data corresponding to the key to be tested belonging to the hotspot data, so that one or more of the servers perform storage adjustment according to the acquired processing instruction includes:

Generate a short-time fuse instruction and a first migration instruction;

Sending the short-time fuse instruction to the server that transmits the second hotspot data;

The first migration instruction is transmitted to other servers.

Optionally, the first migration instruction includes:

storing at least a portion of cache data in the first-level cache into the second-level cache;

The second migration instruction includes:

At least part of the cached data in the secondary cache is migrated to the data pool.

Optionally, the first-level cache uses a memory-type cache;

The secondary cache is stored using a document-based database.

The present application also provides a distributed cache hotspot data processing device, the distributed cache hotspot data processing device comprising:

A key acquisition module to be tested, which is used to obtain the key to be tested uploaded by each server;

A hot data judgment module, which is used to judge whether the key to be tested uploaded by each server is hot data;

An event information acquisition module, wherein the event information acquisition module is used to acquire event information corresponding to the key to be tested belonging to the hot data when the hot data judgment module judges that it is yes;

A processing module is used to send processing instructions to each server according to event information or hot data corresponding to the key to be tested belonging to the hot data, so that one or more of the servers perform storage adjustment according to the obtained processing instructions.

Beneficial Effects

The distributed cache hotspot data processing method of the present application performs corresponding processing instructions according to the event information or hotspot data corresponding to the key to be tested after the key to be tested is hotspot data, so that different servers can have different processing measures in response to different event information or hotspot data, rather than planning a single rule for each server to use.

BRIEF DESCRIPTION OF THE DRAWINGS

FIG1 is a flow chart of a distributed cache hotspot data processing method according to an embodiment of the present application.

FIG. 2 is a schematic diagram of an electronic device for implementing the distributed cache hotspot data processing method shown in FIG. 1 .

Detailed ways

In order to make the purpose, technical scheme and advantages of the implementation of this application clearer, the technical scheme in the embodiment of this application will be described in more detail below in conjunction with the drawings in the embodiment of this application. In the drawings, the same or similar reference numerals throughout represent the same or similar elements or elements with the same or similar functions. The described embodiments are part of the embodiments of this application, not all of them. The embodiments described below with reference to the drawings are exemplary and are intended to be used to explain this application, and should not be construed as limitations on this application. Based on the embodiments in this application, all other embodiments obtained by ordinary technicians in this field without making creative work are within the scope of protection of this application. The embodiments of this application are described in detail below in conjunction with the drawings.

FIG1 is a flow chart of a distributed cache hotspot data processing method according to an embodiment of the present application.

The distributed cache hotspot data processing method shown in FIG1 includes:

Step 1: Get the key to be tested uploaded by each server;

Step 2: Determine whether the key to be tested uploaded by each server is hot data. If so,

Step 3: Obtain the hotspot data corresponding to the key to be tested that belongs to the hotspot data;

Step 4: Send processing instructions to each server according to the hot data corresponding to the key to be tested belonging to the hot data, so that one or more of the servers perform storage adjustment according to the obtained processing instructions.

The distributed cache hotspot data processing method of the present application performs corresponding processing instructions according to the event information or hotspot data corresponding to the key to be tested after the key to be tested is hotspot data, so that different servers can have different processing measures in response to different event information or hotspot data, rather than planning a single rule for each server to use.

In this embodiment, determining whether the key to be tested uploaded by the server is hotspot data includes:

Determine whether the number of the same key to be tested uploaded by any server exceeds a first preset threshold within a preset time period, and if so, determine that the key to be tested is the first hotspot data;

The step of determining whether the key to be tested uploaded by the server is hotspot data includes:

It is determined whether the number of the same key to be tested uploaded by any multiple servers exceeds a second preset threshold within a preset time period. If so, it is determined that the key to be tested is the second hotspot data.

In this embodiment, the first preset threshold and the second preset threshold can be set according to one's own needs.

For example, the data heat can be set to hot_spot according to the number of accesses. The data heat will continue to decrease over time. When the heat drops to a certain value, the data becomes cold data. The data heat is variable. For example, the data heat of a data is set to 10 according to the number of accesses. After that, each time the data is accessed, the data heat of the data increases by 1. If the data exceeds the first preset threshold, the key to be tested is considered to be hot data.

In this embodiment, obtaining the event information corresponding to the key to be tested includes:

Acquire a corresponding association relationship database, wherein the corresponding association relationship database includes at least one preset key to be tested and event information corresponding to each preset key to be tested;

Get the event information corresponding to the preset key to be tested that is the same as the key to be tested belonging to the hot data.

For example, the prefix of key:goods is the product details (for example, instant noodles, milk), and instant noodles and milk are part of the event information. It is understandable that the event information can also be other things, such as a person's name, a hot word, etc.

In this embodiment, the hotspot data includes hotspot information, hot user information and hot interface information;

When the hotspot data is first hotspot data and the hotspot data is hotspot information, sending a processing instruction to each server according to the event information corresponding to the key to be tested belonging to the hotspot data, so that one or more of the servers perform storage adjustment according to the acquired processing instruction includes:

Acquire, according to the event information, relationship information between the server transmitting the first hotspot data and other servers respectively, wherein the relationship information includes a first intimate relationship and a first general relationship;

If the relationship information between the server that obtains the first hotspot data and other servers includes intimate relationships and general relationships, then

Generate a short-time fuse instruction, a first migration instruction, and a second migration instruction;

Sending the short-time fuse instruction to the server that transmits the first hotspot data;

Transmitting the first migration instruction to a server having a first intimate relationship with the server of the acquired first hotspot data;

The second migration instruction is transmitted to a server having a first general relationship with the server of the acquired first hotspot data.

In this way, it can be determined based on the relationship between the servers whether it is necessary to control the instructions of other servers due to frequent operations performed by one of the servers.

For example, taking a social networking site as an example, if a hot event occurs, causing a server to frequently search for certain keywords, or a server is brushing orders through some event-brushing software, at this time, although the server needs to be downgraded, migrated, etc., it may not affect other servers, or it may only affect a few servers related to the server. At this time, there is no need to make unified arrangements for all servers.

For example, a game has multiple servers set up around the world. At this time, a BUG appears in the game, but the BUG only exists on the Asian server. Then, hotspot information may appear on the Asian servers deployed in Asia, but this hotspot information may not appear on servers in Europe, America, etc. At this time, you only need to adjust the Asian server.

In this embodiment, the relationship between the servers can be set in advance or according to historical circumstances.

For example, if in one or more historical events, once hot data appears in a server, there must be several servers that will appear hot data immediately afterwards. At this time, the servers that appear hot data immediately afterwards can be set as close relationships.

In contrast, servers that do not have hotspot data can be set to general relationships.

In this embodiment, further subdivision can be performed based on event information. For example, taking a certain shopping platform as an example, the shopping platform will hold a special event for Western products on a certain day. At this time, the search for keywords related to Western products (for example, the cross) will increase significantly, so that hot information may appear. However, since Western products have certain limitations (for example, for Westerners, the desire to buy Western products is relatively strong, while for Easterners, the desire to buy is not so strong), at this time, some servers mainly used to serve Westerners will appear to be under increased pressure, while servers mainly serving Easterners may not appear. At this time, the servers serving Westerners may have a close relationship, while the servers serving Easterners and the servers serving Westerners have a general relationship.

It is understandable that the above-mentioned various relationship information can be set in advance and reflected by being set as a database, so that the relationship between a server and other servers can be determined when searching for the relationship between the two. In addition, the database can be updated at any time to make the relationship between each server more accurate.

In this embodiment, when the hotspot data is the first hotspot data and the hotspot data is the thermal interface information, the hotspot data corresponding to the key to be tested belonging to the hotspot data is sent to each server as a processing instruction, so that one or more of the servers perform storage adjustment according to the obtained processing instruction, including:

Acquire relationship information between other servers and the thermal interface information according to the thermal interface information, wherein the relationship information includes a second intimate relationship and a second general relationship;

If the relationship information between the other servers and the hot interface information includes a second intimate relationship and a second general relationship, then

Generate a short-time fuse instruction, a first migration instruction, and a second migration instruction;

Sending the short-time fuse instruction to the server that transmits the first hotspot data;

Transmitting the first migration instruction to a server having a second intimate relationship with the hot interface information;

The second migration instruction is transmitted to a server whose relationship information with the hot interface information is a second general relationship.

If the hot data is hot interface information, then there is no need to consider what kind of event the event information is, because no matter what happens, frequent requests to connect to a certain interface do not need to be distinguished by events. At this time, just look up from the historical records whether a certain interface of a certain server is frequently requested, and whether the interface of other servers is also frequently requested in the historical records. If so, the two servers have a close relationship. If not, it can be a general relationship.

In this embodiment, when the hotspot data is the first hotspot data and the hotspot data is hot user information, sending a processing instruction to each server according to the hotspot data corresponding to the key to be tested belonging to the hotspot data, so that one or more of the servers perform storage adjustment according to the acquired processing instruction includes:

Acquire relationship information between other servers and the hot user information according to the hot user information, wherein the relationship information includes a third intimate relationship and a third general relationship;

If the relationship information between other servers and the hot user information includes a third intimate relationship and a third general relationship, then

Generate a short-time fuse instruction, a first migration instruction, and a second migration instruction;

Sending the short-time fuse instruction to the server that transmits the first hotspot data;

Transmitting the first migration instruction to a server having a third intimate relationship with the hot user information;

The second migration instruction is transmitted to a server whose relationship information with the hot user information is a third general relationship.

If the hot data is hot user information, then there is no need to consider what kind of event the event information is. At this time, just look for historical records to find out whether other servers have been visited or operated by a user when a certain server has been visited or operated by the user. If so, the two servers have a close relationship, if not, they have a general relationship.

In this embodiment, when the hotspot data is the second hotspot data and the hotspot data is the hotspot information, sending a processing instruction to each server according to the hotspot data corresponding to the key to be tested belonging to the hotspot data, so that one or more of the servers perform storage adjustment according to the acquired processing instruction includes:

Generate a short-time fuse instruction and a first migration instruction;

Sending the short-time fuse instruction to the server that transmits the second hotspot data;

The first migration instruction is transmitted to other servers.

If hotspot information appears on multiple servers, it means that these servers have a close relationship (that is, they will be under pressure later). At this time, the short-term fuse instruction is sent to the server that transmits the second hotspot data.

In this embodiment, the first migration instruction includes:

storing at least a portion of cache data in the first-level cache into the second-level cache;

The second migration instruction includes:

At least part of the cached data in the secondary cache is migrated to the data pool.

In this embodiment, the first-level cache uses a memory-type cache; the second-level cache uses a document-type database for storage.

The reason why the present application sets up a first-level cache and a second-level cache, and uses them in different relationships (close relationships, general relationships), is that, by storing part of the cache data in the first-level cache into the second-level cache, and modifying the value of the said part of the cache data in the first-level cache to the key value of the said part of the cache data in the second-level cache, the technical problem of performance degradation caused by the cache degradation strategy under large data volume and long-term requirements in the prior art is solved. The present application layers the cache, with the memory cache as the first-level cache and the document cache as the second-level cache. At the same time, the computing resources of the first-level cache and the second-level cache are separated. Hitting the first-level cache is only retrieved in the memory cache, and hitting the second-level cache is mainly calculated in the document cache, avoiding intensive calculations on the same node.

In particular, the present application sets the relationship as a close relationship and a general relationship, believing that if it is a close relationship, then if hot information appears on one of the servers in the close relationship, it is very likely that other servers in the close relationship will also have hot information, which will cause these servers to be under pressure for a period of time in the future, and thus data migration is required to prevent the sudden influx of large amounts of data from paralyzing the server.

If the relationship is a general server, it means that the pressure state may not appear in a short time. At this time, no special operation is actually required. However, since some servers have already had hot data, it is uncertain whether these general servers may appear in the future. In this case, the cached data in the second-level cache is first migrated to the data pool to free up the second-level cache. In this way, once the pressure increases, it can prevent the second-level cache from being insufficient and unable to migrate data for the first-level cache.

In this embodiment, the data pool may be composed of Shingled Magnetic Recording (SMR) disks, so as to increase the storage capacity of the distributed storage system with the same number of storage nodes and reduce the latency of the cache pool.

In this embodiment, the capacity of the secondary cache and the data pool is monitored in real time. Once the secondary cache reaches a storage upper limit or a threshold, part of the data in the secondary cache is put into the data pool regardless of whether hot data appears.

In this embodiment, when the data pool reaches an upper limit or a threshold, space can be made by deleting data.

The present application also provides a distributed cache hotspot data processing device, which includes a key acquisition module to be tested, a hotspot data judgment module, an event information acquisition module and a processing module, wherein:

The key acquisition module to be tested is used to obtain the key to be tested uploaded by each server;

The hot data judgment module is used to judge whether the key to be tested uploaded by each server is hot data;

The event information acquisition module is used to obtain the event information corresponding to the key to be tested belonging to the hot data when the hot data judgment module judges that it is yes;

The processing module is used to send processing instructions to each server according to the event information or hot data corresponding to the key to be tested belonging to the hot data, so that one or more of the servers perform storage adjustment according to the obtained processing instructions.

It should be noted that the above explanations of the method embodiment are also applicable to the device of this embodiment and will not be repeated here.

The present application also provides an electronic device, including a memory, a processor, and a computer program stored in the memory and capable of running on the processor. When the processor executes the computer program, the above-mentioned distributed cache hotspot data processing method is implemented.

The present application also provides a computer-readable storage medium, which stores a computer program. When the computer program is executed by a processor, it can implement the above distributed cache hotspot data processing method.

FIG. 2 is an exemplary structural diagram of an electronic device capable of implementing the distributed cache hotspot data processing method provided according to an embodiment of the present application.

As shown in FIG2 , the electronic device includes an input device 501, an input interface 502, a central processing unit 503, a memory 504, an output interface 505, and an output device 506. The input interface 502, the central processing unit 503, the memory 504, and the output interface 505 are interconnected through a bus 507, and the input device 501 and the output device 506 are connected to the bus 507 through the input interface 502 and the output interface 505, respectively, and then connected to other components of the electronic device. Specifically, the input device 501 receives input information from the outside, and transmits the input information to the central processing unit 503 through the input interface 502; the central processing unit 503 processes the input information based on the computer executable instructions stored in the memory 504 to generate output information, temporarily or permanently stores the output information in the memory 504, and then transmits the output information to the output device 506 through the output interface 505; the output device 506 outputs the output information to the outside of the electronic device for use by the user.

That is to say, the electronic device shown in Figure 2 can also be implemented to include: a memory storing computer executable instructions; and one or more processors, which can implement the distributed cache hotspot data processing method described in combination with Figure 1 when executing the computer executable instructions.

In one embodiment, the electronic device shown in Figure 2 can be implemented to include: a memory 504, configured to store executable program code; one or more processors, configured to run the executable program code stored in the memory 504 to execute the distributed cache hotspot data processing method in the above embodiment.

In a typical configuration, a computing device includes one or more processors (CPU), input/output interfaces, network interfaces, and memory.

The memory may include non-permanent storage in a computer-readable medium, random access memory (RAM) and/or non-volatile memory in the form of read-only memory (ROM) or flash RAM. The memory is an example of a computer-readable medium.

Computer readable media include permanent and non-permanent, removable and non-removable, and the media can be implemented by any method or technology to store information. The information can be computer readable instructions, data structures, program modules or other data. Examples of computer storage media include, but are not limited to, phase change memory (PRAM), static random access memory (SRAM), dynamic random access memory (DRAM), other types of random access memory (RAM), read-only memory (ROM), electrically erasable programmable read-only memory (EEPROM), flash memory or other memory technology, read-only compact disk read-only memory (CD-ROM), data versatile disk (DVD) or other optical storage, magnetic cassettes, magnetic tape disk storage or other magnetic storage devices or any other non-transmission media that can be used to store information that can be accessed by a computing device.

The flow chart and block diagram in the accompanying drawings illustrate the possible architecture, function and operation of the system, method and computer program product according to various embodiments of the present application. In this regard, each square box in the flow chart or block diagram can represent a module, a program segment or a part of a code, and a module, a program segment or a part of a code includes one or more executable instructions for realizing the specified logical function. It should also be noted that in some implementations as replacements, the functions marked in the square box can also occur in a sequence different from that marked in the accompanying drawings. For example, two square boxes identified in succession can actually be executed substantially in parallel, and they can sometimes be executed in the opposite order, depending on the functions involved. It should also be noted that each square box in the block diagram and/or flow chart, and the combination of the square boxes in the block diagram and/or the overall flow chart can be implemented with a dedicated hardware-based system that performs the specified function or operation, or can be implemented with a combination of dedicated hardware and computer instructions.

The processor referred to in this embodiment may be a central processing unit (CPU), or other general-purpose processors, digital signal processors (DSP), application-specific integrated circuits (ASIC), field-programmable gate arrays (FPGA) or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components, etc. A general-purpose processor may be a microprocessor or the processor may be any conventional processor, etc.

The memory can be used to store computer programs and/or modules. The processor realizes various functions of the device/terminal equipment by running or executing the computer programs and/or modules stored in the memory and calling the data stored in the memory. The memory can mainly include a program storage area and a data storage area, wherein the program storage area can store an operating system, an application required for at least one function (such as a sound playback function, an image playback function, etc.), etc.; the data storage area can store data created according to the use of the mobile phone (such as audio data, a phone book, etc.), etc. In addition, the memory can include a high-speed random access memory, and can also include a non-volatile memory, such as a hard disk, a memory, a plug-in hard disk, a smart memory card (Smart Media Card, SMC), a secure digital (Secure Digital, SD) card, a flash card (Flash Card), at least one disk storage device, a flash memory device, or other volatile solid-state storage devices.

In this embodiment, if the module/unit integrated in the device/terminal equipment is implemented in the form of a software functional unit and sold or used as an independent product, it can be stored in a computer-readable storage medium. Based on this understanding, the present invention implements all or part of the processes in the above-mentioned embodiment method, and can also be completed by instructing the relevant hardware through a computer program. The computer program can be stored in a computer-readable storage medium, and the computer program can implement the steps of the above-mentioned various method embodiments when executed by the processor. Among them, the computer program includes computer program code, and the computer program code can be in source code form, object code form, executable file or some intermediate form. The computer-readable medium may include: any entity or device that can carry computer program code, recording medium, U disk, mobile hard disk, disk, optical disk, computer memory, read-only memory (ROM, Read-Only Memory), random access memory (RAM, Random Access Memory), electric carrier signal, telecommunication signal and software distribution medium. It should be noted that the content contained in the computer-readable medium can be appropriately increased or decreased according to the requirements of legislation and patent practice in the jurisdiction. Although the present application is disclosed as above in terms of a preferred embodiment, it is not intended to limit the present application. Any person skilled in the art may make possible changes and modifications without departing from the spirit and scope of the present application. Therefore, the scope of protection of the present application shall be based on the scope defined by the claims of the present application.

Those skilled in the art will appreciate that the embodiments of the present application may be provided as methods, systems or computer program products. Therefore, the present application may adopt the form of a complete hardware embodiment, a complete software embodiment or an embodiment in combination with software and hardware. Moreover, the present application may adopt the form of a computer program product implemented on one or more computer-usable storage media (including but not limited to disk storage, CD-ROM, optical storage, etc.) that contain computer-usable program code.

In addition, it is obvious that the word "comprising" does not exclude other units or steps. Multiple units, modules or devices stated in the device claims can also be implemented by one unit or the overall device through software or hardware.

Although the present invention has been described in detail above with general descriptions and specific embodiments, it is obvious to those skilled in the art that some modifications or improvements may be made thereto based on the present invention. Therefore, these modifications or improvements made without departing from the spirit of the present invention all fall within the scope of protection claimed by the present invention.

Claims (10)

1. The distributed cache hot spot data processing method is characterized by comprising the following steps of:

obtaining to-be-detected keys uploaded by each server;

Judging whether the key to be tested uploaded by each server is hot spot data or not, if so, then

Acquiring event information corresponding to a key to be detected belonging to hot spot data;

and sending processing instructions to each server according to event information or hot spot data corresponding to the to-be-detected key belonging to the hot spot data, so that one or more of the servers can be stored and adjusted according to the acquired processing instructions.

2. The method for processing distributed cache hot spot data according to claim 1, wherein the determining whether the key to be tested uploaded by the server is hot spot data comprises:

judging whether the number of the same to-be-detected keys uploaded by any one server exceeds a first preset threshold value in a preset time period, if so, judging that the to-be-detected keys are first hot spot data;

the step of judging whether the key to be detected uploaded by the server is hot spot data comprises the following steps:

Judging whether the number of the same to-be-detected keys uploaded by any plurality of servers exceeds a second preset threshold value in a preset time period, and if so, judging that the to-be-detected keys are second hot spot data.

3. The method for processing distributed cache hot spot data according to claim 2, wherein the obtaining event information corresponding to the key to be detected includes:

Acquiring a corresponding association relation database, wherein the corresponding association relation database comprises at least one preset key to be detected and event information corresponding to each preset key to be detected;

and acquiring event information corresponding to the preset to-be-detected key which is the same as the to-be-detected key belonging to the hot spot data.

4. The digital intelligent wind farm fan abnormal current monitoring method of claim 3, wherein the hot spot data comprises hot spot information, hot user information and hot interface information;

When the hotspot data is first hotspot data and the hotspot data is hotspot information, the processing instructions are sent to each server according to event information corresponding to the to-be-detected key belonging to the hotspot data, so that one or more of the servers can store and adjust according to the acquired processing instructions, and the method comprises the following steps:

Acquiring relation information between the server for transmitting the first hot spot data and other servers according to the event information, wherein the relation information comprises a first intimate relation and a first general relation;

If the relationship information between the server acquiring the first hot spot data and the other servers respectively comprises an intimate relationship and a general relationship, then

Generating a short-time fusing instruction, a first migration instruction and a second migration instruction;

the short-time fusing instruction is sent to a server for transmitting the acquired first hot spot data;

transmitting the first migration instruction to a server which has a first affinity relationship with the acquired server of the first hot spot data;

and transmitting the second migration instruction to a server which has a first general relation with the acquired server of the first hot spot data.

5. The method of claim 4, wherein when the hotspot data is first hotspot data and the hotspot data is thermal interface information, the sending a processing instruction to each server according to the hotspot data corresponding to the to-be-detected key belonging to the hotspot data, so that one or more of the servers performs storage adjustment according to the acquired processing instruction includes:

Acquiring relationship information between other servers and the thermal interface information according to the thermal interface information, wherein the relationship information comprises a second intimate relationship and a second general relationship;

If the relationship information between the other server and the hot interface information comprises a second intimate relationship and a second general relationship, then

Generating a short-time fusing instruction, a first migration instruction and a second migration instruction;

the short-time fusing instruction is sent to a server for transmitting the acquired first hot spot data;

transmitting the first migration instruction to a server which has the relationship information between the first migration instruction and the hot interface information as a second affinity;

and transmitting the second migration instruction to a server which has the relationship information between the second migration instruction and the hot interface information as a second general relationship.

6. The method of claim 5, wherein when the hotspot data is first hotspot data and the hotspot data is hot user information, the sending a processing instruction to each server according to the hotspot data corresponding to the to-be-detected key belonging to the hotspot data, so that one or more of the servers performs storage adjustment according to the acquired processing instruction includes:

acquiring relationship information between other servers and the hot user information according to the hot user information, wherein the relationship information comprises a third intimate relationship and a third general relationship;

If the relationship information between the other servers and the hot user information comprises a third intimate relationship and a third general relationship, then

Generating a short-time fusing instruction, a first migration instruction and a second migration instruction;

the short-time fusing instruction is sent to a server for transmitting the acquired first hot spot data;

transmitting the first migration instruction to a server with the relation information between the first migration instruction and the hot user information being a third close relation;

and transmitting the second migration instruction to a server which has third general relation with relation information between the hot user information.

7. The method of claim 6, wherein when the hotspot data is second hotspot data and the hotspot data is hotspot information, the sending a processing instruction to each server according to the hotspot data corresponding to the to-be-detected key belonging to the hotspot data, so that one or more of the servers performs storage adjustment according to the acquired processing instruction includes:

generating a short-time fusing instruction and a first migration instruction;

Sending the short-time fusing instruction to a server for transmitting the acquired second hot spot data;

and transmitting the first migration instruction to other servers.

8. The distributed cache hot spot data processing method of claim 7, wherein the first migration instruction comprises:

storing at least part of cache data in the first-level cache into the second-level cache;

The second migration instruction includes:

and migrating at least part of the cache data in the secondary cache to a data pool.

9. The method for processing distributed cache hot spot data according to claim 8, wherein the first level cache uses a memory type cache;

the secondary cache is stored using a document database.

10. A distributed cache hot spot data processing apparatus, the distributed cache hot spot data processing apparatus comprising:

the to-be-detected key acquisition module is used for acquiring to-be-detected keys uploaded by each server;

the hot spot data judging module is used for judging whether the to-be-detected key uploaded by each server is hot spot data or not;

the event information acquisition module is used for acquiring event information corresponding to the key to be detected belonging to the hot spot data when the hot spot data judgment module judges that the hot spot data judgment module is yes;

And the processing module is used for sending processing instructions to each server according to event information or hot spot data corresponding to the to-be-detected key belonging to the hot spot data, so that one or more of the servers can be stored and adjusted according to the acquired processing instructions.