CN114445220A - Transaction data clearing method and device, database server and storage medium - Google Patents

Abstract

The present application discloses a method, device, database server and storage medium for sorting transaction data. The method includes using multiple clearing periods to clear the transaction data in a transaction batch; wherein, in each clearing period, determine the transaction data to be cleared corresponding to the transaction batch in the transaction database; In a plurality of clearing execution periods within the clearing and clearing period, the transaction data to be cleared is cleared respectively, wherein the amount of cleared transaction data in each clearing execution period is not greater than a first threshold. The technical solution processes the transaction data to be cleared in a transaction batch using multiple clearing periods instead of a single clearing period, and limits the upper limit of the transaction data that can be cleared in each clearing execution period, thereby avoiding clearing The amount of transaction data cleared during the sub-execution period is too high, and there is no need to set up a separate clearing database outside the transaction database, which saves hardware costs and reduces the delay of database master-standby synchronization.

Description

Transaction data sorting method, device, database server and storage medium

technical field

The present application relates to the field of computer technology, and in particular, to a method, device, database server and storage medium for sorting transaction data.

Background technique

Clearing is the data preparation stage of clearing, which mainly refers to all the transaction data of the day according to each member bank's current, other, credit, debit, number of transactions, amount, net balance, etc. Summarize, organize, and categorize.

At present, there is a technical problem that the instantaneous TPS (Transaction Per Second, the amount of transaction data processed per second) of the database is too high during the sorting process, which needs to be solved urgently.

SUMMARY OF THE INVENTION

The embodiments of the present application provide a method, device, database server, and storage medium for sorting transaction data, so as to avoid the problem that the instantaneous TPS of the transaction database is too high.

The embodiment of the present application adopts the following technical solutions:

In a first aspect, an embodiment of the present application provides a method for sorting transaction data, which is executed by a database server and includes: sorting the transaction data in a transaction batch by using a plurality of clearing periods; wherein, in each clearing period , determine the transaction data to be cleared corresponding to the transaction batch in the transaction database; use multiple clearing execution periods in the clearing period to clear the transaction data to be cleared respectively, wherein each The amount of transaction data cleared during the clearing execution period is not greater than the first threshold.

Optionally, the determining the transaction data to be cleared corresponding to the transaction batch in the transaction database includes: querying the transaction time from the transaction database according to the transaction time condition corresponding to the transaction batch. The transaction data that matches the transaction time conditions, is in the final state of the transaction and has not been cleared, is used as the transaction data to be cleared corresponding to the transaction batch.

Optionally, the transaction data whose transaction time matches the transaction time conditions, is in the final state of the transaction and has not been cleared, is queried from the transaction database, and the transaction data to be cleared includes: the transaction data according to the transaction data. The status flag determines the transaction data in the final state of the transaction, and determines the transaction data that has not been cleared according to the clearing flag of the transaction data.

Optionally, using a plurality of clearing execution periods within the clearing period to respectively clear the transaction data to be cleared includes: during the clearing execution period, clearing the transaction data to be cleared one by one. , and accumulate the transaction data volume cleared during this clearing execution period; when the accumulated transaction data volume reaches the first threshold, or all the transaction data to be cleared have been cleared, the clearing execution period will be terminated clearing.

Optionally, the method further includes: determining, in batches, the clearing identifiers of the transaction data that have been cleared during the clearing execution period.

Optionally, the determining in batches the clearing identifiers of the transaction data that have been cleared includes: accumulating the amount of transaction data for which clearing has been completed but the clearing identifier has not been determined, and when the accumulated transaction data amount reaches the second threshold. In the case of , the clearing identifier is determined in batches for the transaction data that has been cleared but the clearing identifier has not been determined, and after the clearing identifier is determined, the accumulated transaction data volume is cleared to zero.

Optionally, the maximum executable duration of each clearing execution period is the same, and the clearing of the transaction data to be cleared by using a plurality of clearing execution periods in the clearing period includes: During the execution period, use the clearing thread to clear the transaction data to be cleared, and count the total time of clearing; if the total time is less than the maximum executable time The duration determines the sleep duration, so that the clearing thread sleeps according to the sleep duration.

Optionally, the total duration of multiple clearing execution periods in a single clearing period is not greater than the third threshold.

Optionally, the method further includes: receiving a first clearing task, the first clearing task corresponding to the transaction batch; the first execution time of the first clearing task is based on the transaction batch The first clearing period of the transaction batch is opened according to the first execution time of the first clearing task, and the first clearing period is executed in each clearing period. Divide tasks to implement clearing steps using multiple clearing periods.

Optionally, the method further includes: receiving a second clearing task, the second clearing task corresponds to the transaction batch, and the execution time of the second clearing task is based on the transaction batch The starting transaction time and the second delay time are determined; according to the execution time of the second clearing task, the second clearing task is executed, and all the transaction data of the transaction batch that have not been cleared are cleared. point.

In a second aspect, an embodiment of the present application further provides an apparatus for sorting transaction data, which is used to implement the method for sorting transaction data as described above.

In a third aspect, embodiments of the present application further provide a database server, including: a processor; and a memory arranged to store computer-executable instructions, the executable instructions, when executed, cause the processor to execute any of the transactions described above Data sorting method.

In a fourth aspect, embodiments of the present application further provide a computer-readable storage medium, where the computer-readable storage medium stores one or more programs, and the one or more programs, when executed by a database server including multiple application programs, make the database The server executes the clearing method of transaction data as described in any of the above.

The above-mentioned at least one technical solution adopted in the embodiments of the present application can achieve the following beneficial effects: the transaction data to be cleared in a transaction batch is processed using multiple clearing periods instead of a single clearing period, and the execution of each clearing is limited. The upper limit of the transaction data volume that can be cleared during the period, thus avoiding the excessive transaction data volume cleared during the clearing execution period, and it is not necessary to set up a clearing database separately from the transaction database, which saves hardware costs, and also makes the database The latency of master-slave synchronization has been reduced.

Description of drawings

The drawings described herein are used to provide further understanding of the present application and constitute a part of the present application. The schematic embodiments and descriptions of the present application are used to explain the present application and do not constitute an improper limitation of the present application. In the attached image:

FIG. 1 shows a schematic flowchart of a transaction clearing method according to an embodiment of the present application;

Figure 2 shows a schematic diagram of a clearing TPS in the prior art utilizing a single clearing period for centralized clearing;

FIG. 3 shows a schematic diagram of a clearing TPS for clearing by using multiple clearing periods according to an embodiment of the present application;

FIG. 4 shows a schematic structural diagram of a transaction sorting device according to an embodiment of the present application;

FIG. 5 shows a schematic structural diagram of a database server in an embodiment of the present application.

Detailed ways

In order to make the objectives, technical solutions and advantages of the present application clearer, the technical solutions of the present application will be clearly and completely described below with reference to the specific embodiments of the present application and the corresponding drawings. Obviously, the described embodiments are only a part of the embodiments of the present application, but not all of the embodiments. Based on the embodiments in the present application, all other embodiments obtained by those of ordinary skill in the art without creative efforts shall fall within the protection scope of the present application.

In order to solve the problem raised in the background section, an implementation manner is to solve the problem by adding hardware resources. Specifically, in addition to saving the transaction data in the transaction database, a separate clearing database is also added for storage, so that even if the TPS of the clearing database is too high, it will not affect the normal use of the transaction database, which is acceptable. way of doing.

However, this undoubtedly greatly increases the hardware cost, because in order to ensure the security of the data, the database usually has a master-standby architecture, that is, a database has multiple standby databases for synchronous backup, and these standby databases may also be set in different cities. To achieve remote disaster recovery.

Through analysis, it is found that the TPS of the database caused by the clearing of transaction data is too high, mainly because the clearing is usually completed in a short period of time to avoid excessive utilization of the database, for example, transactions from 9:00 to 10:00 The data (subject to the transaction time) is usually sorted within a short time after 10:20 (for example, 3 minutes). The clearing of transaction data for the unit is well organized. On the other hand, due to the characteristics of online transactions, if the transaction is unsuccessful, it needs to be processed such as reversal, and the clearing cannot be performed immediately after the transaction data is generated.

In addition, due to the above reasons, the amount of data to be synchronized in the database is too large, so that during the sorting process, the delay of the database synchronization is relatively high, which affects the stability.

In this regard, the technical idea of the present application is to avoid using a centralized time period to process the clearing of transaction data in a transaction batch, but to use multiple time slices to realize the transaction data into zero. , to realize the peak-shaving and valley-filling of database utilization. At the same time, since the amount of data that needs to be cleared in each time shard is usually not a lot, it is possible to set an upper limit on the amount of cleared transaction data to avoid excessive occupation of the transaction database.

The technical solutions provided by the embodiments of the present application will be described in detail below with reference to the accompanying drawings.

FIG. 1 shows a schematic flowchart of a transaction sorting method according to an embodiment of the present application. The method may be executed by a database server, and the database server may be a database server of a transaction database. on the other hand. Due to the large amount of transaction data, it may be difficult for a single transaction database to handle high concurrency. In practice, multiple IDCs (Internet Data Center, Internet Data Center) are often used, and several transaction databases are deployed in each IDC. The database server of the applied transaction sorting method may be a database server of a transaction database in an IDC.

The transaction data sorting method in the embodiment of the present application may use multiple clearing periods to clear the transaction data in a transaction batch, and the clearing of the transaction data in each clearing period can refer to the process shown in FIG. 1 . to fulfill. Each clearing period can be understood as a time slicing, that is, not all transaction data in a transaction batch are centrally cleared in a short period of time.

Transaction batches can be divided according to transaction time. For example, the transaction data generated between 8:00 and 9:00 is 09 batches. In other embodiments, transaction batches may also be divided according to transaction serial numbers and the like.

As shown in Figure 1, the clearing method of transaction data executed during the clearing period includes:

Step S110: Determine the transaction data to be sorted corresponding to the transaction batch in the transaction database.

It can be seen here that the technical solution of the present application directly determines the transaction data to be sorted in the transaction database, and does not need to set up a separate sorting database, which realizes the multiplexing of the transaction database, thereby saving hardware costs and operation and maintenance. cost.

Step S120 , clearing the transaction data to be cleared separately by using a plurality of clearing execution periods in the clearing period, wherein the amount of transaction data cleared in each clearing execution period is not greater than a first threshold.

In the clearing period, multiple clearing execution periods are used to limit the clearable transaction data in each time slice through the preset first threshold, which avoids excessive use of the transaction database and ensures that the transaction data can be sorted out in a timely manner. Because of this, the amount of data that needs to be synchronized each time is not much, thus improving the problem of synchronization delay.

It should be noted that the clearing strategy here can be implemented according to business needs, such as summarizing, classifying, etc., as long as the transaction content recorded in the transaction data can support the clearing strategy.

The clearing execution period, the clearing period duration, and the first threshold can be set as required. For example, the clearing execution period is set to 1 second, the clearing period is set to 5 minutes, and the first threshold is set to 5200 entries.

It can be seen that the method shown in Figure 1 uses multiple clearing periods instead of a single clearing period to process the transaction data to be cleared in a transaction batch, and limits the amount of transaction data that can be cleared in each clearing execution period The upper limit, which avoids the excessive transaction data volume cleared during the clearing execution period, and does not require a separate clearing database outside the transaction database, which saves hardware costs and reduces the delay of database master/standby synchronization. .

In an embodiment of the present application, in the above method, determining the pending transaction data corresponding to the transaction batch in the transaction database includes: querying the transaction database from the transaction database according to the transaction time condition corresponding to the transaction batch The transaction data whose time matches the transaction time conditions, is in the final state of the transaction and has not been cleared, is regarded as the pending transaction data corresponding to the transaction batch.

After the transaction is officially completed, the transaction data will be in the final state of the transaction, and the transaction content will not be changed. It takes a certain amount of time from the generation of transaction data to the final transaction state. In order to ensure the correctness of the clearing, the transaction time conditions corresponding to the transaction batches can be used to limit. For example, if the current time is 8:25, then Only the transaction data of batch 09 before 8:05 is allowed to be cleared.

In an embodiment of the present application, in the above method, the transaction data whose transaction time matches the transaction time conditions, is in the final state of the transaction and has not been cleared is queried from the transaction database, and the transaction data to be cleared includes: according to the transaction The transaction status identifier of the data determines the transaction data in the final transaction state, and the transaction data that has not been cleared is determined according to the clearing identifier of the transaction data.

According to transaction time conditions, clearing identifiers and transaction status identifiers, corresponding database operation statements can be generated to set data routing, thereby determining which transaction data needs to be cleared.

In an embodiment of the present application, in the above method, using a plurality of clearing execution periods in the clearing period, respectively clearing the transaction data to be cleared includes: in the clearing execution period, performing the clearing process one by one for the transaction data to be cleared. Clear and accumulate the transaction data volume that has been cleared during the execution period of this clearing; when the accumulated transaction data volume reaches the first threshold, or all the transaction data to be cleared have been cleared, the clearing will be terminated. Execution period clearing.

Specifically, multiple clearing execution periods can share a variable that counts the amount of transaction data cleared during the clearing execution period. Statistics of the clearing execution period.

In an embodiment of the present application, the above method further includes: during the clearing execution period, determining the clearing identifiers of the transaction data that have been cleared in batches.

After the transaction data is cleared, in order to avoid repeated clearing, it is necessary to mark the cleared transaction data, that is, mark it as cleared. In the prior art, marking is often performed while sorting, which is also one of the reasons for the high TPS. Therefore, the present application further proposes to separate the marking and the clearing, and to mark the cleared transaction data in stages or in batches. For example, after clearing 100 pieces of transaction data, the 100 pieces of transaction data are marked, and the sorting and marking of the 100 pieces of transaction data are regarded as a database transaction as a whole. It has been verified that this processing method can reduce the TPS of the database while ensuring the sorting efficiency.

In some embodiments, if there are multiple transaction databases, the clearing results of these transaction databases need to be aggregated. Therefore, the corresponding clearing results can also be reported during marking, so that the table-level clearing results can be summarized in sequence For library level, IDC level and transaction batch level, etc.

In terms of specific implementation, in an embodiment of the present application, in the above method, determining the clearing identifier of the transaction data that has been cleared in batches includes: accumulating the amount of transaction data for which clearing has been completed but the clearing identifier has not been determined. , when the accumulated transaction data volume reaches the second threshold, determine the clearing mark for the transaction data that has been cleared but the clearing mark has not yet been determined, and after the clearing mark is determined, clear the accumulated transaction data volume. zero.

In an embodiment of the present application, in the above method, the maximum executable duration of each clearing execution period is the same, and using multiple clearing execution periods in the clearing period to clear the transaction data to be cleared separately includes: During the execution period, the clearing thread is used to clear the transaction data to be cleared, and the total time of clearing is counted; if the total time is less than the maximum executable time, the sleep time is determined according to the total time and the maximum execution time, so that the clearing The thread sleeps according to the sleep duration.

The clearing of the present application may be performed by using a clearing thread. Specifically, a transaction database may use a clearing thread, and the clearing thread will perform a clearing process on transaction data in multiple clearing execution periods in one clearing period. Clearing, in order to take into account the robustness and the utilization of computing resources, the following settings can be made, that is, the time required to clear the transaction data of the first threshold amount is less than the maximum executable duration of the clearing execution period, for example, clearing execution The maximum executable duration of the transaction period is 1 second, but in fact, the time to clear 5,200 transaction data generally does not exceed 500 milliseconds, which can ensure stable clearing even if the database fluctuates. It may cause a waste of computing resources, so the clearing thread can be put to sleep. The sleep duration can be determined according to the above method, and details are not described herein again.

In an embodiment of the present application, in the above method, the total duration of multiple clearing execution periods in a single clearing period is not greater than a third threshold.

For example, if the clearing period is 5 minutes, and the total duration of multiple clearing execution periods in the clearing period is limited to 4 minutes, the following situations can be avoided: the clearing period should start at 9:25 and 9:30 End, the next clearing period starts at 9:30, and due to some faults, this clearing period does not start until 9:25:30, so that it can still be guaranteed that the current clearing period can still achieve the original plan before the next clearing period starts. target, with strong robustness. The setting of the third threshold can be determined according to actual requirements.

In an embodiment of the present application, the above method further includes: receiving a first clearing task, where the first clearing task corresponds to a transaction batch; the first execution time of the first clearing task is based on the start of the transaction batch The transaction time and the first delay time are determined; according to the first execution time of the first clearing task, the first clearing period of the transaction batch is opened, and the first clearing task is executed in each clearing period, so as to realize the utilization of multiple The steps for clearing a clearing period.

Specifically, the first sorting task can be generated and issued by the sorting server, and the database server is responsible for executing it. Taking 8:00 to 9:00 as a transaction batch as an example, if the first delay time is 25 minutes, and each clearing period is 5 minutes, the first clearing period will be opened at 8:25, and the first clearing period will be opened at 8:30. The second clearing period... In other words, the first clearing task is a timed task that is executed every 5 minutes.

In scenarios such as using multiple IDCs to deploy transaction databases and each IDC deploying multiple transaction databases, the first sorting task may be obtained by splitting the total sorting task one or more times. For example, the general clearing task can be configured or triggered by the operation and maintenance interface of the clearing server. The clearing server determines the transaction database used for clearing according to the general clearing task, and further divides the general clearing task into IDC-level sub-tasks accordingly. Sort tasks and send them to the corresponding IDC, where the IDC is further divided into the first sorting task at the database level. During execution, the method in the foregoing embodiment may be referred to to query and acquire the transaction data in the data table, and perform subsequent clearing.

In some embodiments, the first clearing task is performed in the clearing period of 5 minutes as follows: query the transaction data to be cleared, and each transaction database uses a clearing thread to perform one by one on the queried transaction data. Clearing, the clearing of every 100 transaction data is regarded as a database transaction.

Within 1 second (the maximum executable duration of the clearing execution period), the accumulated clearing transaction data volume will stop clearing if it reaches clearing TPS (the first threshold) or if there is no transaction data to clear. If the unmarked transaction data reaches the second threshold, the clearing result will be reported and marked, and so on. When the accumulated clearing transaction data reaches the first threshold, the clearing will be stopped, and the clearing can be Mark the finished but unmarked, then count the execution time, calculate the sleep time, and let the sorting thread go to sleep.

If a total of 4 minutes have been executed during the clearing period, then the clearing will be stopped, and you can continue to mark all those that have been cleared but not marked, and then end the work in the clearing period.

In an embodiment of the present application, the above method further includes: receiving a second clearing task, the second clearing task corresponds to the transaction batch, and the execution time of the second clearing task is based on the initial transaction time of the transaction batch and the The second delay time is determined; according to the execution time of the second clearing task, the second clearing task is executed, and all the transaction data of the transaction batch that have not been cleared are cleared.

The purpose of the second clearing task is to avoid abnormal execution of the first clearing task or excessive transaction data. Generally speaking, the transaction data that needs to be cleared in the second clearing task will be very small, and ideally it may not be There is data that needs to be sorted out.

Fig. 2 shows a schematic diagram of a clearing TPS in the prior art that utilizes a single clearing period for centralized clearing, and Fig. 3 shows a schematic diagram of a clearing TPS for clearing with multiple clearing periods according to an embodiment of the present application, The dark gray blocks represent the cleared transaction data volume. It can be seen that the first sorting task is executed from 8:25 to 9:20, the second sorting task is executed from 9:20 to 9:23, and the second sorting task The amount of transaction data is very small in comparison.

Since the second sorting task is mainly to deal with the bottom line, it is not necessary to set a threshold for TPS control.

The present application also provides an apparatus for sorting transaction data, which is used to implement the method for sorting transaction data as described above.

Specifically, FIG. 4 shows a schematic structural diagram of an apparatus for sorting transaction data according to an embodiment of the present application. The apparatus 400 for sorting transaction data can use multiple sorting periods to sort the transaction data in a transaction batch. . As shown in Figure 4, the transaction data sorting device 400 includes:

The determining unit 410 is configured to determine, in each clearing period, the transaction data to be cleared corresponding to the transaction batches in the transaction database.

The clearing execution unit 420 is configured to, in each clearing period, use a plurality of clearing execution periods in the clearing period to clear the transaction data to be cleared respectively, wherein, in each clearing execution period, clearing The amount of transaction data is not greater than the first threshold.

In an embodiment of the present application, in the above device, the clearing execution unit 420 is configured to query the transaction database from the transaction database to find out that the transaction time matches the transaction time condition, is in the final state of the transaction and has not been completed. The cleared transaction data is used as the transaction data to be cleared.

In an embodiment of the present application, in the above-mentioned device, the clearing execution unit 420 is configured to determine the transaction data in the final state of the transaction according to the transaction status identifier of the transaction data, and determine that the clearing has not been completed according to the clearing identifier of the transaction data. transaction data.

In an embodiment of the present application, in the above method, using multiple clearing execution periods to clear the transaction data to be cleared separately includes: during the clearing execution period, clearing the transaction data to be cleared one by one, and Accumulate the amount of transaction data that has been cleared during this clearing execution period; when the accumulated transaction data volume reaches the first threshold, or all the transaction data to be cleared have been cleared, the clearing of this clearing execution period will be terminated. point.

In an embodiment of the present application, in the above device, the clearing execution unit 420 is further configured to determine, in batches, clearing identifiers of the transaction data that have been cleared during the clearing execution period.

In an embodiment of the present application, in the above-mentioned device, the clearing execution unit 420 is configured to accumulate the transaction data volume for which clearing has been completed but the clearing identification has not been determined. When the accumulated transaction data volume reaches the second threshold , to determine the clearing mark in batches for the transaction data that has been cleared but the clearing mark has not been determined, and after the clearing mark is determined, the accumulated transaction data volume will be reset to zero.

In an embodiment of the present application, in the above-mentioned device, the maximum executable duration of each clearing execution period is the same, and the clearing execution unit 420 is configured to use the clearing thread to perform the clearing process on the transaction data to be cleared during the clearing execution period. Clear and count the total duration of clearing; if the total duration is less than the maximum executable duration, the sleep duration is determined according to the total duration and the maximum execution duration, so that the clearing thread sleeps according to the sleep duration.

In an embodiment of the present application, in the above device, the total duration of multiple clearing execution periods in a single clearing period is not greater than a third threshold.

In an embodiment of the present application, in the above device, the determining unit 410 is configured to receive a first clearing task, the first clearing task corresponds to a transaction batch; the first execution time of the first clearing task is based on the transaction The initial transaction time of the batch and the first delay time are determined; the first clearing period of the transaction batch is opened according to the first execution time of the first clearing task, and the first clearing task is executed in each clearing period. , in order to realize the steps of clearing using multiple clearing periods.

In an embodiment of the present application, in the above device, the determining unit 410 is further configured to receive a second clearing task, the second clearing task corresponds to a transaction batch, and the execution time of the second clearing task is based on the transaction batch The initial transaction time and the second delay time are determined; the clearing execution unit 420 is further configured to execute the second clearing task according to the execution time of the second clearing task. Transaction data is sorted.

It can be understood that the above-mentioned device for sorting transaction data can implement each step of the method for sorting transaction data provided by the database server and executed by the database server, and the relevant explanations about the sorting method for transaction data are applicable to The sorting device is not repeated here.

FIG. 5 is a schematic structural diagram of a database server according to an embodiment of the present application. Referring to FIG. 5 , at the hardware level, the database server includes a processor, and optionally an internal bus, a network interface, and a memory. The memory may include memory, such as high-speed random-access memory (Random-Access Memory, RAM), or may also include non-volatile memory (non-volatile memory), such as at least one disk memory. Of course, the database server may also include hardware required by other services.

The processor, the network interface, and the memory can be connected to each other through an internal bus, which can be an ISA (Industry Standard Architecture) bus, a PCI (Peripheral Component Interconnect, peripheral component interconnect standard) bus, or an EISA (Extended Industry) bus. StandardArchitecture, extended industry standard structure) bus, etc. The bus can be divided into address bus, data bus, control bus and so on. For ease of representation, only one bidirectional arrow is shown in FIG. 5, but it does not mean that there is only one bus or one type of bus.

memory for storing programs. Specifically, the program may include program code, and the program code includes computer operation instructions. The memory may include memory and non-volatile memory and provide instructions and data to the processor.

The processor reads the corresponding computer program from the non-volatile memory into the memory and runs it, forming a sorting device for transaction data on a logical level. The processor executes the program stored in the memory, and is specifically used to perform the following operations:

Use multiple clearing periods for clearing;

In each clearing period, determine the transaction data to be cleared in the transaction database, and use multiple clearing execution periods to clear the transaction data to be cleared separately, wherein the amount of transaction data cleared in each clearing execution period is not greater than the first threshold.

The above-mentioned method executed by the apparatus for clearing transaction data disclosed in the embodiment shown in FIG. 1 of the present application may be applied to a processor, or implemented by a processor. A processor may be an integrated circuit chip with signal processing capabilities. In the implementation process, each step of the above-mentioned method can be completed by a hardware integrated logic circuit in a processor or an instruction in the form of software. The above-mentioned processor may be a general-purpose processor, including a central processing unit (CPU), a network processor (NP), etc.; it may also be a digital signal processor (Digital Signal Processor, DSP), an application-specific integrated circuit (Application Specific Integrated Circuit, ASIC), Field-Programmable Gate Array (Field-Programmable Gate Array, FPGA) or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components. The methods, steps, and logic block diagrams disclosed in the embodiments of this application can be implemented or executed. A general purpose processor may be a microprocessor or the processor may be any conventional processor or the like. The steps of the method disclosed in conjunction with the embodiments of the present application may be directly embodied as executed by a hardware decoding processor, or executed by a combination of hardware and software modules in the decoding processor. The software modules may be located in random access memory, flash memory, read-only memory, programmable read-only memory or electrically erasable programmable memory, registers and other storage media mature in the art. The storage medium is located in the memory, and the processor reads the information in the memory, and completes the steps of the above method in combination with its hardware.

The database server can also execute the method executed by the transaction data sorting apparatus in FIG. 1 , and realize the functions of the transaction data sorting apparatus in the embodiment shown in FIG.

An embodiment of the present application further provides a computer-readable storage medium, where the computer-readable storage medium stores one or more programs, and the one or more programs include instructions, and the instructions are executed by a database server including multiple application programs. , the database server can be made to execute the method executed by the device for sorting transaction data in the embodiment shown in FIG. 1 , and is specifically used to execute:

Use multiple clearing periods for clearing;

In each clearing period, determine the transaction data to be cleared in the transaction database, and use multiple clearing execution periods to clear the transaction data to be cleared separately, wherein the amount of transaction data cleared in each clearing execution period is not greater than the first threshold.

As will be appreciated by those skilled in the art, the embodiments of the present application may be provided as a method, a system, or a computer program product. Accordingly, the present application may take the form of an entirely hardware embodiment, an entirely software embodiment, or an embodiment combining software and hardware aspects. Furthermore, the present application may take the form of a computer program product embodied on one or more computer-usable storage media (including, but not limited to, disk storage, CD-ROM, optical storage, etc.) having computer-usable program code embodied therein.

The present application is described with reference to flowchart illustrations and/or block diagrams of methods, apparatus (systems), and computer program products according to embodiments of the present application. It will be understood that each flow and/or block in the flowchart illustrations and/or block diagrams, and combinations of flows and/or blocks in the flowchart illustrations and/or block diagrams, can be implemented by computer program instructions. These computer program instructions may be provided to the processor of a general purpose computer, special purpose computer, embedded processor or other programmable data processing device to produce a machine such that the instructions executed by the processor of the computer or other programmable data processing device produce Means for implementing the functions specified in a flow or flow of a flowchart and/or a block or blocks of a block diagram.

These computer program instructions may also be stored in a computer-readable memory capable of directing a computer or other programmable data processing apparatus to function in a particular manner, such that the instructions stored in the computer-readable memory result in an article of manufacture comprising instruction means, the instructions The apparatus implements the functions specified in the flow or flow of the flowcharts and/or the block or blocks of the block diagrams.

These computer program instructions can also be loaded on a computer or other programmable data processing device to cause a series of operational steps to be performed on the computer or other programmable device to produce a computer-implemented process such that The instructions provide steps for implementing the functions specified in the flow or blocks of the flowcharts and/or the block or blocks of the block diagrams.

In a typical configuration, a computing device includes one or more processors (CPUs), input/output interfaces, network interfaces, and memory.

Memory may include non-persistent memory in computer readable media, random access memory (RAM) and/or non-volatile memory in the form of, for example, read only memory (ROM) or flash memory (flash RAM). Memory is an example of a computer-readable medium.

Computer-readable media includes both persistent and non-permanent, removable and non-removable media, and storage of information may be implemented by any method or technology. Information may be computer readable instructions, data structures, modules of programs, or other data. Examples of computer storage media include, but are not limited to, phase-change memory (PRAM), static random access memory (SRAM), dynamic random access memory (DRAM), other types of random access memory (RAM), read only memory (ROM), Electrically Erasable Programmable Read Only Memory (EEPROM), Flash Memory or other memory technology, Compact Disc Read Only Memory (CD-ROM), Digital Versatile Disc (DVD) or other optical storage, Magnetic tape cassettes, magnetic tape magnetic disk storage or other magnetic storage devices or any other non-transmission medium that can be used to store information that can be accessed by a computing device. As defined herein, computer-readable media does not include transitory computer-readable media, such as modulated data signals and carrier waves.

It should also be noted that the terms "comprising", "comprising" or any other variation thereof are intended to encompass a non-exclusive inclusion such that a process, method, article or device comprising a series of elements includes not only those elements, but also Other elements not expressly listed, or which are inherent to such a process, method, article of manufacture, or apparatus are also included. Without further limitation, an element qualified by the phrase "comprising a..." does not preclude the presence of additional identical elements in the process, method, article of manufacture, or device that includes the element.

It will be appreciated by those skilled in the art that the embodiments of the present application may be provided as a method, a system or a computer program product. Accordingly, the present application may take the form of an entirely hardware embodiment, an entirely software embodiment, or an embodiment combining software and hardware aspects. Furthermore, the present application may take the form of a computer program product embodied on one or more computer-usable storage media (including, but not limited to, disk storage, CD-ROM, optical storage, etc.) having computer-usable program code embodied therein.

The above descriptions are merely examples of the present application, and are not intended to limit the present application. Various modifications and variations of this application are possible for those skilled in the art. Any modification, equivalent replacement, improvement, etc. made within the spirit and principle of this application shall be included within the scope of the claims of this application.

Claims (13)

1. A clearing method of transaction data is executed by a database server, wherein the method comprises clearing transaction data in a transaction batch by using a plurality of clearing periods;

wherein, in each of the cleaning stages,

determining to-be-cleared transaction data corresponding to the transaction batch in a transaction database;

and respectively counting the transaction data to be counted by utilizing a plurality of counting execution periods in the counting execution period, wherein the counting transaction data amount in each counting execution period is not more than a first threshold value.

2. The method of claim 1, wherein said determining outstanding transaction data in a transaction database corresponding to the transaction batch comprises:

and inquiring transaction data which is matched with the transaction time condition, is in a transaction final state and is not finished to be classified from the transaction database according to the transaction time condition corresponding to the transaction batch, and taking the transaction data as to-be-classified transaction data corresponding to the transaction batch.

3. The method as claimed in claim 2, wherein the querying transaction data of transaction time matched with the transaction time condition, in a transaction final state and incomplete clearing from the transaction database as the transaction data to be cleared comprises:

and determining the transaction data in the final transaction state according to the transaction state identification of the transaction data, and determining the transaction data of incomplete clearing according to the clearing identification of the transaction data.

4. The method of claim 1, wherein said separately accounting said transaction data to be accounted for utilizing a plurality of accounting execution periods within said accounting period comprises:

in the clearing execution period, clearing transaction data to be cleared one by one, and accumulating the cleared transaction data amount in the clearing execution period;

and terminating the clearing of the clearing execution period under the condition that the accumulated transaction data amount reaches a first threshold value or all transaction data to be cleared are cleared completely.

5. The method of claim 1, wherein the method further comprises:

and determining the counting identification of the transaction data which has finished counting in batches in the counting execution period.

6. The method of claim 5, wherein determining the tally identification of transaction data for which the tally has been completed in batches comprises:

and accumulating the transaction data volume which is subjected to clearing and is not determined with the clearing identification, determining the clearing identification for the transaction data which is subjected to clearing and is not determined with the clearing identification in batch under the condition that the accumulated transaction data volume reaches a second threshold value, and clearing the accumulated transaction data volume after the clearing identification is determined.

7. The method as claimed in claim 1, wherein the maximum executable duration of each of said liquidation executing periods is the same, and said separately liquidating said transaction data to be liquidated by using a plurality of liquidation executing periods within said liquidation period comprises:

in the clearing execution period, clearing the transaction data to be cleared by utilizing a clearing thread, and counting the total clearing time;

and if the total time length is less than the maximum executable time length, determining a sleep time length according to the total time length and the maximum executable time length, and enabling the sorting thread to sleep according to the sleep time length.

8. The method of claim 1, wherein a total duration of the plurality of clearing execution periods within a single clearing period is not greater than a third threshold.

9. The method of any one of claims 1-8, further comprising:

receiving a first clearing task, wherein the first clearing task corresponds to the transaction batch; the first execution time of the first clearing task is determined according to the initial trading time and the first delay time of the trading batch;

and starting the first clearing period of the transaction batch according to the first execution time of the first clearing task, and executing the first clearing task in each clearing period respectively so as to realize the step of clearing by utilizing a plurality of clearing periods.

10. The method of any one of claims 1-8, further comprising:

receiving a second clearing task, wherein the second clearing task corresponds to the transaction batch, and the execution time of the second clearing task is determined according to the initial transaction time and the second delay time of the transaction batch;

and executing the second clearing task according to the execution time of the second clearing task, and clearing all the unfinished clearing transaction data of the transaction batch.

11. A transaction data clearing device applied to a database server, wherein the device is used for implementing the method of any one of claims 1 to 10.

12. A database server, comprising:

a processor; and

a memory arranged to store computer executable instructions which, when executed, cause the processor to perform the method of any of claims 1 to 10.

13. A computer readable storage medium storing one or more programs which, when executed by a database server comprising a plurality of application programs, cause the database server to perform the method of any of claims 1-10.

Images