JP2023001510A - Data management device and data management method - Google Patents

Abstract

To provide a data management device and a data management method which cause an appropriate database to store data in each database according to characteristics of the data processing.SOLUTION: In a data management system, a data management device and each database device are communicably connected by a communication network. The data management device 10 comprises: a data processing simulation program which calculates data of a predetermined item to be generated in a future predetermined period, by analyzing processing target data of a predetermined item acquired from a database, and estimates characteristics of data processing to be executed in the database including the calculated data; a data arrangement proposal creation program which identifies the database storing the data of the predetermined item, among the databases having a plurality of different data processing performances, on the basis of the estimated characteristics of the data processing; and a data arrangement execution program which causes the identified database to store the data including the processing target data.SELECTED DRAWING: Figure 2

Description

The present invention relates to a data management device and a data management method.

With recent developments in database technology, not only conventional relational models but also various database models such as key-value models and graph models have come to be used according to the characteristics of the data to be processed. Therefore, a multi-model database has been developed that can handle these database models in an integrated manner.

However, it is difficult to migrate a system operating using existing databases to a new multi-model database. Therefore, as a technique for handling a multi-model database, for example, Patent Document 1 discloses a storage device for storing a row-oriented database and a column-oriented database converted from the row-oriented database, and a control device for controlling the storage device. , a control device divides a plurality of records contained in a row-oriented database into a plurality of groups, and converts each group into a column group according to the format of the column-oriented database.

Japanese Patent Application Laid-Open No. 2021-026728

However, databases are not just for storing data, but are also targets for various data processing such as data referencing and data aggregation. Different data structures have different data processing characteristics. In particular, due to the spread of IoT (Internet Of Things) systems, there are more opportunities to collect and analyze large-scale data, and the current situation is that the amount of data to be processed is increasing. The technology described in Patent Literature 1 does not provide a mechanism for managing a multi-model database in full consideration of these points.

SUMMARY OF THE INVENTION The present invention has been made in view of such a situation, and its object is to provide a data management apparatus and a data management system capable of managing data in each database in an appropriate database according to the characteristics of the data processing. The purpose is to provide a management method.

One of the present inventions for solving the above problems is a processor and a memory, and by analyzing data to be processed of a predetermined item acquired from a database, the predetermined item generated in a predetermined period in the future. a data processing simulating unit for calculating data and estimating characteristics of data processing executed in a database containing the calculated data; a data management apparatus comprising: a data allocation proposal creation unit that identifies a database in which data of the predetermined item is stored; and a data allocation execution unit that stores data including the processing target data in the identified database; do.

According to another aspect of the present invention for solving the above problems, an information processing apparatus analyzes data to be processed of a predetermined item acquired from a database, thereby generating a predetermined item for a predetermined period in the future. data processing simulation processing for calculating data and estimating characteristics of data processing executed in a database containing the calculated data; , a data arrangement proposal creation process for specifying a database in which the data of the predetermined item is to be stored, and a data arrangement execution process for storing data including the process target data in the specified database, a data management method, and

According to the present invention, data in each database can be stored in an appropriate database according to the characteristics of the data processing.
Problems, configurations, and effects other than those described above will be clarified by the following description of the embodiments.

It is a figure showing an example of composition of a data management system concerning this embodiment. It is a figure which shows an example of the function (program) with which a data management apparatus is provided. It is a figure which shows an example of a data name and location correspondence table. FIG. 2 is a diagram showing an example of hardware included in each information processing device of a data management device and a database device; FIG. 10 is a flow diagram illustrating an example of data collection processing; FIG. 10 is a flow diagram illustrating details of query execution processing; FIG. 10 is a flow chart for explaining processing target data analysis processing; FIG. 11 is a flow diagram illustrating an example of data rearrangement processing; It is a figure which shows an example of a rearrangement proposal screen. FIG. 11 is a flow chart for explaining the details of placement plan creation processing;

FIG. 1 is a diagram showing an example of the configuration of a data management system 1 according to this embodiment. A data management system 1 includes a data management device 10 and a plurality of database devices 20 .

Each database device 20 stores a database. The types of databases stored in each database device 20 are different. When the types of databases are different, the data formats of data inquiries (queries) to the databases and query responses thereto are also different.

In this embodiment, it is assumed that there are a database device 20a that stores a relational database, a database device 20b that stores a time-series database, and a database device 20c that stores a column-oriented database.

The data management device 10 performs inquiry processing (query) for data processing and processing for receiving a query response to the inquiry for each of the database devices 20 storing databases of different types. In addition, the data management device 10 performs a process of proposing to relocate each database of the database device 20 to another database based on the received query response.

The data management device 10 and each database device 20 are communicably connected by a communication network 30 such as a wired LAN (Local Area Network), a wireless LAN, the Internet, or a dedicated line.

FIG. 2 is a diagram showing an example of functions (programs) included in the data management device 10. As shown in FIG.

First, the data management device 10 accepts designation of data processing from the user regarding databases having different data processing performances (hereinafter referred to as a group of databases) stored in the database device 20 . Regarding this data processing, the data management device 10 processes the database group in a unified manner (in this embodiment, in such a way that it is handled as a single relational database).

Specifically, the data management device 10 stores a data processing content input program 201, a data processing content management program 202, a query transmission program 2035, a query result format conversion program 208, and a query result output program 209. there is

The data processing content input program 201 receives from the user input of data to be processed (process target data) for the database group.

The data processing content management program 202 stores information on data processing to be performed on data of each item in the database group, including processing target data. This data information is, for example, the type of data processing (data aggregation, data reference, data update, etc.), the range of data to be processed, or the execution cycle of data processing.

The query transmission program 2035 includes a query generation program 203, a query analysis program 204, a data management program 205, and a query format conversion program 207.

The query generation program 203 generates a command (query) in a predetermined format to request each database device 20 regarding the processing target data stored by the data processing content management program 202 . A query is, for example, a command requesting acquisition of data of each data item (for example, data of a predetermined row, data of a predetermined column, predetermined time-series data) from each database device 20 .

The query analysis program 204 analyzes the query generated by the query generation program 203 and identifies the location of data to be processed by the query (for example, location of each database device 20 on the network). The location of this data is stored in the data name/location correspondence table 206 provided in the table management program 205 .

(data name and location correspondence table)
Here, FIG. 3 is a diagram showing an example of the data name/location correspondence table 206. As shown in FIG. The data name and location correspondence table 206 includes a data name 2061 in which information (for example, the name of the data item) specifying the data item (on the database) related to each processing target data is set, and a database having the data of the data item. location 2062 in which information specifying the location of the database (for example, location on the network of the database device 20) is set, and type 2063 data items in which the type of the database is set. Information such as row-oriented relational database (RDB: Relational Data Base), column-oriented DB, row-oriented DB, or time-series DB is set in the type 2063, for example.

Next, as shown in FIG. 2, the query format conversion program 207 performs conversion according to each database device 20 (database) to which the query processing request is made, based on the location of the data specified by the query analysis program 204. Each query is generated, and the generated query is transmitted to each database device 20 .

Next, the query result format conversion program 208 converts the response (query response) to each query received from each database device 20 into a predetermined format (the same format as the query generation program 203).

The query result output program 209 outputs the content of the query response converted by the query result format conversion program 208 to a file or displays it on the screen.

Next, the data management device 10 analyzes the tendency of the data of each database device 20 (data to be processed in each data item) included in the query response, and stores the data of each item including the data to be processed in each database. It proposes to the user which of the devices 20 should be stored in which database device 20, ie, rearranges the data, and executes it.

Specifically, the data management device 10 includes a data processing target analysis program 210, a database candidate management program 211, a data processing simulation program 212, a data rearrangement proposal creation program 213, a data arrangement proposal output program 214, and a data arrangement execution program. 215 programs are stored.

The data processing target analysis program 210 analyzes the data processing indicated by the data processing content management program 202 based on the processing target data acquired from each database device 20 . For example, the data processing target analysis program 210 calculates the data update range, data update frequency, data update required time, data update execution cycle, etc. of each database device 20 related to the process target data.

The database candidate management program 211 stores templates of each type of database in the database group (hereinafter referred to as database candidates).

The data processing simulation program 212 calculates data (dummy data) of each data item of each database device 20 to be generated in a predetermined future period specified by the user based on the analysis result of the data processing target analysis program 210 ( Predict. The data processing simulation program 212 then estimates the characteristics of the data processing executed in the database containing the calculated data.

Specifically, the data processing simulation program 212 creates a trial database in which dummy data is stored based on the database candidates, and executes data processing on the created trial database to obtain characteristics of the data processing. presume.

Note that the estimated characteristics of data processing are, for example, the time required for data processing, the execution frequency of data processing, or the update frequency of data to be processed in a predetermined future period.

Based on the execution result of the data processing simulation program 212, the data rearrangement proposal creation program 213 is based on the information (database) of the database device 20 (database) that stores the data of the data items related to the processing target data among the database devices 20. layout plan).

In this embodiment, the data rearrangement proposal creation program 213 expresses the data update processing performance, data compression performance, and data aggregation performance related to the data in the trial database based on the data processing characteristics estimated by the data processing simulation program 212. Create a database layout plan) according to the height of each parameter value.

The data allocation proposal output program 214 displays the allocation plan created by the data relocation proposal creation program 213 on the screen.

The data placement execution program 215 executes the placement plan specified by the user among the placement plans displayed by the data placement proposal output program 214, and stores the data of the data items related to the data to be processed in the database indicated by the placement plan. .

Furthermore, the data management device 10 stores a communication program 216 . The communication program 216 controls data transmission/reception with each database device 20 .

Here, FIG. 4 is a diagram showing an example of hardware included in each information processing device of the data management device 10 and the database device 20. As shown in FIG. Each information processing device includes a processor 101 such as a CPU (Central Processing Unit), MPU (Micro Processing Unit), or GPU (Graphics Processing Unit), and a memory such as ROM (Read Only Memory) or RAM (Random Access Memory). 102, a storage device 103 such as a hard disk drive, flash memory, or solid state drive (SSD);
An input device 104 such as a keyboard, mouse, card reader, or touch panel, or an output device 105 such as a liquid crystal display (LCD), an audio output device (speaker), or a printing device, and a network interface card (Network interface card: NIC), a wireless communication module, a USB (Universal Serial Interface) module, or a communication device 106 such as a serial communication module. Each information processing apparatus may be a computer having physical hardware as described above, or may be a computer unit (virtual server) obtained by logically dividing a physical computer. Also, each information processing device may be a task (process or container) executed on one or more computer clusters.

The function of each information processing device is realized by the hardware of each information processing device, or by the processor 101 of each information processing device reading and executing a program stored in the memory 102 or the storage device 103. . Further, the above program can be distributed by being recorded on a recording medium, for example.

Next, processing performed by the data management system 1 will be described.
The data management system 1 includes a data collection process S1 for acquiring data from the database group of the database device 20, a processing target data analysis process S301 for analyzing the acquired data, and each database in the database group based on the analysis result. 20, and a rearrangement process S2 for determining which of 20 is to be rearranged.
First, the data collection processing S1 will be described.

<Data collection processing>
FIG. 5 is a flowchart illustrating an example of the data collection processing S1. The data collection process S1 is started, for example, when a predetermined input is received from the user, at predetermined timing (for example, predetermined time, predetermined time interval), or when the database of the database device 20 is updated. be.

The data processing content input program 201 of the data management device 10 receives input of data processing to be performed on the database group from the user (S101).

That is, the data processing content input program 201 receives input of the type of data processing. For example, the data processing content input program 201 accepts designation of data reference or data aggregation.

The data processing content input program 201 also accepts input of data processing method and content. For example, the data processing content input program 201 includes a database for data processing, a range on the database for data processing, an appearance cycle of data to be actually processed within the data range (for example, data aggregation cycle), data It accepts an input of a processing execution cycle or a function used for data processing (for example, a function for calculating an average value or calculating a total value).

The data processing content management program 202 stores the information input by the data processing content input program 201 (S102).

The query generation program 203 generates a query for implementing the data processing input in S101 (S103). This query is a command based on a predetermined format (hereinafter referred to as standard format), for example, based on SQL (Structured Query Language).

The data management device 10 executes data processing for each database device 20 based on the query generated in S103, and performs query execution processing for displaying the content of the query response received from each database device 20 on the screen or outputting it to a file. (S104). Note that when an execution condition such as an execution cycle is input in S101, the data management device 10 executes query execution processing S104 under the execution condition input in S102. Details of the query execution processing S104 will be described below.
The data collection process S1 ends here.

<Query execution processing>
FIG. 6 is a flowchart for explaining the details of the query execution processing S104. The query analysis program 204 first analyzes the query generated and transmitted in S103, and identifies the processing target data (specifically, the data item name) indicated by the query (S201).

The query analysis program 204 identifies the location (database) of each processing target data identified in S201 (S202). For example, the query analysis program 204 acquires the data item name of each processing target data specified in S201, and stores the data of the acquired data item name by referring to each record in the data name/location correspondence table 206. The specified database device 20 (database) is specified.

The query format conversion program 207 converts the query sent in S103 into a query format corresponding to each database according to the type of each database specified in S202 (for example, the type 2063 of the data name and location correspondence table 206). Convert. Then, the query format conversion program 207 transmits each converted query to each database device 20 (S203).

Upon receiving each query, the database device 20 performs data processing indicated by the query, and transmits the processing result (query response including data to be processed) to the data management device 10 .

The query result format conversion program 208 converts the data format of the query response received from each database device 20 into a standard format (S204).

The query result output program 209 displays the content of the query response created by the conversion in S204 on the screen or outputs it to a predetermined file (S205). The query execution processing S104 ends here.

Next, the processing target data analysis processing S301 will be described.
<Processing target data analysis processing>
FIG. 7 is a flowchart for explaining the processing target data analysis processing S301. The processing target data analysis processing S301 is performed when there is a predetermined input from the user, when the data management device 10 receives processing target data from the database device 20, or when a predetermined timing (for example, a predetermined time, a predetermined time interval).

That is, the data processing target analysis program 210 analyzes the processing target data accumulated by the data management device 10 so far.

For example, the data processing target analysis program 210 calculates the update frequency of the data item or database related to the processing target data. Further, for example, the data processing target analysis program 210 calculates the distribution of the values of the data to be updated by calculating a distribution function representing the distribution of the values of the processing target data. Also, for example, the data processing target analysis program 210 analyzes the tendency of time-series changes in the value of the processing target data and calculates a prediction function representing the trend.
Thus, the processing target data analysis processing S301 ends.

<Data relocation processing>
FIG. 8 is a flowchart illustrating an example of the data rearrangement processing S2. The data rearrangement process S2 is executed, for example, when there is a predetermined input from the user, or at predetermined timing (for example, predetermined time, predetermined time interval).

First, the data processing simulation program 212 sets a future period (hereinafter referred to as a user-defined period, for example, after three years) that serves as a reference for judging data rearrangement. The user-set period may be set by user input, or may be automatically set by the data processing simulation program 212 . The user-set period may be a continuous period, or may be a plurality of periodically repeated time periods.

Then, the data processing simulation program 212 estimates the data content in the database of each database device 20 during the user setting period based on the analysis result of the processing target data analysis processing S301, that is, creates dummy data (S401). For example, the data processing simulation program 212, based on the update frequency, prediction function, distribution function, etc. calculated in S301, each data value to be set in the database of each database device 20 or fluctuation of the data value during the period set by the user Calculate

The data processing simulation program 212 acquires each database candidate by calling the database candidate management program 211, and creates a database of empty information (trial database) related to each acquired database candidate. Then, the data processing simulation program 212 sets the data (dummy data) estimated in S401 in each created trial database (S402).

The data processing simulation program 212 executes the data processing set in S101 for each trial database set in S402 (S403). At this time, the data processing simulation program 212 measures the processing time required for each executed data processing. In addition, the data processing simulation program 212, regarding the execution of data processing of each trial database, determines the execution frequency of the data processing (execution cycle in this embodiment), and the update frequency of the data subject to the data processing. memorize

The data relocation proposal creating program 213 executes placement plan creation processing for creating a placement plan based on the processing time, execution frequency, and update frequency calculated in S403 (S404). The details of the placement plan creation processing S404 will be described later.

The data allocation proposal output program 214 displays the allocation plan created in the allocation plan creation processing S404, and also displays it on a rearrangement proposal screen for accepting input from the user as to whether or not to execute the displayed allocation plan (S405).

(Relocation proposal screen)
FIG. 9 is a diagram showing an example of a rearrangement proposal screen 300. As shown in FIG. The rearrangement proposal screen 300 includes a data name display field 301 that is a list of data items related to the data to be processed, a rearrangement destination display field 302 that is a database (database device) to which data related to the data item is allocated, and an execution confirmation column 303 for whether or not to execute rearrangement for the arrangement destination.

Then, as shown in FIG. 8, the data placement execution program 215 executes the placement plan created in S405 with respect to the processing target data for which an input to the effect that the placement plan is to be executed is received from the user (S406). . Specifically, the data placement execution program 215 transmits the data of the data item related to each process target data from each current database device 20 to each database device 20 of the placement destination (at that time, the data format is converted). is also done). The data rearrangement processing S2 is thus completed.
Here, the details of the placement plan creation processing S404 will be described.

FIG. 10 is a flowchart for explaining the details of the placement plan creation processing S404.
The data rearrangement proposal creation program 213 determines whether or not the processing time related to the processing target data measured in S403 is greater than a predetermined threshold (S501). If the processing time is longer than the predetermined threshold (S501: YES), the data relocation proposal creating program 213 executes the processing of S502, and if the processing time is not longer than the predetermined threshold (S501: NO), The arrangement proposal creation program 213 executes the process of S503.

In S502, the data relocation proposal generation program 213 displays predetermined warning information on the screen, and the allocation plan generation processing S404 ends.

In S503, the data relocation proposal creation program 213 determines whether or not the update frequency of the processing target data (parameter value representing data update processing performance) is higher than a predetermined threshold. If the update frequency is higher than the predetermined threshold (S503: YES), the data relocation proposal creating program 213 executes the process of S507. The placement proposal creation program 213 executes the process of S504.

In S504, the data rearrangement proposal creation program 213 calculates the ratio of the data processing time (relative to the time series data) calculated in S403 to the execution cycle calculated in S403 (representing the data compression performance) for the data to be processed. parameter value) is higher than a predetermined threshold.

If the ratio of the data processing time to the execution cycle is not higher than the predetermined threshold (if the data compression performance is high) (S504: NO), the data relocation proposal creation program 213 stores the data to be processed in the time-series DB. Information proposing placement in the database device 20 is generated (S505), and the placement plan creation processing S404 ends.

If the ratio of the data processing time to the execution cycle is higher than the predetermined threshold (S504: YES), the data rearrangement proposal creating program 213 proposes to arrange the processing target data in the database device 20 having a column-oriented DB. information is generated (S506), and the placement plan creation processing S404 ends.

In S605, the data rearrangement proposal creation program 213 sets the ratio of the data processing time for the column-oriented DB calculated in S403 to the execution cycle calculated in S403 (parameter value representing data aggregation performance) for the data to be processed. is lower than a threshold value, and only when the ratio is lower than a predetermined threshold value (when the data aggregation performance is high), the data to be processed is placed in the database device 20 having a column-oriented DB. may generate information to

Next, in S507, the data relocation proposal creation program 213 calculates the ratio of the data processing time (in units of rows) to the RDB calculated in S403 to the execution cycle calculated in S403 (the data update function is enabled). parameter) is higher than a predetermined threshold.

If the ratio of the data processing time to the execution cycle is higher than the predetermined threshold (S507: YES), the data relocation proposal creating program 213 transfers the data to be processed to the database device 20 having a row-oriented DB (that is, a database having an RDB). 20), but the data processing is generated using a column-oriented DB (S509), and the placement plan creation processing S404 ends.

If the ratio of the data processing time to the execution cycle is equal to or less than the predetermined threshold (S507: NO), the data relocation proposal creation program 213 converts the data to be processed into the database device 20 having a row-oriented DB (that is, (S508), and the placement plan creation process S404 ends.

As described above, the data management apparatus 10 of the present embodiment analyzes the data to be processed of the predetermined data item acquired from the database, and calculates the data of the data item to be generated in the future period. Estimate the characteristics of the data processing executed in the database containing the data, and based on the estimated characteristics of the data processing, specify the database that stores the data of the data item among the database group, and assign the database to be processed Store data containing data.

That is, the data management apparatus 10 of the present embodiment estimates the characteristics of data processing by predicting future data processing of the data to be processed and creating dummy data, and arranges data based on the result of the estimation. Identify the database that should As a result, the data in each database can be managed by an appropriate database according to the characteristics of the data processing.

In particular, the data management device 10 of the present embodiment creates a trial database storing dummy data, and performs data processing on the created trial database to estimate characteristics of data processing. By actually creating a database in this way, the characteristics of data processing can be accurately estimated.

Further, the data management device 10 of the present embodiment uses parameters representing data update processing performance, data compression performance, and data aggregation performance related to dummy data based on the data processing time in the future period, the execution frequency of data processing, and the data update frequency. Calculate the value and identify the database accordingly. Thereby, an appropriate database can be specified according to the characteristics of the data processing performance of each database.

For example, the data management device 10 of this embodiment estimates the data update frequency in the future period, and if the parameter value representing the data update frequency exceeds a predetermined threshold value, identifies a row-oriented database (RDB, etc.) . This makes it possible to take advantage of the characteristics of row-oriented databases with high update performance.

Further, in this case, the data management device 10 of the present embodiment is configured such that when the parameter value representing the data update frequency exceeds a predetermined threshold, the parameter value representing the time required for data processing in units of rows in the future period is a predetermined value. If the threshold is exceeded, a row-oriented database is used as the storage destination, but the data processing is specified as using a column-oriented database. This makes it possible to utilize the advantages of both a row-oriented database with high update performance and a column-oriented database with high column-by-column data processing capability.

Further, the data management device 10 of the present embodiment identifies the time-series database when the parameter value representing the time required for data processing of the time-series data in the future period does not exceed a predetermined threshold. This makes it possible to take advantage of the characteristics of time-series databases that excel in data compression performance.

Further, the data management device 10 of the present embodiment identifies a column-oriented database when the parameter value representing the time required for data processing in units of columns in the future period does not exceed a predetermined threshold value. This makes it possible to utilize the characteristics of a column-oriented database (for example, RDB) that excels in data aggregation performance (on a column-by-column basis).

In addition, the data management apparatus 10 of the present embodiment can prompt the user to confirm whether or not to perform the relocation by displaying information about the database specified as the relocation destination on the screen.

In addition, the data management device 10 of the present embodiment converts a standard format query to generate a query corresponding to each database group, and transmits the generated query to the database group. Receives response data from and converts each received response data to a standard format. Then, the data management device 10 acquires each converted response data as data to be processed.

As a result, even if there are databases with different compatible formats, it is possible to easily obtain data in a unified standard format regardless of the format, and quickly identify the destination database.

The present invention is not limited to the above-described embodiments, and can be implemented using arbitrary constituent elements without departing from the spirit of the present invention. The embodiments and modifications described above are merely examples, and the present invention is not limited to these contents as long as the features of the invention are not impaired. Moreover, although various embodiments and modifications have been described above, the present invention is not limited to these contents. Other aspects conceivable within the scope of the technical idea of the present invention are also included in the scope of the present invention.

For example, part of each function provided by each device of the present embodiment may be provided in another device, or functions provided by another device may be provided in the same device.

Further, the type of database managed by the data management device 10 is not limited to that described in the present embodiment, and other types of databases may be used.

Further, in the present embodiment, it is assumed that one type of database is stored in one database device 20, but a plurality of types of databases are stored in one database device 20, and the data management device 10 may be configured to access each database of the database device 20 .

In addition, the data management device 10 calculates data aggregation performance, data compression performance, and data aggregation performance based on data processing time, data update time, and data update cycle, but other parameters are used. may be used to calculate these performances.

The data management device 10 may also calculate performance other than the data aggregation performance, the data compression performance, and the data aggregation performance.

Also, although the data management device 10 employs the SQL format as the standard format, other formats may be used.

1 data management system, 10 data management device, 20 database device, 212 data processing simulation program, 213 data rearrangement proposal creation program, 215 data arrangement execution program

Claims (10)

having a processor and memory,
By analyzing the data to be processed of the predetermined item acquired from the database, the data of the predetermined item that will be generated in a predetermined period in the future is calculated, and the characteristics of the data processing executed in the database containing the calculated data are determined. an estimating data processing simulator;
a data layout proposal creation unit that identifies, from among a plurality of databases having different data processing performances, a database in which the data of the predetermined item is to be stored, based on the estimated characteristics of data processing;
a data placement execution unit that stores data including the data to be processed in the identified database;
A data management device comprising: 2. The data processing simulating unit according to claim 1, wherein said data processing simulating unit creates a trial database storing said calculated data, and executes data processing on the created trial database, thereby estimating characteristics of said data processing. data management equipment. The data processing simulating unit estimates at least one of the time required for data processing, the frequency of execution of data processing, and the frequency of updating data in the predetermined future period as characteristics of the data processing,
The data allocation proposal creation unit calculates a parameter value representing at least one of data update processing performance, data compression performance, and data aggregation performance related to the calculated data based on the estimated characteristics of data processing, and calculates Identifying a database for storing the data of the predetermined item according to the parameter value,
The data management device according to claim 1. The data processing simulating unit estimates, as a characteristic of the data processing, a data update frequency in the predetermined future period,
The data allocation proposal creating unit determines whether or not the parameter value representing the estimated update frequency of the data exceeds a predetermined threshold value, and if the parameter value exceeds the threshold value, the data of the predetermined item is determined. identifying a row-oriented database as the stored database;
4. The data management device according to claim 3. The data processing simulating unit estimates, as characteristics of the data processing, a data update frequency and a time required for data processing in units of rows in the predetermined future period,
The data allocation proposal creation unit determines whether or not the parameter value representing the estimated update frequency of the data exceeds a predetermined threshold value, and if the parameter value exceeds the threshold value, the data in units of rows Determining whether a parameter value representing the time required for processing exceeds a predetermined threshold value, and specifying a row-oriented database as a database for storing data of the predetermined item when the parameter value exceeds the threshold value specifying a column-oriented database as a database for performing data processing of the predetermined item with
5. The data management device according to claim 4. The data processing simulating unit estimates the time required for data processing of time-series data in the predetermined future period as a property of the data processing,
The data allocation proposal creation unit determines whether or not the parameter value representing the estimated time required for data processing exceeds a predetermined threshold value, and if the parameter value does not exceed the threshold value, the predetermined item Identifying a time-series database as a database for storing data,
4. The data management device according to claim 3. The data processing simulating unit estimates the time required for data processing in units of columns in the predetermined future period as a characteristic of the data processing,
The data allocation proposal creation unit determines whether or not the parameter value representing the estimated time required for data processing exceeds a predetermined threshold value, and if the parameter value does not exceed the threshold value, the predetermined item identifying a columnar database as the database in which to store the data;
4. The data management device according to claim 3. 2. The data management device according to claim 1, further comprising a data placement proposal output unit that displays information about said specified database on a screen. By creating a query in a predetermined format and performing a predetermined conversion on the created query, a query corresponding to each of a plurality of databases having different data processing performances is generated, and the generated query is applied to the plurality of databases. a query transmission unit that receives response data for each of the transmitted queries from the plurality of databases by transmitting them to each;
a query result format conversion unit that converts each of the received response data into the predetermined format;
The data processing simulating unit acquires each of the converted response data as data to be processed for the predetermined item.
The data management device according to claim 1. The information processing device
By analyzing the data to be processed of the predetermined item acquired from the database, the data of the predetermined item that will be generated in a predetermined period in the future is calculated, and the characteristics of the data processing executed in the database containing the calculated data are determined. a simulated data processing to be estimated;
a data arrangement proposal creation process for identifying a database in which the data of the predetermined item is to be stored, among a plurality of databases having different data processing performances, based on the estimated characteristics of the data processing;
a data placement execution process for storing data including the data to be processed in the specified database;
A data management method that implements

Images