CN105243528A - Financial IT system graphical centralized reconciliation system and method under big data environment - Google Patents
Financial IT system graphical centralized reconciliation system and method under big data environment Download PDFInfo
- Publication number
- CN105243528A CN105243528A CN201510583111.4A CN201510583111A CN105243528A CN 105243528 A CN105243528 A CN 105243528A CN 201510583111 A CN201510583111 A CN 201510583111A CN 105243528 A CN105243528 A CN 105243528A
- Authority
- CN
- China
- Prior art keywords
- reconciliation
- task
- operation platform
- data
- record
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Landscapes
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
Abstract
The invention relates to a reconciliation system and a method thereof which are used for realizing graphical automatic centralization in a financial IT system under a big data environment. The system includes a graphical development platform used for defining reconciliation tasks and generating a target file used by a reconciliation operation platform, the reconciliation operation platform which is used for acquiring reconciliation source data, converting the reconciliation source data into standard logical records and executing a comparison process according to stored logical records, and a reconciliation service platform which is used for defining the dependencies of the reconciliation tasks, enabling manual monitoring on the reconciliation tasks and performing warning when reconciliation task execution is abnormal, wherein the graphical development platform includes a graphical interface configuration module used for developing process guidance required by the reconciliation tasks and storing the process guidance in the form of a defining file, and a configuration compilation module. With the reconciliation system and the method thereof which are used for realizing the graphical automatic centralization in the financial IT system adopted, reconciliation development can be completed based on graphical configuration. The reconciliation system and the method thereof do not rely on specific databases, support massive data, flexibly define the dependencies of the reconciliation tasks, and have a wider application range.
Description
Technical field
The present invention relates to computer software technical field, particularly relate to financial industry computer application system field, under specifically referring to a kind of large data environment, realize graphical automatically concentrated reconciliation disposal system and method thereof in financial IT system.
Background technology
Along with the development of modern social science technology, financial industry not only enters global age, more enters informationalized epoch.Customer-centric, for client provides convenience the target of service Shi Ge financial company particularly banking establishments of diversification.
The service basic of banking industry traditional loans and deposits greatly develops intermediary service, such as withholds public-works spending, sell all kinds of business such as air ticket, insurance.Because on-line transaction needs across multiple system, the stability of each system, network factors all may bring the inconsistent of account in whole operation flow.Although online punching just can reduce this inconsistent, still needing rigorous mode completely the same to ensure.The mode adopted is exactly reconciliation afterwards, and the account of oneself is all listed at the two ends of billing and accounting system, then checks the part finding out difference.This existence being reconciliation disposal system is laid a good foundation.
The reconciliation process of present each bank presents diversified feature, and reconciliation process is dispersed in each department, each system, and the reconciliation process of even a lot of bank and external system is process that is that manually complete or that at all just do not have reconciliation.
The reconciliation disposal system of current realization is mostly the system of bank for certain two system customization exploitation, adopts java or other language to realize.Main technology imports to database reconciliation file exactly, then writes sql statement and completes comparison.
Existing implementation has the following disadvantages.1. the implementation cycle is long, and because the water product of the personnel of enforcement are uneven also bring larger workload to test.2. reconciliation process is dependency database too, when data volume is serious to hydraulic performance decline when certain progression.3. there is no unified planning and management, particularly reconciliation between different system is also had to situation about relying on, need more manual intervention.
Summary of the invention
The object of the invention is the shortcoming overcoming above-mentioned prior art, provide a kind of can realize graphic based configure into reconciliation exploitation, do not rely on concrete database, support mass data, flexibly each reconciliation task of definition dependence, there is broader applications scope large data environment under realize the graphical reconciliation disposal system automatically concentrated and method thereof in financial IT system.
To achieve these goals, realize graphical automatically concentrated reconciliation disposal system and method thereof in financial IT system under large data environment of the present invention and there is following formation:
Graphical automatically concentrated reconciliation disposal system and method thereof in financial IT system is realized under this large data environment, its principal feature is, described system comprises: pattern development platform, in order to define reconciliation task and generate reconciliation operation platform use file destination;
Reconciliation operation platform, in order to gather reconciliation source data, convert standard logic record to and to perform comparison process according to the logical record preserved;
Reconciliation business platform, in order to define the dependence of reconciliation task, manual monitoring reconciliation task alarm when reconciliation tasks carrying is abnormal.
Preferably, described pattern development platform comprises:
Graphical interfaces configuration module, the flow process wanted in order to develop reconciliation required by task is expected and is stored with the form of defined file;
Configuration collector, in order to carry out the file destination compiling the use of the reconciliation operation platform described in generating to described defined file.
Preferably, described reconciliation operation platform comprises:
Data acquisition module, in order to gather the reconciliation source data of decision side and participant;
Data standard module, in order to resolve the reconciliation source data of decision side and participant, executable unit and semantic conversion form standard logic record;
Data memory module, in order to store described standard logic record;
Reconciliation engine modules, performs comparison process in order to the logical record preserved according to described data memory module;
Task scheduling modules, in order to dispatch and executed in parallel multiple reconciliation task.
Preferably, described reconciliation business platform comprises:
Mission Monitor module, in order to define reconciliation task dependence, manual monitoring reconciliation task, check and derive reconciliation result;
Abnormality alarming module, in order to carry out alarm when automatic reconciliation tasks carrying is abnormal.
The invention still further relates to a kind of method based on the graphical reconciliation process of automatically concentrating in financial IT system under realizing large data environment of described reconciliation disposal system, it is characterized in that, described method comprises the following steps:
(1) define reconciliation task by described pattern development platform and generate the file destination of reconciliation operation platform use;
(2) the reconciliation business platform definition reconciliation Task Dependent relation described in also generates dependence configuration file;
(3) the reconciliation operation platform described in performs reconciliation operation;
(4) the reconciliation business platform described in is checked and is confirmed reconciliation result.
Preferably, described step (1), comprises the following steps:
(1-1) user uses the newly-built reconciliation task of described pattern development platform, is reconciliation task designated packet, the create-rule inputting reconciliation task name and batch number;
(1-2) reconciliation task is preserved to be grouped into catalogue by the pattern development platform described in work space;
(1-3) the pattern development platform prompting user described in inputs and determines number formulary certificate, and described decision number formulary is according to comprising the node number of the side of decisioning, the mode of data acquisition, document format data, data model and data standard mapping;
(1-4) the pattern development platform prompting user described in inputs participant data, and described participant data comprise the node number of participant, the mode of data acquisition, document format data, data model and data standard and map;
(1-5) the pattern development platform prompting user-selected number described in is according to associated column and comparison array;
(1-6) above configuration information is saved in defined file by the pattern development platform described in;
(1-7) defined file is compiled as file destination by the pattern development platform described in;
(1-8) file destination of generation is deployed in the assigned catalogue of described reconciliation operation platform by the pattern development platform described in.
Preferably, described step (2), comprises the following steps:
(2-1) the reconciliation business platform described in calls the inquiry reconciliation task list service of reconciliation operation platform, finds all reconciliation tasks created;
(2-2) task, according to the result of inquiry, is shown with form of icons by the reconciliation business platform described in;
(2-3) user is with the line of arrow to set up Task Dependent relation by adding or deleting according to business between two tasks, and the Task Dependent without any dependence starts task;
(2-4) be starting point by dependence task, each dependence task of conversion check, if run into by dependence task, then point out user make mistakes, then continue step (2-3); If run into beginning task, continue step (2-5);
(2-5) the reconciliation business platform described in generates dependence configuration file and is saved in reconciliation operation platform.
Preferably, described step (3), comprises the following steps:
(3-1) reconciliation Task Dependent configuration file is loaded and initialization reconciliation task waiting list and reconciliation tasks carrying thread pool when the reconciliation operation platform described in starts;
(3-2) waiting list and thread pool state is judged, if the thread that waiting list is not empty and available free in thread pool, then continue step (3-3), if waiting list is empty, then continue step (4), if the not empty but no trunk journey in thread pool of waiting list, then continue step (3-2);
(3-3) the reconciliation operation platform described in is that reconciliation task generates current overall batch number and newly insert a record in reconciliation task instances table;
(3-4) the reconciliation operation platform described in calls decision side's data acquisition according to described file destination, and waits for that gatherer process terminates;
(3-5) the reconciliation operation platform described in calls participant data acquisition according to described file destination, and waits for that gatherer process terminates;
(3-6) the reconciliation operation platform calling data standard procedure described in converts decision number formulary certificate and participant data to standard logic record respectively;
(3-7) above-mentioned standard logic record is preserved by the reconciliation operation platform described in;
(3-8) the reconciliation operation platform described in performs comparison according to correlation rule and comparison rule, is preserved by comparison result;
(3-9) join one by one in waiting list and by the execution thread of task be returned in thread pool by relying on the reconciliation task of current reconciliation task, then continue step (3-2).
More preferably, described reconciliation operation platform is that reconciliation task generates current overall batch number, comprises the following steps:
(3-3-1) the reconciliation operation platform described in judges whether batch number create-rule is predefine template, if so, then according to current environment and template generation batch number; If create-rule is User Defined expansion, the batch number that invoke user provides realizes class and generates batch number;
(3-3-2) the reconciliation operation platform described in performs history according to the batch number query task of task name, generation and judges whether the record that there is same task name and batch number, if, then serial number is that the last item serial number adds 1, otherwise serial number is 0, the overall batch number of generation comprises task name, batch number and serial number.
More preferably, described reconciliation operation platform calling data standard procedure converts decision number formulary certificate and participant data to standard logic record respectively, comprises the following steps:
(3-6-1) decision number formulary certificate is become original physical record with the file declustering of participant data according to configuration by the reconciliation operation platform described in;
(3-6-2) the reconciliation operation platform described in is resolved original physical record one by one and is generated primitive logic record, and a territory of each record is a business factor;
(3-6-3) primitive logic record is converted into standard logic record by the reconciliation operation platform described in;
(3-6-4) the reconciliation operation platform described in is standard recording head assignment, comprises correlation rule row and the comparison rule row of user's mapping.
More preferably, described reconciliation operation platform comprises data memory module, and above-mentioned standard logic record is preserved by described reconciliation operation platform, comprises the following steps:
(371) the reconciliation operation platform described in is according to user configured correlation rule column-generation index column;
(372) standard logic record is saved in data memory module by the reconciliation operation platform described in;
(373) the reconciliation operation platform described in calls described data memory module to standard logic record ordering, and sort field is index column.
More preferably, described reconciliation operation platform comprises reconciliation engine modules and data memory module, and described reconciliation operation platform performs comparison according to correlation rule and comparison rule, comprises the following steps:
(3-8-1) the reconciliation operation platform described in obtains decision side's logical record minimum with participant respectively from described data memory module and judges whether record has contrasted, if, then continue step (3-2), otherwise continue step (3-8-2);
(3-8-2) the reconciliation operation platform described in calls described reconciliation engine modules and compares two records, if index value is equal, then continues step (3-8-3), if index value is unequal, then continues step (3-8-6);
(3-8-3) value defined in more each comparison rule, if mated completely, then continues step (3-8-4), if Incomplete matching, then continues step (3-8-5);
(3-8-4) increase a reconciliation reef knot fruit in the result, decision side and participant all take off a smallest record, then continue step (3-8-2);
(3-8-5) increase a reconciliation in the result not equal a record, decision side and participant all take off a smallest record, then continue step (3-8-2);
(3-8-6) judge the size of decision side and participant data, if the side's of decision data directory is little, then continue step (3-8-7), if participant data directory is little, then continue step (3-8-8);
(3-8-7) always increasing account record more than in result, determining that number formulary is according to taking off a record, then continues step (3-8-2) simultaneously;
(3-8-8) increase a few account record in the result, participant data take off a record simultaneously, then continue step (3-8-2).
Preferably, described step (4), comprises the following steps:
(4-1) the reconciliation business platform described in is inquired about reconciliation task instances table, is obtained all reconciliation task instances lists and task instances information is showed user by list;
(4-2) the reconciliation business platform described in is inquired about reconciliation result table according to user for the selection of reconciliation task and returns the results list of current reconciliation task instances;
(4-3) for the result of reconciliation injustice, user can confirm reconciliation result, selects artificial correction or reconciliation again.
Realize graphical automatically concentrated reconciliation disposal system and method thereof in financial IT system under have employed the large data environment in this invention, unified framework is provided, defines multiple reconciliation scene, use the technology of metadata to carry out the data layout of specification and unified each side; Make the parsing of graphically supporting document content; Use external sort algorithm then to adopt a merge algorithm to complete reconciliation to mass data sequence, to cloud computing support, undue dependence can not be produced to database; The various reconciliation tasks of centralized management bank, support the dependence of a definition task, adopt the mode of task scheduling to trigger reconciliation process, thus can realize the reconciliation of robotization; Support that external system subscribes to reconciliation tasks carrying situation, thus alarm notification can be sent when exception; This technical scheme has development efficiency and significantly promotes, and reduces developer's threshold simultaneously; Primary support is had to the data of the larger order of magnitude; Decrease the workload of O&M, improve efficiency, make operation maintenance personnel only need to pay close attention to alarm notification and inquiry reconciliation result, there is range of application widely.
Accompanying drawing explanation
Fig. 1 is the structural representation of the graphical reconciliation disposal system automatically concentrated in financial IT system under large data environment of the present invention.
Fig. 2 is the process flow diagram of reconciliation engine modules of the present invention comparison.
Embodiment
In order to more clearly describe technology contents of the present invention, conduct further description below in conjunction with specific embodiment.
Under this large data environment, the financial industry robotization of graphic based concentrates reconciliation framework to comprise pattern development door, run door and reconciliation business platform, and described pattern development door comprises:
Graphical interfaces configuration module, based on Eclipse exploitation, realizes the process wizard that exploitation reconciliation required by task is wanted.Guide comprises reconciliation task definition, determines that number formulary is according to definition, the definition of participant data, the definition of reconciliation rule.Final each definition stores in the form of a file.
Configuration collector, compiles the defined file that above-mentioned interface configurations module is preserved, and generates the file destination that reconciliation operation platform uses.
Described reconciliation operation platform comprises:
Data acquisition module, is responsible for the reconciliation source data gathering decision side and participant, comprises from FTP image data, database image data, by transaction image data.Data acquisition is also divided into active acquisition and passive collection.
Data standard module, resolves the reconciliation file of decision side and participant, and executable unit and semantic conversion form the logical record of standard.
Data memory module, storage standards logical record, supports Sybase, ODS and HDFS, supports mass data storage.To logical record sequence, realize indexed search.
Reconciliation engine modules, perform comparison process according to the logical record preserved in data memory module, every bar records and only has four kinds of results: reconciliation is put down, and decision side and participant all occur and key element is consistent; Many accounts, decision side occurs but participant does not occur; Few account, participant occurs but determines that Fang Wei occurs; Injustice, decision side and participant all occur but key element is inconsistent.
Task scheduling modules, dispatches multiple reconciliation task, realizes the dependence between reconciliation task, executed in parallel.
Described reconciliation business platform comprises:
Mission Monitor module, the dependence of definition reconciliation task, manually start reconciliation, the situation of reconciliation exception restarts reconciliation.Check and derive reconciliation result, artificial correction reconciliation result.
Abnormality alarming module, when automatic reconciliation tasks carrying is abnormal, by note, mail, large-size screen monitors alarm.
Should realize account checking method based on above-mentioned reconciliation framework, its principal feature is, described method comprises definition reconciliation task operating, definition reconciliation Task Dependent relational operation, scheduling reconciliation operation platform execution reconciliation operation, checks and confirm reconciliation results operation.
Described definition reconciliation task operating, comprises the following steps:
(11) user uses the newly-built reconciliation task of described pattern development platform, is reconciliation task designated packet, the create-rule of input reconciliation task name and batch number;
(12) the pattern development platform described in will to be grouped into catalogue, and task is called filename, and chx is that extension name (namely " grouping/task name .chx ") is preserved in work space.If there is file of the same name prompting user reconciliation task to exist;
(13) the pattern development platform prompting user described in inputs and determines number formulary certificate, comprises the node number of decision side, the mode of data acquisition, document format data, and data model and data standard map;
(14) the pattern development platform prompting user described in inputs participant data, comprises the node number of participant, the mode of data acquisition, document format data, and data model and data standard map;
(15) the pattern development platform prompting user-selected number described in is according to associated column and comparison array;
(16) above configuration information is saved in defined file by the pattern development platform described in;
(17) defined file is compiled as file destination by the pattern development platform invoke configuration collector described in, and file destination is .cht;
(18) file destination of generation is deployed in reconciliation operation platform assigned catalogue by the pattern development platform described in;
Described definition reconciliation Task Dependent relational operation, comprises the following steps:
(21) the reconciliation business platform described in calls the inquiry reconciliation task list service of reconciliation operation platform, finds all reconciliation tasks created.
(22) task, according to the result of inquiry, is all illustrated as task icons by the reconciliation business platform described in;
(23) user adds between two tasks according to service needed or the line that deletes arrow (dependence task points to by dependence task), sets up Task Dependent relation; Task Dependent without any dependence starts task.
(24) with above-mentioned by dependence task for starting point, each dependence task of conversion check, knows and runs into by dependence task or beginning task.Illustrated to there is Circular dependency if run into by dependence task, prompting user makes mistakes, and requires that user revises; If run into beginning task, be that dependence is correct.
(25) the reconciliation business platform described in generates dependence configuration file according to the line of user, is saved in reconciliation operation platform;
Described scheduling reconciliation operation platform performs reconciliation operation and comprises the following steps:
(31) reconciliation Task Dependent configuration file is loaded when the reconciliation operation platform described in starts.Described reconciliation operation platform initialization reconciliation task waiting list and reconciliation tasks carrying thread pool.The reconciliation task directly relying on beginning task is joined wait operation queue.
(32) start scheduler task process and perform following operation, if the thread that waiting list is not empty and available free in thread pool, from thread pool, take out a thread, from waiting list, go out team's task, and start this reconciliation task of thread execution of just taking out.Repeat this step, until wait etc. are classified as empty and all threads are all idle.If waiting list is empty or does not have idle thread in thread pool, wait for that idle thread is waken up in sleep.For each tasks carrying the following step:
(33) for reconciliation task generates current overall batch number; A new insertion record (overall batch number, in reconciliation for Id, reconciliation task Id) in reconciliation task instances table;
(34) the reconciliation operation platform described in calls decision side's data acquisition according to task definition file destination, and waits for that gatherer process terminates;
(35) the reconciliation operation platform described in calls participant data acquisition according to task definition file destination, and waits for that gatherer process terminates;
(36) the calling data standard procedure after decision side's data acquisition terminates of the reconciliation operation platform described in converts decision number formulary certificate to standard logic record;
(37) above-mentioned decision side standard logic record is saved in data memory module by the reconciliation operation platform described in, and according to the engine correlation rule generating indexes row in task definition, and to standard logic record ordering;
(38) the calling data standard procedure after participant data acquisition terminates of the reconciliation operation platform described in converts decision number formulary certificate to standard logic record;
(39) above-mentioned participant standard logic record is saved in data memory module by the reconciliation operation platform described in, and according to the engine correlation rule generating indexes row in task definition, and to standard logic record ordering;
(3A) the reconciliation operation platform described in calls reconciliation engine modules and performs comparison according to correlation rule and comparison rule, and comparison result is preserved data memory module;
(3B) state of reconciliation example record is upgraded for completing.Query task relies on configuration, the reconciliation task relying on current reconciliation task is joined one by one in waiting list, is returned in thread pool, wakeup schedule task process by the execution thread of task.
Described checks and confirms that reconciliation results operation comprises the following steps:
(41) the reconciliation business platform inquiry reconciliation task instances table described in, obtains all reconciliation task instances lists; Task instances information is showed user by list by reconciliation business platform;
(42) user clicks selection reconciliation task instances by the page, and reconciliation business platform inquiry reconciliation result table, returns the results list of current reconciliation task instances;
(43) for the result of non-" putting down ", user can confirm reconciliation result, selects artificial correction or reconciliation again; Confirm that complete reconciliation task instances terminates.
Operating for reconciliation task generates current overall batch number in the method for reconciliation framework is concentrated in this financial industry robotization realizing graphic based, comprises the following steps:
(331) the reconciliation operation platform described in judges batch number create-rule, if create-rule is predefine template, reconciliation operation platform is according to current environment and template generation batch number; If create-rule is User Defined expansion, the batch number that invoke user provides realizes class, generates batch number;
(332) the reconciliation operation platform described in is according to task name, the batch number query task of above-mentioned generation performs history, if there is the record of same task name and batch number, then serial number is that the last item serial number adds 1, otherwise serial number is 0, the final overall batch number generated is task name. batch number. and serial number;
Operating for described reconciliation operation platform calls decision side's data acquisition according to task definition file destination in the method for reconciliation framework is concentrated in this financial industry robotization realizing graphic based, comprises the following steps:
(341) the reconciliation operation platform described in configures according to Mission Objectives Document, performs different operations.If acquisition mode is FTP, reconciliation operation platform will call FTP collector and realize, by sending message to acquisition module; If ODS or database will adopt SQL class collector to realize; If HDFS will adopt HDFS to realize.Each realization and reconciliation operation platform are independently, mutual by message.Described reconciliation operation platform self suspended task after calling acquisition module, and wait for that acquisition module result notifies;
(342) the reconciliation operation platform file acquisition module described in is after collection completes, and send result and notify described reconciliation operation platform, reconciliation operation platform is performed step below;
Operating for described reconciliation operation platform calling data standard procedure after decision side's data acquisition terminates converts decision number formulary certificate to standard logic record in the method for reconciliation framework is concentrated in this financial industry robotization realizing graphic based, comprises the following steps:
(361) data file is split into original physical record according to configuration by the reconciliation operation platform described in, defines during data by above-mentioned graphical configuration decision side or participant of the form of raw readings;
(362) original physical record resolved one by one by the reconciliation operation platform described in, and generate primitive logic record (actual can be regarded as a MAP), a territory of each record is a business factor;
(363) primitive logic record is converted into standard logic record by the reconciliation operation platform described in, and converted contents comprises uniform units, semantic name translation, if the unit of the unified amount of money is to dividing;
(364) the reconciliation operation platform described in is standard recording head assignment, comprises correlation rule row and the comparison rule row of user's mapping;
This financial industry robotization realizing graphic based is concentrated and is saved in data memory module for described reconciliation operation platform by above-mentioned decision side standard logic record in the method for reconciliation framework, and according to the engine correlation rule generating indexes row in task definition, and to the operation of standard logic record ordering, comprise the following steps:
(371) the reconciliation operation platform described according to user configured correlation rule column-generation index column, generating mode be row number+" | "+row length+" $ "+row value+row length+" $ "+train value+
(372) standard logic record is saved in data memory module by the reconciliation operation platform described in;
(373) the reconciliation operation platform calling data memory module described in is to standard logic record ordering, and sort field is index column;
Operating according to correlation rule and comparison rule execution comparison for described reconciliation operation platform calls reconciliation engine modules in the method for reconciliation framework is concentrated in this financial industry robotization realizing graphic based, comprises the following steps:
(3A1) the reconciliation platform described in obtains decision side's logical record minimum with participant respectively from data memory module.
(3A2) compare two records, if index value is equal, if the value defined in more each comparison rule is mated completely, increase a reconciliation reef knot fruit in the result, decision side and participant all take off a smallest record; If Incomplete matching, increase a reconciliation in the result and do not equal a record, decision side and participant all take off a smallest record; Repeat (3A2)
If (3A3) index value is unequal, if the side's of decision data directory is little, always increasing account record more than in result, determining that number formulary is according to taking off a record simultaneously; If participant data directory is little, increase a few account record in the result, participant data take off a record simultaneously; Repeat (3A2)
In the middle of reality uses, this above-mentioned graphical configuration operation of reconciliation framework is for reconciliation task configures the association attributes (such as: the attribute of data acquisition, the attribute etc. of data normalization) of each operation:
The attribute of TransferFile class definition data acquisition, mainly comprises path, acquisition mode etc. that file gathers.
RemoteFilePath definition if telefile time telefile path; FileHostService definition obtain file method realize class name, mainly comprise from the obtain manner such as database, ODS; The notice that can trigger when notifyTrans defined file is transmitted.
ImportFile defines the attribute of data normalization process, mainly comprises the data layout of definition reconciliation source file and the mapping relations of definition and standard criterion data.
Wherein fileParserClass be document analysis realize class, the general class that realizes provided comprises FixLengthFileParser, XMLFileParser, JsonFileParser, SeparaterFileParser, XslFileParser; After fileParser resolution file, it is name and the value that map, a map comprise all fields that each record can export; The map that previous step exports by columnMapping is mapped as the standard criterion record of this frame method definition further.
CompareColumns, associateColumns define comparison array and the associated column of the use of reconciliation engine respectively.
The operation of this above-mentioned reconciliation framework definition dependence is the dependence setting up every two reconciliation tasks, and actual is structure TaskSetRelation object:
RelyOn is defined as current task and relies on which task, and which Task Dependent relyBy defines current task by.Following is the Implementation of pseudocode of addRelation:
When reconciliation business platform adopts on line to set up dependence, call addRelation to set up TaskSetRelation.
It is dispatch each reconciliation task according to the dependence of above-mentioned foundation that this above-mentioned reconciliation framework scheduling reconciliation operation platform performs reconciliation operation:
Realize graphical automatically concentrated reconciliation disposal system and method thereof in financial IT system under have employed the large data environment in this invention, unified framework is provided, defines multiple reconciliation scene, use the technology of metadata to carry out the data layout of specification and unified each side; Make the parsing of graphically supporting document content; Use external sort algorithm then to adopt a merge algorithm to complete reconciliation to mass data sequence, to cloud computing support, undue dependence can not be produced to database; The various reconciliation tasks of centralized management bank, support the dependence of a definition task, adopt the mode of task scheduling to trigger reconciliation process, thus can realize the reconciliation of robotization; Support that external system subscribes to reconciliation tasks carrying situation, thus alarm notification can be sent when exception; This technical scheme has development efficiency and significantly promotes, and reduces developer's threshold simultaneously; Primary support is had to the data of the larger order of magnitude; Decrease the workload of O&M, improve efficiency, make operation maintenance personnel only need to pay close attention to alarm notification and inquiry reconciliation result, there is range of application widely.
In this description, the present invention is described with reference to its specific embodiment.But, still can make various amendment and conversion obviously and not deviate from the spirit and scope of the present invention.Therefore, instructions and accompanying drawing are regarded in an illustrative, rather than a restrictive.
Claims (13)
1. the reconciliation disposal system graphically automatically concentrated in financial IT system under large data environment, it is characterized in that, described reconciliation disposal system comprises:
Pattern development platform, in order to define reconciliation task and generate reconciliation operation platform use file destination;
Reconciliation operation platform, in order to gather reconciliation source data, convert standard logic record to and to perform comparison process according to the logical record preserved;
Reconciliation business platform, in order to define the dependence of reconciliation task, manual monitoring reconciliation task alarm when reconciliation tasks carrying is abnormal.
2. the reconciliation disposal system graphically automatically concentrated in financial IT system under large data environment according to claim 1, it is characterized in that, described pattern development platform comprises:
Graphical interfaces configuration module, the flow process wanted in order to develop reconciliation required by task is expected and is stored with the form of defined file;
Configuration collector, in order to carry out the file destination compiling the use of the reconciliation operation platform described in generating to described defined file.
3. the reconciliation disposal system graphically automatically concentrated in financial IT system under large data environment according to claim 1, it is characterized in that, described reconciliation operation platform comprises:
Data acquisition module, in order to gather the reconciliation source data of decision side and participant;
Data standard module, in order to resolve the reconciliation source data of decision side and participant, executable unit and semantic conversion form standard logic record;
Data memory module, in order to store described standard logic record;
Reconciliation engine modules, performs comparison process in order to the logical record preserved according to described data memory module;
Task scheduling modules, in order to dispatch and executed in parallel multiple reconciliation task.
4. the reconciliation disposal system graphically automatically concentrated in financial IT system under large data environment according to claim 1, it is characterized in that, described reconciliation business platform comprises:
Mission Monitor module, in order to define reconciliation task dependence, manual monitoring reconciliation task, check and derive reconciliation result;
Abnormality alarming module, in order to carry out alarm when automatic reconciliation tasks carrying is abnormal.
5. a method for graphical reconciliation process of automatically concentrating in financial IT system under realizing large data environment based on the reconciliation disposal system according to any one of Claims 1-4, it is characterized in that, described method comprises the following steps:
(1) define reconciliation task by described pattern development platform and generate the file destination of reconciliation operation platform use;
(2) the reconciliation business platform definition reconciliation Task Dependent relation described in also generates dependence configuration file;
(3) the reconciliation operation platform described in performs reconciliation operation;
(4) the reconciliation business platform described in is checked and is confirmed reconciliation result.
6. the method for graphical reconciliation process of automatically concentrating in financial IT system under the large data environment of realization according to claim 5, it is characterized in that, described step (1), comprises the following steps:
(1-1) user uses the newly-built reconciliation task of described pattern development platform, is reconciliation task designated packet, the create-rule inputting reconciliation task name and batch number;
(1-2) reconciliation task is preserved to be grouped into catalogue by the pattern development platform described in work space;
(1-3) the pattern development platform prompting user described in inputs and determines number formulary certificate, and described decision number formulary is according to comprising the node number of the side of decisioning, the mode of data acquisition, document format data, data model and data standard mapping;
(1-4) the pattern development platform prompting user described in inputs participant data, and described participant data comprise the node number of participant, the mode of data acquisition, document format data, data model and data standard and map;
(1-5) the pattern development platform prompting user-selected number described in is according to associated column and comparison array;
(1-6) above configuration information is saved in defined file by the pattern development platform described in;
(1-7) defined file is compiled as file destination by the pattern development platform described in;
(1-8) file destination of generation is deployed in the assigned catalogue of described reconciliation operation platform by the pattern development platform described in.
7. the method for graphical reconciliation process of automatically concentrating in financial IT system under the large data environment of realization according to claim 5, it is characterized in that, described step (2), comprises the following steps:
(2-1) the reconciliation business platform described in calls the inquiry reconciliation task list service of reconciliation operation platform, finds all reconciliation tasks created;
(2-2) task, according to the result of inquiry, is shown with form of icons by the reconciliation business platform described in;
(2-3) user is with the line of arrow to set up Task Dependent relation by adding or deleting according to business between two tasks, and the Task Dependent without any dependence starts task;
(2-4) be starting point by dependence task, each dependence task of conversion check, if run into by dependence task, then point out user make mistakes, then continue step (2-3); If run into beginning task, continue step (2-5);
(2-5) the reconciliation business platform described in generates dependence configuration file and is saved in reconciliation operation platform.
8. the method for graphical reconciliation process of automatically concentrating in financial IT system under the large data environment of realization according to claim 5, it is characterized in that, described step (3), comprises the following steps:
(3-1) reconciliation Task Dependent configuration file is loaded and initialization reconciliation task waiting list and reconciliation tasks carrying thread pool when the reconciliation operation platform described in starts;
(3-2) waiting list and thread pool state is judged, if the thread that waiting list is not empty and available free in thread pool, then continue step (3-3), if waiting list is empty, then continue step (4), if the not empty but no trunk journey in thread pool of waiting list, then continue step (3-2);
(3-3) the reconciliation operation platform described in is that reconciliation task generates current overall batch number and newly insert a record in reconciliation task instances table;
(3-4) the reconciliation operation platform described in calls decision side's data acquisition according to described file destination, and waits for that gatherer process terminates;
(3-5) the reconciliation operation platform described in calls participant data acquisition according to described file destination, and waits for that gatherer process terminates;
(3-6) the reconciliation operation platform calling data standard procedure described in converts decision number formulary certificate and participant data to standard logic record respectively;
(3-7) above-mentioned standard logic record is preserved by the reconciliation operation platform described in;
(3-8) the reconciliation operation platform described in performs comparison according to correlation rule and comparison rule, is preserved by comparison result;
(3-9) join one by one in waiting list and by the execution thread of task be returned in thread pool by relying on the reconciliation task of current reconciliation task, then continue step (3-2).
9. the method for graphical reconciliation process of automatically concentrating in financial IT system under the large data environment of realization according to claim 8, it is characterized in that, described reconciliation operation platform is that reconciliation task generates current overall batch number, comprises the following steps:
(3-3-1) the reconciliation operation platform described in judges whether batch number create-rule is predefine template, if so, then according to current environment and template generation batch number; If create-rule is User Defined expansion, the batch number that invoke user provides realizes class and generates batch number;
(3-3-2) the reconciliation operation platform described in performs history according to the batch number query task of task name, generation and judges whether the record that there is same task name and batch number, if, then serial number is that the last item serial number adds 1, otherwise serial number is 0, the overall batch number of generation comprises task name, batch number and serial number.
10. the method for graphical reconciliation process of automatically concentrating in financial IT system under the large data environment of realization according to claim 8, it is characterized in that, described reconciliation operation platform calling data standard procedure converts decision number formulary certificate and participant data to standard logic record respectively, comprises the following steps:
(3-6-1) decision number formulary certificate is become original physical record with the file declustering of participant data according to configuration by the reconciliation operation platform described in;
(3-6-2) the reconciliation operation platform described in is resolved original physical record one by one and is generated primitive logic record, and a territory of each record is a business factor;
(3-6-3) primitive logic record is converted into standard logic record by the reconciliation operation platform described in;
(3-6-4) the reconciliation operation platform described in is standard recording head assignment, comprises correlation rule row and the comparison rule row of user's mapping.
The method of graphical reconciliation process of automatically concentrating in financial IT system under the large data environment of 11. realization according to claim 8, it is characterized in that, described reconciliation operation platform comprises data memory module, above-mentioned standard logic record is preserved by described reconciliation operation platform, comprises the following steps:
(371) the reconciliation operation platform described in is according to user configured correlation rule column-generation index column;
(372) standard logic record is saved in data memory module by the reconciliation operation platform described in;
(373) the reconciliation operation platform described in calls described data memory module to standard logic record ordering, and sort field is index column.
The method of graphical reconciliation process of automatically concentrating in financial IT system under the large data environment of 12. realization according to claim 8, it is characterized in that, described reconciliation operation platform comprises reconciliation engine modules and data memory module, described reconciliation operation platform performs comparison according to correlation rule and comparison rule, comprises the following steps:
(3-8-1) the reconciliation operation platform described in obtains decision side's logical record minimum with participant respectively from described data memory module and judges whether record has contrasted, if, then continue step (3-2), otherwise continue step (3-8-2);
(3-8-2) the reconciliation operation platform described in calls described reconciliation engine modules and compares two records, if index value is equal, then continues step (3-8-3), if index value is unequal, then continues step (3-8-6);
(3-8-3) value defined in more each comparison rule, if mated completely, then continues step (3-8-4), if Incomplete matching, then continues step (3-8-5);
(3-8-4) increase a reconciliation reef knot fruit in the result, decision side and participant all take off a smallest record, then continue step (3-8-2);
(3-8-5) increase a reconciliation in the result not equal a record, decision side and participant all take off a smallest record, then continue step (3-8-2);
(3-8-6) judge the size of decision side and participant data, if the side's of decision data directory is little, then continue step (3-8-7), if participant data directory is little, then continue step (3-8-8);
(3-8-7) always increasing account record more than in result, determining that number formulary is according to taking off a record, then continues step (3-8-2) simultaneously;
(3-8-8) increase a few account record in the result, participant data take off a record simultaneously, then continue step (3-8-2).
The method of graphical reconciliation process of automatically concentrating in financial IT system under the large data environment of 13. realization according to claim 5, it is characterized in that, described step (4), comprises the following steps:
(4-1) the reconciliation business platform described in is inquired about reconciliation task instances table, is obtained all reconciliation task instances lists and task instances information is showed user by list;
(4-2) the reconciliation business platform described in is inquired about reconciliation result table according to user for the selection of reconciliation task and returns the results list of current reconciliation task instances;
(4-3) for the result of reconciliation injustice, user can confirm reconciliation result, selects artificial correction or reconciliation again.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201510583111.4A CN105243528A (en) | 2015-09-15 | 2015-09-15 | Financial IT system graphical centralized reconciliation system and method under big data environment |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201510583111.4A CN105243528A (en) | 2015-09-15 | 2015-09-15 | Financial IT system graphical centralized reconciliation system and method under big data environment |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN105243528A true CN105243528A (en) | 2016-01-13 |
Family
ID=55041165
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201510583111.4A Pending CN105243528A (en) | 2015-09-15 | 2015-09-15 | Financial IT system graphical centralized reconciliation system and method under big data environment |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN105243528A (en) |
Cited By (26)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105787109A (en) * | 2016-03-22 | 2016-07-20 | 农信银资金清算中心有限责任公司 | Account checking method and device of payment and clearing system |
| CN106022908A (en) * | 2016-05-17 | 2016-10-12 | 中国建设银行股份有限公司 | Method and system for querying information of assets and liabilities |
| CN106127567A (en) * | 2016-06-21 | 2016-11-16 | 国家电网公司 | Enterprise deposits journal account and the account checking method of cash in banks statement and system |
| CN106445898A (en) * | 2016-09-07 | 2017-02-22 | 东信和平科技股份有限公司 | Mail cover data processing method and system |
| CN106503420A (en) * | 2016-09-27 | 2017-03-15 | 中电科软件信息服务有限公司 | The multi-party reconciliation assessment of hospital and supervisory systems and method |
| CN107665460A (en) * | 2016-07-24 | 2018-02-06 | 平安科技（深圳）有限公司 | Accounting method and device based on real-time deal |
| CN107784094A (en) * | 2017-10-17 | 2018-03-09 | 平安科技（深圳）有限公司 | Monetary fund system automation liquidation method, device, equipment and storage medium |
| CN108509392A (en) * | 2018-02-24 | 2018-09-07 | 深圳壹账通智能科技有限公司 | Multimachine structure account checking method, system, computer equipment and storage medium |
| CN109102379A (en) * | 2017-06-21 | 2018-12-28 | 米思米（中国）精密机械贸易有限公司 | Account checking apparatus, reconciliation server and reconciliation system |
| CN109598602A (en) * | 2017-09-28 | 2019-04-09 | 平安普惠企业管理有限公司 | Account checking method, device, equipment and computer readable storage medium |
| CN110019194A (en) * | 2017-09-27 | 2019-07-16 | 腾讯科技（深圳）有限公司 | Verification of data method, apparatus, computer equipment and storage medium |
| CN110413428A (en) * | 2019-08-06 | 2019-11-05 | 中国联合网络通信集团有限公司 | Reconciliation data processing method, electronic device and storage medium |
| CN110532373A (en) * | 2019-07-17 | 2019-12-03 | 平安科技（深圳）有限公司 | Generation method, device, computer equipment and the storage medium of finance data |
| CN111176802A (en) * | 2019-07-26 | 2020-05-19 | 腾讯科技（深圳）有限公司 | Task processing method and device, electronic equipment and storage medium |
| CN111427918A (en) * | 2020-03-27 | 2020-07-17 | 中国工商银行股份有限公司 | Transaction detail data comparison method and device |
| CN111915429A (en) * | 2020-08-11 | 2020-11-10 | 北京开科唯识技术有限公司 | Account checking method and device |
| US10866944B2 (en) | 2017-05-22 | 2020-12-15 | Fujitsu Limited | Reconciled data storage system |
| CN112380199A (en) * | 2020-11-10 | 2021-02-19 | 珠海市新德汇信息技术有限公司 | Big data end-to-end data reconciliation arrangement method |
| CN112541750A (en) * | 2020-12-08 | 2021-03-23 | 中国联合网络通信集团有限公司 | Data processing method, device, equipment and computer readable storage medium |
| CN113191583A (en) * | 2021-03-23 | 2021-07-30 | 中国工商银行股份有限公司 | Account checking file generation method and device |
| CN113591446A (en) * | 2021-06-29 | 2021-11-02 | 四川新网银行股份有限公司 | Configuration reconciliation file generation device |
| CN113781208A (en) * | 2021-09-22 | 2021-12-10 | 深圳鼎盛电脑科技有限公司 | Operation problem processing system and method based on Internet financial industry |
| CN114372787A (en) * | 2020-10-14 | 2022-04-19 | 腾讯科技（深圳）有限公司 | Business resource processing method and device, electronic equipment and storage medium |
| CN114547113A (en) * | 2022-04-26 | 2022-05-27 | 云账户技术(天津)有限公司 | Mass data account checking system, method, network equipment and storage medium |
| CN114925045A (en) * | 2022-04-11 | 2022-08-19 | 杭州半云科技有限公司 | PaaS platform for large data integration and management |
| CN115984022A (en) * | 2023-03-17 | 2023-04-18 | 梅州客商银行股份有限公司 | Unified account checking method and device for distributed payment system |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101571978A (en) * | 2009-01-08 | 2009-11-04 | 深圳市奥拓电子有限公司 | Method for checking up bank accounts |
| CN101609402A (en) * | 2009-07-07 | 2009-12-23 | 中兴通讯股份有限公司 | A kind of file account checking method and system |
| US20120304095A1 (en) * | 2011-05-27 | 2012-11-29 | International Business Machines Corporation | Identity Manager Operations Dashboard |
| US20130046884A1 (en) * | 2011-08-16 | 2013-02-21 | Panduit Corp. | Integrated asset tracking, task manager, and virtual container for data center management |
| CN103177368A (en) * | 2013-04-19 | 2013-06-26 | 中国建设银行股份有限公司 | Reconciliation method and system for electronic commerce system |
-
2015
- 2015-09-15 CN CN201510583111.4A patent/CN105243528A/en active Pending
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101571978A (en) * | 2009-01-08 | 2009-11-04 | 深圳市奥拓电子有限公司 | Method for checking up bank accounts |
| CN101609402A (en) * | 2009-07-07 | 2009-12-23 | 中兴通讯股份有限公司 | A kind of file account checking method and system |
| US20120304095A1 (en) * | 2011-05-27 | 2012-11-29 | International Business Machines Corporation | Identity Manager Operations Dashboard |
| US20130046884A1 (en) * | 2011-08-16 | 2013-02-21 | Panduit Corp. | Integrated asset tracking, task manager, and virtual container for data center management |
| CN103177368A (en) * | 2013-04-19 | 2013-06-26 | 中国建设银行股份有限公司 | Reconciliation method and system for electronic commerce system |
Cited By (36)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105787109A (en) * | 2016-03-22 | 2016-07-20 | 农信银资金清算中心有限责任公司 | Account checking method and device of payment and clearing system |
| CN106022908A (en) * | 2016-05-17 | 2016-10-12 | 中国建设银行股份有限公司 | Method and system for querying information of assets and liabilities |
| CN106127567A (en) * | 2016-06-21 | 2016-11-16 | 国家电网公司 | Enterprise deposits journal account and the account checking method of cash in banks statement and system |
| CN107665460A (en) * | 2016-07-24 | 2018-02-06 | 平安科技（深圳）有限公司 | Accounting method and device based on real-time deal |
| CN106445898B (en) * | 2016-09-07 | 2020-01-10 | 东信和平科技股份有限公司 | Method and system for processing postal envelope data |
| CN106445898A (en) * | 2016-09-07 | 2017-02-22 | 东信和平科技股份有限公司 | Mail cover data processing method and system |
| CN106503420A (en) * | 2016-09-27 | 2017-03-15 | 中电科软件信息服务有限公司 | The multi-party reconciliation assessment of hospital and supervisory systems and method |
| US10866944B2 (en) | 2017-05-22 | 2020-12-15 | Fujitsu Limited | Reconciled data storage system |
| CN109102379B (en) * | 2017-06-21 | 2021-02-09 | 米思米（中国）精密机械贸易有限公司 | Account checking device, account checking server and account checking system |
| CN109102379A (en) * | 2017-06-21 | 2018-12-28 | 米思米（中国）精密机械贸易有限公司 | Account checking apparatus, reconciliation server and reconciliation system |
| CN110019194B (en) * | 2017-09-27 | 2023-03-03 | 腾讯科技（深圳）有限公司 | Data checking method, device, computer equipment and storage medium |
| CN110019194A (en) * | 2017-09-27 | 2019-07-16 | 腾讯科技（深圳）有限公司 | Verification of data method, apparatus, computer equipment and storage medium |
| CN109598602A (en) * | 2017-09-28 | 2019-04-09 | 平安普惠企业管理有限公司 | Account checking method, device, equipment and computer readable storage medium |
| CN107784094A (en) * | 2017-10-17 | 2018-03-09 | 平安科技（深圳）有限公司 | Monetary fund system automation liquidation method, device, equipment and storage medium |
| WO2019075835A1 (en) * | 2017-10-17 | 2019-04-25 | 平安科技（深圳）有限公司 | Automated clearing method, apparatus and device for monetary fund system, and storage medium |
| CN108509392B (en) * | 2018-02-24 | 2022-03-25 | 深圳壹账通智能科技有限公司 | Multi-agency reconciliation method, system, computer equipment and storage medium |
| CN108509392A (en) * | 2018-02-24 | 2018-09-07 | 深圳壹账通智能科技有限公司 | Multimachine structure account checking method, system, computer equipment and storage medium |
| CN110532373A (en) * | 2019-07-17 | 2019-12-03 | 平安科技（深圳）有限公司 | Generation method, device, computer equipment and the storage medium of finance data |
| CN111176802A (en) * | 2019-07-26 | 2020-05-19 | 腾讯科技（深圳）有限公司 | Task processing method and device, electronic equipment and storage medium |
| CN111176802B (en) * | 2019-07-26 | 2023-03-14 | 腾讯科技（深圳）有限公司 | Task processing method and device, electronic equipment and storage medium |
| CN110413428A (en) * | 2019-08-06 | 2019-11-05 | 中国联合网络通信集团有限公司 | Reconciliation data processing method, electronic device and storage medium |
| CN111427918A (en) * | 2020-03-27 | 2020-07-17 | 中国工商银行股份有限公司 | Transaction detail data comparison method and device |
| CN111915429B (en) * | 2020-08-11 | 2021-05-14 | 北京开科唯识技术股份有限公司 | Account checking method and device |
| CN111915429A (en) * | 2020-08-11 | 2020-11-10 | 北京开科唯识技术有限公司 | Account checking method and device |
| CN114372787A (en) * | 2020-10-14 | 2022-04-19 | 腾讯科技（深圳）有限公司 | Business resource processing method and device, electronic equipment and storage medium |
| CN112380199A (en) * | 2020-11-10 | 2021-02-19 | 珠海市新德汇信息技术有限公司 | Big data end-to-end data reconciliation arrangement method |
| CN112541750A (en) * | 2020-12-08 | 2021-03-23 | 中国联合网络通信集团有限公司 | Data processing method, device, equipment and computer readable storage medium |
| CN112541750B (en) * | 2020-12-08 | 2023-06-30 | 中国联合网络通信集团有限公司 | Data processing method, device, equipment and computer readable storage medium |
| CN113191583A (en) * | 2021-03-23 | 2021-07-30 | 中国工商银行股份有限公司 | Account checking file generation method and device |
| CN113591446A (en) * | 2021-06-29 | 2021-11-02 | 四川新网银行股份有限公司 | Configuration reconciliation file generation device |
| CN113591446B (en) * | 2021-06-29 | 2023-11-03 | 四川新网银行股份有限公司 | Configurational account checking file generating device |
| CN113781208A (en) * | 2021-09-22 | 2021-12-10 | 深圳鼎盛电脑科技有限公司 | Operation problem processing system and method based on Internet financial industry |
| CN114925045A (en) * | 2022-04-11 | 2022-08-19 | 杭州半云科技有限公司 | PaaS platform for large data integration and management |
| CN114925045B (en) * | 2022-04-11 | 2024-05-03 | 杭州半云科技有限公司 | PaaS platform for big data integration and management |
| CN114547113A (en) * | 2022-04-26 | 2022-05-27 | 云账户技术(天津)有限公司 | Mass data account checking system, method, network equipment and storage medium |
| CN115984022A (en) * | 2023-03-17 | 2023-04-18 | 梅州客商银行股份有限公司 | Unified account checking method and device for distributed payment system |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN105243528A (en) | Financial IT system graphical centralized reconciliation system and method under big data environment | |
| CN109101652B (en) | Label creating and managing system | |
| US11461294B2 (en) | System for importing data into a data repository | |
| US11163731B1 (en) | Autobuild log anomaly detection methods and systems | |
| US11663033B2 (en) | Design-time information based on run-time artifacts in a distributed computing cluster | |
| Ali et al. | From conceptual design to performance optimization of ETL workflows: current state of research and open problems | |
| US8671084B2 (en) | Updating a data warehouse schema based on changes in an observation model | |
| EP3493050B1 (en) | System for metadata management | |
| US20130166550A1 (en) | Integration of Tags and Object Data | |
| US20190034811A1 (en) | Service layer augmentation of response to semantically-informed query of arbitrary external data sources | |
| US20130166563A1 (en) | Integration of Text Analysis and Search Functionality | |
| CN105719126B (en) | system and method for scheduling Internet big data tasks based on life cycle model | |
| CN115374102A (en) | Data processing method and system | |
| US20140289243A1 (en) | Method and system for centralized issue tracking | |
| CN111752723B (en) | Visual multi-source service management system and implementation method thereof | |
| US20150006469A1 (en) | Methodology supported business intelligence (BI) software and system | |
| US20210174302A1 (en) | Data provisioning system and method | |
| US11567957B2 (en) | Incremental addition of data to partitions in database tables | |
| US20240193176A1 (en) | Cleaning and organizing schemaless semi-structured data for extract, transform, and load processing | |
| US8051110B2 (en) | Identifying screen flows to support multiple entities and their diverse rules with a single application instance | |
| CN108121537A (en) | A kind of software assembly line system and its production method | |
| CN118153931A (en) | Data processing method, device, equipment and storage medium | |
| CN109213909A (en) | A kind of big data analysis system and its analysis method fusion search and calculated | |
| US20250278280A1 (en) | Dynamically generating a reusable process model object for a workflow including multiple conditions and multiple actions | |
| CN109684329A (en) | A kind of method for managing resource based on data center apparatus |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20160113 |