CN105930233B

CN105930233B - To specifying the data of public cloud account to carry out the method and system of automated back-up respectively

Info

Publication number: CN105930233B
Application number: CN201610338692.XA
Authority: CN
Inventors: 徐超
Original assignee: Beijing Spring Technology Co Ltd
Current assignee: Beijing Spring Technology Co Ltd
Priority date: 2016-05-19
Filing date: 2016-05-19
Publication date: 2018-10-16
Anticipated expiration: 2036-05-19
Also published as: CN105930233A

Abstract

The invention discloses a kind of to specifying the data of public cloud account to carry out the method and system of automated back-up respectively, includes the following steps：Publicly-owned cloud storage account and multiple storage devices with wifi functions is specified to bind the account of individual private possession cloud storage system and some；Individual private possession cloud storage system under each catalogue in the publicly-owned cloud storage account subdirectory and file traversed for the first time, and by under respective directories subdirectory and file name data export and preserve into database；Individual private possession cloud storage system by under each catalogue in database subdirectory and file name data generate multiple tasks group and wait for wifi functions storage device active obtaining；After the described storage device networking, according to the subdirectory and filename downloading task data since specifying in publicly-owned cloud storage account automatically under respective directories in current task group.The present invention realizes and backups to different storage devices by the content in specified public cloud account is intelligent automatic respectively.

Description

To specifying the data of public cloud account to carry out the method and system of automated back-up respectively

Technical field

The present invention relates to a kind of to specifying the data of public cloud account to carry out the method and system of automated back-up respectively, belongs to Publicly-owned cloud storage account data redundancy technique field.

Background technology

Cloud storage be in the conceptive extension of cloud computing (cloud computing) and a new concept developed, Refer to being set various types of storage in network by functions such as cluster application, grid or distributed file systems It is standby that collaborative work is gathered by application software, the common system that data storage and Operational Visit function is externally provided. In cloud storage system (i.e. publicly-owned cloud storage account, such as Baidu's Dropbox, 360 cloud disks, Kingsoft fast disk), the data that can store Amount is very big, thus many users share file (such as photo, document etc.) with good friend simultaneously in order to clear up mobile phone EMS memory, often Personal documentum privatum is sent in cloud storage system and is stored.But expose at the same time, and gradually new problem：Than If cloud account is stolen, then the individual privacy of user is likely to be leaked.When therefore, using cloud storage, Information Security Problem becomes the main misgivings of user.It, may be because in addition, after certain vital documents needed for user are uploaded to cloud storage system Cause the audit fails to be deleted in turn for certain reasons, to bring certain loss to user, while causing bad User experience, thus backup in time is carried out to the data in cloud storage system and just shows extremely important.

Storage device, such as mobile hard disk, its memory space is generally also bigger, possesses for individual subscriber, for depositing Lay in the important file of part.If user wants that (including user oneself is uploaded to by mobile phone by file useful in cloud storage system File in cloud storage system and other people be uploaded to cloud storage system and be shared with the file of user) be stored in its mobile hard disk In, then it needs to first pass through computer and downloads file from cloud storage system, be then restored again into mobile hard disk.In addition, if cloud is deposited There is file update in storage system, needs also remain for user and go manual identified and download to be stored in its people's mobile hard disk.In addition, one There may be many different catalogues in the cloud storage system of user, user needs the file under some or certain catalogues is standby respectively In part to some mobile hard disk, the file under other catalogues is backed up in one or more mobile hard disks respectively again, for example, There are aaa, bbb, ccc, ddd, eee, fff totally 6 catalogues in some cloud storage system of user, user needs will be under catalogue aaa File individually backup in X mobile hard disks, the file under catalogue bbb, ccc is individually backuped in Y mobile hard disks, by ddd, File under eee, fff individually backups in Z mobile hard disks.This is also that people urgently want to solve the problems, such as.

Invention content

The object of the present invention is to provide a kind of methods to specifying the data of public cloud account to carry out automated back-up respectively And system, it can effectively solve problems of the prior art, realize the content in specified public cloud account distinguishing intelligence Automated back-up can be changed to different storage devices, ensure that the safety of data.

In order to solve the above technical problems, the present invention adopts the following technical scheme that：A kind of number to specifying public cloud account According to the method for carrying out automated back-up respectively, include the following steps：

S1, by the account of individual private possession cloud storage system and some specify publicly-owned cloud storage account and it is multiple carry wifi work( The storage device of energy is bound；

S2, individual private possession cloud storage system is to the subdirectory and file under each catalogue in the publicly-owned cloud storage account Traversed for the first time, after the completion of traversal, by under respective directories subdirectory and file name data export and preserve into database；

S3, individual private possession cloud storage system by under each catalogue in database subdirectory and file name data generate it is multiple Task groups simultaneously wait for the storage device active obtaining with wifi functions；

S4 obtains task, so after the storage device networking with wifi functions to individual private possession cloud storage system Afterwards according under respective directories in current task group subdirectory and filename automatically since specify publicly-owned cloud storage account under Carry task data.

Preferably, step S1 is specifically included：

S11 accesses the web management interface of each storage device with wifi functions, and utilizes individual private possession cloud storage The account and password of system are logged in；After logging in successfully, each storage device with wifi functions is and individual private possession cloud The account of storage system establishes binding relationship；

S12 is initiated on the web management interface of each storage device with wifi functions to some specified public affairs There is the bind request of cloud storage account；It obtains to access by the opening programming interface (i.e. OpenAPI) of publicly-owned cloud storage system and award Power obtains corresponding mandate key；

S13 by the title of the publicly-owned cloud storage system, authorizes setting for key and storage device with wifi functions Standby number is uploaded to individual private possession cloud storage system and preserves；

S14, individual private possession cloud storage system create multiple and different virtual containers so that each virtual container respectively with institute It states each catalogue in specified publicly-owned cloud storage account and corresponds association, while each virtual container carries wifi work(with each The storage device of energy carries out one-to-one, many-one or one-to-many association.

It is realized the account of individual private possession cloud storage system and publicly-owned cloud storage account by the above method and carries wifi The storage device of function is bound, so as to the storage device realized individual private possession cloud storage system with carry wifi functions Efficient, peace is carried out between publicly-owned cloud storage system and between the storage device with wifi functions and publicly-owned cloud storage system Entirely, the communication stablized；Especially by using different virtual containers respectively with specify publicly-owned cloud storage account in some Or certain several catalogue corresponds association, while each virtual container carries out a pair with each storage device with wifi functions One, many-one or one-to-many association, so as to which more accurate using each virtual container, efficiently cloud storage account is specified in management and control Content backup under middle respective directories and more new task.

In above-mentioned step S14, it can hold to each when individual private possession cloud storage system creates multiple and different virtual containers Device distribute a unique mark, when virtual container with specify publicly-owned cloud storage account in some catalogue and some carry WiFi When the storage device of function is bound, individual private possession cloud storage system can record container unique mark and specify publicly-owned cloud storage The relationship between some catalogue and some storage device with WiFi function and preservation to individual private possession cloud in account are deposited In the database of storage system.

Preferably, step S2 is specifically included：The different virtual containers are to publicly-owned cloud storage account associated there Subdirectory and file in family under respective directories are traversed for the first time, generate data structure (the i.e. catalogue and file of META DATA Structure, further comprise last modification time, file size, MD5 values, whether have been downloaded into the storage with wifi functions The information such as equipment)；After the completion of traversal, by the filename according to it is N number of be one group, after being divided into multiple groups, export as json The data (a variety of computer languages all support it) of format, and preserve into database；Wherein, when traversal, with son Whether catalogue or file name are as index value, using file size, last modification time, MD5 values, be the information such as catalogue as knot The data block of structure body type；So as to optimize management of the personal cloud storage system to backup tasks, convenient for wifi work( The storage device transmission tasks of energy.

Step S3 is specifically included：Data in database are generated multiple tasks by each different virtual container according to grouping Group, and according to grouping acquisition task after storage device networking of the waiting with wifi functions；Storage with wifi functions is set The standby mission bit stream for only downloading a grouping every time, rather than whole mission bit streams, so as to readily available new task, more The performance of new task and the pressure for reducing personal cloud storage platform.

In the above method, after the storage device networking with wifi functions, obtained to individual private possession cloud storage system Task is taken, individual private possession cloud storage system, downloading data backup tasks are then firstly connected to；Wherein, all tasks are all pressed According to it is N number of be one group, per the account information for containing publicly-owned cloud storage system in group task and need from this publicly-owned cloud storage system File name in the catalogue backed up in system.

Preferably, step S4 is specifically included：After storage device networking with wifi functions, the shape of storage device is detected State then initiates task to individual private possession cloud storage system and obtains request, individual private possession cloud storage system inquires if Active With the associated all virtual containers of the equipment, first task groups not being fully completed in virtual container are then handed down to this and are set It is standby；The equipment preserves the number of task definition and grouping, and according to the subdirectory and file under respective directories in current task group Name automatically since specify publicly-owned cloud storage account in downloading task data；The often download or completion one of one file of completion The download of all or part of file of task groups then (carries wifi functions to corresponding virtual container more new task performance Storage device in downloading task, just simultaneously obtain generate the task virtual container unique mark) and storage set Standby remaining free space；If the remaining free space of storage device is less than preset value, the current group obtained is abandoned Follow-up work, and be arranged storage device state be Inactive, stop data synchronization service；Otherwise corresponding virtual container After receiving task update request, corresponding record is searched according to packet numbering and file name in a packet, if finding pair Fetched=1 is then arranged in the file record answered (wherein, each file has corresponded to a fetched value)；Wherein, Fetched is a member for including in META DATA structures, and carrying for user is downloaded to for indicating whether The default value of the storage device of wifi functions, fetched is 0；If not finding corresponding file record, false signals are returned To the storage device for carrying wifi functions, after the storage device with wifi functions receives false signals, abandon having obtained The follow-up work of current group and reacquire first unfinished task groups (this indicates that update occurs in grouped task, because This needs to reacquire grouped task)；After storage device with wifi functions often completes the download of a task groups, ask automatically Next unfinished task groups are sought, until completing the last one does not complete task groups.According to the storage device with wifi functions Hardware performance, the task groups in virtual container can be handled one by one, or simultaneously in multiple virtual containers appoint Business grouping is handled.So as to accurately back up required data from publicly-owned cloud storage account according to data update list, carry The high efficiency of data backup and the operational efficiency of whole system.In addition, setting fetched is to be wrapped in META DATA structures The member contained, consequently facilitating the download performance of label task；In this way when the storage device with wifi functions is next After networking again, unfinished task can be directly downloaded, and without all downloading from the beginning, it alleviates with wifi functions The pressure of storage device, improves data transmission efficiency；It also avoids when local storage space smooth expansion cause simultaneously Data duplication backup the problem of.

In step S4, when detecting the state of storage device, storage device is needed to send its current residual memory space Into individual private possession cloud storage system, individual private possession cloud storage system feeds back it currently according to the size of preset value to storage device State, be Active or Inactive.

When the state of storage device is Inactive, it is also desirable to periodically reacquire its newest state.

Preferably, in method above-mentioned, if the residual memory space of the storage device is less than preset value, accordingly Virtual container sets the state of the storage device to Inactive, which stops simultaneously operating；By to described Storage device delete data be allowed to revert to Active states or by be associated with new storage device to the virtual container or Person's virtual container is by other residual memory spaces associated with it higher than preset value but storage that current state is Inactive After one in equipment is set as Active states, restore data synchronous working；Wherein, virtual container is associated with multiple storage devices When, only it is Active there are one the state of storage device, other are Inactive, to realize when carrying out data synchronization Smooth expansion to local storage space.

In the above method, if the current state of storage device is Active, it is corresponding to it can also to bind new storage device Virtual container, and if the new storage device state be Active, associated upper one with the virtual container The storage device of Active states can be forced to be set as Inactive, then continue data in the new storage device It is synchronous.

It is furthermore preferred that being closed when each virtual container is corresponded with each catalogue specified in publicly-owned cloud storage account When joining, while being associated with each storage device progress many-one with wifi functions, if certain of individual private possession cloud storage system A virtual container execute it is synchronous during when finding that the memory space of the storage device is less than preset value, then the virtual appearance Device sets the relationship of itself and the storage device to Inactive states；Simultaneously individual private possession cloud storage system searches and notify and Other associated virtual containers of the storage device, other virtual containers also set the relationship of itself and the storage device to Inactive states；Data synchronous working stops, until the storage device by delete data switch to Active states or Person will be associated with by being associated with the new storage device with wifi functions to each virtual container or each virtual container Other residual memory spaces be Inactive higher than preset value but current state storage device in one be set as After Active states, continue data synchronous working.It is associated with some storage device so as to quick, unified control All publicly-owned cloud storage card of accounts in data synchronous working progress whether.

Preferably, it after the storage device networking with wifi functions, obtains and appoints to individual private possession cloud storage system Business, then according under respective directories in current task group subdirectory and filename automatically from specify publicly-owned cloud storage account in open Beginning downloading task data specifically include：Parallel processing or serial process；The parallel processing is the storage with wifi functions Equipment first obtains and first task groups data of the associated all virtual containers of this equipment, then carries out multiple files parallel It downloads；The serial process is only to obtain the task groups data of a virtual container every time and carry out file synchronization, has been handled Handle the task data of next virtual container after all grouped tasks of one virtual container successively again.If carrying wifi work( Cpu performance built in the storage device of energy is good, then uses parallel processing, if cpu performance is poor, uses serial process；In addition The read or write speed of storage device also affects the selection of this setting, can be arranged maximum parallel according to different hardware performances Number of tasks.

Data above-mentioned to specified public cloud account carry out in the method for automated back-up respectively, and step S2 further includes：It is a People's private cloud storage system at regular intervals under the catalogue of publicly-owned cloud storage account associated there subdirectory and filename carry out Supplement traversal (interval time of supplement traversal can adjust, give tacit consent to 24 hours primary), and with the subdirectory and text of local cache Part list of file names is compared, and finds out new file, generates download/synchronous task list；It specifically includes：

First, individual private possession cloud storage system loads the json numbers of bibliographic structure from database according to the sequence of grouping According to preserving the structure of arrays in the memory of program, and the array is named as：old；(the element for including in the array It can be retrieved by filename, each element contains a data block, is saved in data block and file name Corresponding MD5 values, file size, last modification time etc. and the relevant information of META DATA)；

Secondly, in the way of traversing for the first time under the publicly-owned each catalogue of cloud storage account subdirectory and filename carry out Supplement traversal, obtains the structure of arrays of newest directory traversal result, and the array is named as：new；(its structure and old phases Together, likewise, the element for including in the array can be retrieved by filename, but each element in the data structure Including fetched values all be 0)；

Again, an element is taken out from old arrays, and element identical with the element files name is searched in new arrays, It is if it is not found, then abandon the element in this old array；If having found corresponding element, two elements of comparison MD5 values or file size and last modification time are (when publicly-owned cloud storage system supports MD5 values, then by comparing MD5 values；When When publicly-owned cloud storage system does not support MD5 values, then the ratio of MD5 values is replaced by documents length and last modification time It is right；Since the file of cloud disk is after downloading/backuping to the storage device with wifi functions, user can delete pair from cloud disk Then the file answered is stored in more new files to cloud disk；Therefore in individual private possession cloud storage system to publicly-owned cloud storage account File will be under the circumstances when being scanned appearance)；If identical, the fetched values of element in old arrays are answered It makes to corresponding element in new arrays；This operation is repeated, until element all in old arrays all takes out；

Finally, after the completion of supplement traversal, the data of new arrays are exported as to the data of json formats from the memory of program, And it is preserved into database with packet mode.

So as to only carry out automatic, backup in time to each publicly-owned newer file of cloud storage account, further increase The efficiency of automatically updating data；In addition, in the above method, after upper primary scanning result is generated as multiple tasks group, There is partial task to have been completed (fetched is equal to 1) in task groups, if these tasks have been in the shape completed State, and corresponding file is not deleted in cloud disk, then it is necessary to according to old times in newest cloud disc file scanning result Business list is to be completed (setting fetched is 1) come the state that task is arranged.Specifically, by the above method, so as to The catalogue and file structure of newest publicly-owned cloud storage are merged with the old data stored in database.If old number (such as being deleted by user) is not present in current publicly-owned cloud storage according to the filename of middle record, then will be These records are deleted in merging process；It, will also be according to the value or file size of MD5 if there is file of the same name in new and old record Judge the whether substantial variation of file with last modification time, if file produces variation, is just labeled as not downloading, it is no The download state of task is just then arranged according to the state of reporter's record.For there was only existing filename in new record, then directly It is set as not downloading.

A kind of system to specifying the data of public cloud account to carry out automated back-up respectively, including：

Binding module, for by the account of individual private possession cloud storage system and some specified publicly-owned cloud storage account and multiple Storage device with wifi functions is bound；

Spider module, for individual private possession cloud storage system to the son under each catalogue in the publicly-owned cloud storage account Catalogue and file are traversed for the first time；

First data export and memory module, after the completion of traversing, by the subdirectory and file concrete number under respective directories According to exporting and preserve into database；

Task generates and distribution module, is used for individual private possession cloud storage system by the subdirectory under each catalogue in database And file name data generates multiple tasks group and waits for the storage device active obtaining with wifi functions；

Automatic download module, after the storage device networking with wifi functions, to individual private possession cloud storage System obtain task, then according under respective directories in current task group subdirectory and filename deposited automatically from specified public cloud It stores up and starts downloading task data in account.

Preferably, the binding module further includes：

Login module, the web management interface for accessing each storage device with wifi functions, and utilize personal private The account and password for having cloud storage system are logged in；After logging in successfully, each storage device with wifi functions i.e. with it is a The account of people's private cloud storage system establishes binding relationship；

Bind request sending module, for the web management interface in each storage device with wifi functions The upper bind request for initiating to specify some publicly-owned cloud storage account；

Access mandate acquisition module, for being obtained by the opening programming interface (i.e. OpenAPI) of publicly-owned cloud storage system Access mandate obtains corresponding mandate key；

Information uploading module, for by the title of the publicly-owned cloud storage system, mandate key and with wifi functions The device numbering of storage device is uploaded to individual private possession cloud storage system and preserves；

Virtual container creates and relating module, and multiple and different virtual containers is created for individual private possession cloud storage system, So that each virtual container is associated with each catalogue one-to-one correspondence specified in publicly-owned cloud storage account respectively, at the same it is each Virtual container carries out one-to-one, many-one or one-to-many association with each storage device with wifi functions.

Preferably, the spider module further includes：

Structure of arrays generation module, for the different virtual containers to publicly-owned cloud storage account associated there Subdirectory and file under middle respective directories are traversed for the first time, generate the data structure of META DATA；

First data export and memory module further includes：

Packet module, for traverse after the completion of, by the filename according to it is N number of be one group, be divided into multiple groups Afterwards, the data of json formats are exported as, and are preserved into database；Wherein, when traversal, using subdirectory or file name as rope Draw value.

Preferably, the automatic download module further includes：

State detection module detects the state of storage device after the storage device networking with wifi functions；

Logging modle initiates task if the state for storage device is Active to individual private possession cloud storage system Obtain request, individual private possession cloud storage system inquire with the associated all virtual containers of the equipment, then will be in virtual container First task groups not being fully completed is handed down to the equipment；The equipment preserves the number of task definition and grouping；

Information feedback module often completes the download of file for the storage device with wifi functions or completes one The download of all or part of file of a task groups, then to corresponding virtual container more new task performance and storage device Remaining free space；

File record is searched and setup module, if the remaining free space for storage device is more than preset value, phase The virtual container answered searches corresponding note in a packet after receiving task update request according to packet numbering and file name Record, if finding corresponding file record, is arranged fetched=1；Wherein, fetched be META DATA structures in include A member, the storage device with wifi functions for indicating whether to be downloaded to user, the acquiescence of fetched Value is 0；If not finding corresponding file record, false signals are returned to the storage device for carrying wifi functions；

Module is abandoned and reacquired to task, after receiving false signals for the storage device with wifi functions, abandons The follow-up work of the current group obtained simultaneously reacquires first unfinished task groups；

The automatic request module of task, after the download that a task groups are often completed for the storage device with wifi functions, Automatically next unfinished task groups are asked, until completing the last one does not complete task groups.

Preferably, the automatic download module further includes：

Setup module, it is when the residual memory space for the storage device is less than preset value, then corresponding virtually to hold Device sets the state of the storage device to Inactive, which stops simultaneously operating；

Processing module, for deleting the storage device, data are allowed to revert to Active states or association is new Storage device to the virtual container or virtual container by other residual memory spaces associated with it higher than preset value but Current state is to restore data synchronous working after one in the storage device of Inactive is set as Active states；Wherein, Only it is Active there are one the state of storage device when carrying out data synchronization when virtual container is associated with multiple storage devices, He is Inactive.

Data above-mentioned to specified public cloud account carry out in the system of automated back-up respectively, and the spider module is also Including：

Supplement traversal and contrast module, for individual private possession cloud storage system periodically to publicly-owned cloud storage associated there Subdirectory and filename under the catalogue of account carry out supplement traversal, and are carried out with the subdirectory of local cache and list of file names It compares, finds out new file, generate download/synchronous task list；

The supplement traversal and contrast module specifically include：

Data load and memory module：It is loaded according to the sequence of grouping from database for individual private possession cloud storage system The json data of bibliographic structure preserve the structure of arrays in the memory of program, and the array are named as：old；

Supplement spider module：For in the way of traversing for the first time to the subdirectory under the publicly-owned each catalogue of cloud storage account And filename carries out supplement traversal, obtains the structure of arrays of newest directory traversal result, and the array is named as：new；

Data comparison module：For taking out an element from old arrays, searched and the element files in new arrays The identical element of name, then abandons the element in this old array if it is not found,；It is right if having found corresponding element Than the MD5 values or file size of two elements and last modification time；If identical, the fetched of element in old arrays Value is copied to corresponding element in new arrays；This operation is repeated, until element all in old arrays all takes out；

Second data export and memory module, after the completion of supplementing traversal, by the data of new arrays from the memory of program The data of json formats are exported as, and are preserved into database with packet mode.

Compared with prior art, the present invention has the following advantages：

1, the present invention is by by the account of individual private possession cloud storage system and some specified publicly-owned cloud storage account and multiple Storage device with wifi functions is bound；Individual private possession cloud storage system is to each in the publicly-owned cloud storage account Subdirectory and file under catalogue are traversed for the first time, after the completion of traversal, by the subdirectory and file name data under respective directories It exports and preserves into database；Individual private possession cloud storage system is by the subdirectory and file concrete number under each catalogue in database According to generation multiple tasks group and wait for the storage device active obtaining with wifi functions；The storage with wifi functions After equipment networking, task is obtained to individual private possession cloud storage system, then according to the specific item under respective directories in current task group Record and filename automatically since specify publicly-owned cloud storage account in downloading task data.To realize specified public cloud account Content in family is intelligent automatic respectively to backup to different storage devices, ensure that the safety of data；And whole process is equal Without user's manual operations, data backup efficiency is higher；

2, by using different virtual containers respectively with specify some or certain several mesh in publicly-owned cloud storage account Record corresponds association, while each virtual container carries out one-to-one, many-one with each storage device with wifi functions Or one-to-many association, so as to which more accurate using each virtual container, efficiently corresponding mesh in cloud storage account is specified in management and control Content backup and more new task under record；

3, individual private possession cloud storage system is periodically to the subdirectory under the catalogue of publicly-owned cloud storage account associated there And filename carries out supplement traversal, and be compared with the subdirectory of local cache and list of file names, new file is found out, is generated Download/synchronous task list, so as to only carry out automatic, backup in time to each publicly-owned newer file of cloud storage account, Further improve the efficiency of automatically updating data；

4, in the present invention, if the residual memory space of the storage device is less than preset value, corresponding virtual container Set the state of the storage device to Inactive, which stops simultaneously operating；By to the storage device Data are deleted to be allowed to revert to Active states or by being associated with new storage device to the virtual container or virtual appearance Other residual memory spaces associated with it are higher than preset value with device but current state is in the storage device of Inactive After one is set as Active states, restore data synchronous working；Wherein, virtual container be associated with multiple storage devices when, into Only it is Active there are one the state of storage device, other are Inactive, to realize to local when row data synchronize The smooth expansion of memory space；

5, it is associated with when each virtual container is corresponded with each catalogue specified in publicly-owned cloud storage account, simultaneously When being associated with each storage device progress many-one with wifi functions, hold if some of individual private possession cloud storage system is virtual Device execute it is synchronous during when finding that the memory space of the storage device is less than preset value, then the virtual container by its with The relationship of the storage device is set as Inactive states；Individual private possession cloud storage system is searched and notifies to set with the storage simultaneously Other standby associated virtual containers, other virtual containers also set the relationship of itself and the storage device to Inactive states； Data, which work asynchronously, to be stopped, until the storage device switchs to Active states or by being associated with newly by deleting data The storage device with wifi functions will be associated with it other remaining to each virtual container or each virtual container After one in the storage device that memory space is higher than preset value but current state is Inactive is set as Active states, after It is continuous to carry out data synchronous working.It is deposited so as to quick, unified control all public clouds associated with some storage device Whether storing up the progress of the data synchronous working in card of accounts.

Description of the drawings

Fig. 1 is a kind of method flow diagram of embodiment of the present invention；

Fig. 2 is the account and Baidu Yun accounts and the storage device with wifi functions of individual private possession cloud storage system The method flow diagram bound；

Fig. 3 is that the storage device with wifi functions executes backup tasks and individual private possession cloud storage system (drop cloud) It was found that having new file in publicly-owned cloud storage and generating the flow chart of backup tasks.

The present invention is further illustrated with reference to the accompanying drawings and detailed description.

Specific implementation mode

The embodiment of the present invention 1：A method of to specifying the data of public cloud account to carry out automated back-up respectively, such as scheme 1, shown in Fig. 3, include the following steps：

S1, by the account of individual private possession cloud storage system and some specify publicly-owned cloud storage account and it is multiple carry wifi work( The storage device of energy is bound；It specifically includes：

S14, individual private possession cloud storage system create multiple and different virtual containers so that each virtual container respectively with institute It states each catalogue in specified publicly-owned cloud storage account and corresponds association, while each virtual container carries wifi work(with each The storage device of energy carries out one-to-one, many-one or one-to-many association；

S2, individual private possession cloud storage system is to the subdirectory and file under each catalogue in the publicly-owned cloud storage account Traversed for the first time, after the completion of traversal, by under respective directories subdirectory and file name data export and preserve into database； It specifically includes：The different virtual containers are to the subdirectory under respective directories in publicly-owned cloud storage account associated there And file is traversed for the first time, generates the data structure of META DATA；After the completion of traversal, it is according to N number of by the filename One group, after being divided into multiple groups, the data of json formats are exported as, and preserve into database；Wherein, when traversal, with specific item Record or file name are as index value；

Step S2 further includes：Individual private possession cloud storage system is periodically to the catalogue of publicly-owned cloud storage account associated there Under subdirectory and filename carry out supplement traversal, and be compared, find out with the subdirectory of local cache and list of file names New file generates download/synchronous task list；It specifically includes：

First, individual private possession cloud storage system loads the json numbers of bibliographic structure from database according to the sequence of grouping According to preserving the structure of arrays in the memory of program, and the array is named as：old；

Secondly, in the way of traversing for the first time under the publicly-owned each catalogue of cloud storage account subdirectory and filename carry out Supplement traversal, obtains the structure of arrays of newest directory traversal result, and the array is named as：new；

Again, an element is taken out from old arrays, and element identical with the element files name is searched in new arrays, It is if it is not found, then abandon the element in this old array；If having found corresponding element, two elements of comparison MD5 values or file size and last modification time；If identical, the fetched values of element in old arrays are copied to new Corresponding element in array；This operation is repeated, until element all in old arrays all takes out；

Finally, after the completion of supplement traversal, the data of new arrays are exported as to the data of json formats from the memory of program, And it is preserved into database with packet mode；

S4 obtains task, so after the storage device networking with wifi functions to individual private possession cloud storage system Afterwards according under respective directories in current task group subdirectory and filename automatically since specify publicly-owned cloud storage account under Carry task data；It specifically includes：After storage device networking with wifi functions, the state of storage device is detected, if Active then initiates task to individual private possession cloud storage system and obtains request, and individual private possession cloud storage system is inquired to be set with this Then first task groups not being fully completed in virtual container are handed down to the equipment by standby associated all virtual containers；It should Equipment preserve task definition and grouping number, and according under respective directories in current task group subdirectory and filename it is automatic The downloading task data since specifying in publicly-owned cloud storage account；Often complete one task groups of download or completion of a file All or part of file download, then can to the corresponding virtual container more residue of new task performance and storage device Use space；If the remaining free space of storage device is less than preset value, the follow-up work of current group obtained is abandoned, And the state that storage device is arranged is Inactive, stops data synchronization service；Otherwise corresponding virtual container is taken office in reception After business update request, corresponding record is searched according to packet numbering and file name in a packet, if finding corresponding file note Record, then be arranged fetched=1；Wherein, fetched is a member for including in META DATA structures, is for expression The default value of the no storage device with wifi functions for having been downloaded into user, fetched is 0；If not finding corresponding File record then returns to false signals to the storage device for carrying wifi functions, and the storage device with wifi functions receives After false signals, abandons the follow-up work of the current group obtained and reacquire first unfinished task groups；Band After having the storage device of wifi functions often to complete the download of a task groups, next unfinished task groups are asked automatically, until It completes the last one and does not complete task groups；If the residual memory space of the storage device is less than preset value, corresponding empty Quasi- container sets the state of the storage device to Inactive, which stops simultaneously operating；By being deposited to described Storage equipment delete data be allowed to revert to Active states or by be associated with new storage device to the virtual container or Virtual container sets the storage that other residual memory spaces associated with it are higher than preset value but current state is Inactive After one in standby is set as Active states, restore data synchronous working；Wherein, virtual container is associated with multiple storage devices When, only it is Active there are one the state of storage device, other are Inactive when carrying out data synchronization.

The binding module further includes：

The spider module further includes：

First data export and memory module further includes：

The automatic download module further includes：

The spider module further includes：

The supplement traversal and contrast module specifically include：

Embodiment 2：A method of to specifying the data of public cloud account to carry out automated back-up respectively, as shown in Figure 1, packet Include following steps：

S4 obtains task, so after the storage device networking with wifi functions to individual private possession cloud storage system Afterwards according under respective directories in current task group subdirectory and filename automatically since specify publicly-owned cloud storage account under Carry task data；It specifically includes：After storage device networking with wifi functions, the state of storage device is detected, if Active then initiates task to individual private possession cloud storage system and obtains request, and individual private possession cloud storage system is inquired to be set with this Then first task groups not being fully completed in virtual container are handed down to the equipment by standby associated all virtual containers；It should Equipment preserve task definition and grouping number, and according under respective directories in current task group subdirectory and filename it is automatic The downloading task data since specifying in publicly-owned cloud storage account；Often complete one task groups of download or completion of a file All or part of file download, then can to the corresponding virtual container more residue of new task performance and storage device Use space；If the remaining free space of storage device is less than preset value, the follow-up work of current group obtained is abandoned, And the state that storage device is arranged is Inactive, stops data synchronization service；Otherwise corresponding virtual container is taken office in reception After business update request, corresponding record is searched according to packet numbering and file name in a packet, if finding corresponding file note Record, then be arranged fetched=1；Wherein, fetched is a member for including in META DATA structures, is for expression The default value of the no storage device with wifi functions for having been downloaded into user, fetched is 0；If not finding corresponding File record then returns to false signals to the storage device for carrying wifi functions, and the storage device with wifi functions receives After false signals, abandons the follow-up work of the current group obtained and reacquire first unfinished task groups；Band After having the storage device of wifi functions often to complete the download of a task groups, next unfinished task groups are asked automatically, until It completes the last one and does not complete task groups.

The binding module further includes：

The spider module further includes：

First data export and memory module further includes：

The automatic download module further includes：

Embodiment 3：A method of to specifying the data of public cloud account to carry out automated back-up, including following step respectively Suddenly：

A kind of operation principle of embodiment of the present invention：As shown in Fig. 2, access respectively with the A disks of wifi functions, B disks, The web management interface of C disks, D disks, E disks, and logged in using the account and password of individual private possession cloud storage system；It logs in into After work(, the A disks, B disks, C disks, D disks, E disks are to establish binding relationship with the account of individual private possession cloud storage system；Institute The A disks stated, B disks, C disks, D disks, E disks web management interface on initiate to specify publicly-owned cloud storage account (such as Baidu to some Yun accounts) bind request；Access mandate is obtained by the opening programming interface (i.e. OpenAPI) of Baidu Yun, obtains phase The mandate key answered；By the title (Baidu Yun) of the publicly-owned cloud storage system, authorize key and A disks, B disks, C disks, D disks, The device numbering of E disks is uploaded to individual private possession cloud storage system and preserves；Individual private possession cloud storage system creates 6 different void Quasi- container, such as S1 virtual containers, S2 virtual containers, S3 virtual containers, S4 virtual containers, S5 virtual containers, S6 virtual containers, and Create following incidence relation：

Aaa catalogues --- S1 virtual containers --- A disks of Baidu Yun accounts

Bbb catalogues --- S2 virtual containers --- B disks of Baidu Yun accounts

Ccc catalogues --- S3 virtual containers --- B disks of Baidu Yun accounts

Ddd catalogues --- S4 virtual containers --- C disks of Baidu Yun accounts

Eee catalogues --- S5 virtual containers --- C disks of Baidu Yun accounts

Fff catalogues --- S6 virtual containers --- the C disks and D disks and E disks of Baidu Yun accounts

Utilize S1 virtual containers, S2 virtual containers, S3 virtual containers, S4 virtual containers, S5 virtual containers, S6 virtual containers The data backup of different directories and more new task in management and control Baidu cloud account respectively, and with mobile hard disk carry out it is one-to-one, one To the association of more or many-one, the data under different directories in specified public cloud account are distinguished into automated back-up to same to realize One or different mobile hard disks in.

In backup procedure, A disks, B disks, C disks constantly can feed back residual memory space to each virtual container, if A disks Residual memory space be less than preset value, then S1 virtual containers set the incidence relation of itself and A disks to Inactive, A disks stop Only back-up job makes it revert to Active states or hard by being associated with new movement until the data by deleting A disks After disk such as F disks to S1 virtual containers, back-up job continues.

Similarly, if in backup procedure, S2 virtual containers receive information --- and the residual memory space of B disks is less than default Value, then S2 virtual containers set the incidence relation of itself and B disks to Inactive, meanwhile, individual private possession cloud storage system is searched Other and the associated virtual container of B disks, find and inform S3 virtual containers, and S3 virtual containers are by the incidence relation of itself and B disks Be set as Inactive, B disks stop back-up job, until the data by deleting B disks, make its revert to Active states or After person is by being associated with new mobile hard disk such as G disks to S2, S3 virtual container, back-up job continues.

And so on, S6 virtual containers are associated 3 C disks, D disks and E disks storage devices, in data synchronization process, It only is in Active states, such as C disks there are one storage device, other 2 are Inactive states.

If in backup procedure, S4 virtual containers receive information --- the residual memory space of C disks is less than preset value, then S4 Virtual container sets the incidence relation of itself and C disks to Inactive, meanwhile, individual private possession cloud storage system searches other and C The associated virtual container of disk, finds and informs S5 virtual containers and S6 virtual containers, S5 virtual containers and S6 virtual containers by its It is also configured as Inactive with the incidence relation of C disks, C disks stop back-up job, until the data by deleting C disks, keep its extensive Be again Active states or by being associated with new mobile hard disk such as H disks to S4, S5, S6 virtual container after, back-up job after It is continuous.Or S6 virtual containers set the state of D disks or E disks to Active, continue synchronous working and (only limit S6 virtually to hold Device).

Claims

1. a kind of method to specifying the data of public cloud account to carry out automated back-up respectively, which is characterized in that including following step Suddenly：

S1, by the account of individual private possession cloud storage system and some specify publicly-owned cloud storage account and multiple with wifi functions Storage device is bound；

S2, individual private possession cloud storage system under each catalogue in the publicly-owned cloud storage account subdirectory and file carry out Traverse for the first time, after the completion of traversal, by under respective directories subdirectory and file name data export and preserve into database；

S3, individual private possession cloud storage system by under each catalogue in database subdirectory and file name data generate multiple tasks Group simultaneously waits for the storage device active obtaining with wifi functions；

S4 obtains task, then root after the storage device networking with wifi functions to individual private possession cloud storage system According under respective directories in current task group subdirectory and filename automatically since specify publicly-owned cloud storage account in download appoint Business data.

2. the method according to claim 1 to specifying the data of public cloud account to carry out automated back-up respectively, feature It is, step S1 is specifically included：

S11 accesses the web management interface of each storage device with wifi functions, and utilizes individual private possession cloud storage system Account and password logged in；After logging in successfully, each storage device with wifi functions is and individual private possession cloud storage The account of system establishes binding relationship；

S12 initiates to specify public cloud to some on the web management interface of each storage device with wifi functions Store the bind request of account；Access mandate is obtained by the opening programming interface of publicly-owned cloud storage system, acquisition is awarded accordingly Weigh key；

S13 by the title of the publicly-owned cloud storage system, authorizes the equipment of key and storage device with wifi functions to compile It number is uploaded to individual private possession cloud storage system and preserves；

S14, individual private possession cloud storage system create multiple and different virtual containers so that each virtual container respectively with the finger Each catalogue in fixed publicly-owned cloud storage account corresponds association, at the same each virtual container with each with wifi functions Storage device carries out one-to-one, many-one or one-to-many association.

3. the method according to claim 2 to specifying the data of public cloud account to carry out automated back-up respectively, feature It is, step S2 is specifically included：The different virtual containers are to corresponding mesh in publicly-owned cloud storage account associated there Subdirectory and file under record are traversed for the first time, generate the data structure of META DATA；After the completion of traversal, by the text Part name according to it is N number of be one group, after being divided into multiple groups, export as the data of json formats, and preserve into database；Wherein, When traversal, using subdirectory or file name as index value.

4. the method according to claim 3 to specifying the data of public cloud account to carry out automated back-up respectively, feature It is, step S4 is specifically included：After storage device networking with wifi functions, the state of storage device is detected, if Active then initiates task to individual private possession cloud storage system and obtains request, and individual private possession cloud storage system is inquired to be set with this Then first task groups not being fully completed in virtual container are handed down to the equipment by standby associated all virtual containers；It should Equipment preserve task definition and grouping number, and according under respective directories in current task group subdirectory and filename it is automatic The downloading task data since specifying in publicly-owned cloud storage account；Often complete one task groups of download or completion of a file All or part of file download, then can to the corresponding virtual container more residue of new task performance and storage device Use space；If the remaining free space of storage device is less than preset value, the follow-up work of current group obtained is abandoned, And the state that storage device is arranged is Inactive, stops data synchronization service；Otherwise corresponding virtual container is taken office in reception After business update request, corresponding record is searched according to packet numbering and file name in a packet, if finding corresponding file note Record, then be arranged fetched=1；Wherein, fetched is a member for including in META DATA structures, is for expression The default value of the no storage device with wifi functions for having been downloaded into user, fetched is 0；If not finding corresponding File record then returns to false signals to the storage device for carrying wifi functions, and the storage device with wifi functions receives After false signals, abandons the follow-up work of the current group obtained and reacquire first unfinished task groups；Band After having the storage device of wifi functions often to complete the download of a task groups, next unfinished task groups are asked automatically, until It completes the last one and does not complete task groups.

5. the method according to claim 4 to specifying the data of public cloud account to carry out automated back-up respectively, feature It is, if the residual memory space of the storage device is less than preset value, corresponding virtual container is by the storage device State is set as Inactive, which stops simultaneously operating；It is allowed to extensive by deleting data to the storage device It is Active states again or will be associated with it to the virtual container or virtual container by being associated with new storage device One in the storage device that other residual memory spaces are higher than preset value but current state is Inactive is set as After Active states, restore data synchronous working；Wherein, when virtual container is associated with multiple storage devices, data synchronization is being carried out When, only it is Active there are one the state of storage device, other are Inactive.

6. according to claim 3~5 any one of them to specifying the data of public cloud account to carry out the side of automated back-up respectively Method, which is characterized in that step S2 further includes：Individual private possession cloud storage system is periodically to publicly-owned cloud storage account associated there Catalogue under subdirectory and filename carry out supplement traversal, and compared with the subdirectory of local cache and list of file names It is right, new file is found out, download/synchronous task list is generated；It specifically includes：

First, individual private possession cloud storage system loads the json data of bibliographic structure from database according to the sequence of grouping, Corresponding structure of arrays is preserved in the memory of program, and the array is named as：old；

Secondly, in the way of traversing for the first time under the publicly-owned each catalogue of cloud storage account subdirectory and filename supplement Traversal, obtains the structure of arrays of newest directory traversal result, and the array is named as：new；

Again, an element is taken out from old arrays, and element identical with the element files name is searched in new arrays, if It does not find, then abandons the element in this old array；If having found corresponding element, the MD5 values of two elements are compared Or file size and last modification time；If identical, the fetched values of element in old arrays are copied in new arrays Corresponding element；This operation is repeated, until element all in old arrays all takes out；

Finally, after the completion of supplement traversal, the data of new arrays export as to the data of json formats from the memory of program, and with Packet mode is preserved into database.

7. a kind of system to specifying the data of public cloud account to carry out automated back-up respectively, which is characterized in that including：

Binding module, for the account of individual private possession cloud storage system to be specified publicly-owned cloud storage account with some and multiple is carried The storage device of wifi functions is bound；

Spider module, for individual private possession cloud storage system to the subdirectory under each catalogue in the publicly-owned cloud storage account And file is traversed for the first time；

First data export and memory module, for traverse after the completion of, by under respective directories subdirectory and file name data lead Go out and preserves into database；

Task generates and distribution module, is used for individual private possession cloud storage system by the subdirectory and text under each catalogue in database Part name data generate multiple tasks group and wait for the storage device active obtaining with wifi functions；

Automatic download module, after the storage device networking with wifi functions, to individual private possession cloud storage system Acquisition task, then according under respective directories in current task group subdirectory and filename automatically from specified publicly-owned cloud storage account Start downloading task data in family.

8. the system according to claim 7 to specifying the data of public cloud account to carry out automated back-up respectively, feature It is, the binding module further includes：

Login module, the web management interface for accessing each storage device with wifi functions, and utilize individual private possession cloud The account and password of storage system are logged in；After logging in successfully, each storage device with wifi functions is i.e. private with individual There is the account of cloud storage system to establish binding relationship；

Bind request sending module, for being sent out on the web management interface of each storage device with wifi functions Play the bind request that publicly-owned cloud storage account is specified to some；

Access mandate acquisition module obtains phase for obtaining access mandate by the opening programming interface of publicly-owned cloud storage system The mandate key answered；

Information uploading module, for by the title of the publicly-owned cloud storage system, authorize key and storage with wifi functions The device numbering of equipment is uploaded to individual private possession cloud storage system and preserves；

Virtual container creates and relating module, and multiple and different virtual containers is created for individual private possession cloud storage system so that Each virtual container is associated with each catalogue one-to-one correspondence specified in publicly-owned cloud storage account respectively, while each virtual Container carries out one-to-one, many-one or one-to-many association with each storage device with wifi functions.

9. the system according to claim 8 to specifying the data of public cloud account to carry out automated back-up respectively, feature It is, the spider module further includes：

Data structure building module, for the different virtual containers to phase in publicly-owned cloud storage account associated there It answers subdirectory and file under catalogue to be traversed for the first time, generates the data structure of META DATA；

First data export and memory module further includes：

Packet module, for traverse after the completion of, by the filename according to it is N number of be one group, after being divided into multiple groups, lead Go out for the data of json formats, and preserves into database；Wherein, when traversal, using subdirectory or file name as index value.

10. the system according to claim 9 to specifying the data of public cloud account to carry out automated back-up respectively, feature It is, the automatic download module further includes：

Logging modle is initiated task to individual private possession cloud storage system and is obtained if the state for storage device is Active Request, individual private possession cloud storage system inquire with the associated all virtual containers of the equipment, then by virtual container first A task groups not being fully completed are handed down to the equipment；The equipment preserves the number of task definition and grouping；

Information feedback module, often completes the download of file for the storage device with wifi functions or completes one to appoint The download of all or part of file of business group, then to the surplus of corresponding virtual container more new task performance and storage device Remaining free space；

File record is searched and setup module, if the remaining free space for storage device is more than preset value, accordingly Virtual container searches corresponding record in a packet after receiving task update request according to packet numbering and file name, If finding corresponding file record, fetched=1 is set；Wherein, fetched is include one in META DATA structures A member, the storage device with wifi functions for indicating whether to be downloaded to user, the default value of fetched are 0；

If not finding corresponding file record, false signals are returned to the storage device for carrying wifi functions；

Module is abandoned and reacquired to task, after receiving false signals for the storage device with wifi functions, abandons The follow-up work of the current group of acquisition simultaneously reacquires first unfinished task groups；

11. the system according to claim 10 to specifying the data of public cloud account to carry out automated back-up respectively, special Sign is that the automatic download module further includes：

Setup module, when the residual memory space for the storage device is less than preset value, then corresponding virtual container will The state of the storage device is set as Inactive, which stops simultaneously operating；

Processing module, for being allowed to revert to Active states to the storage device deletion data or being associated with new deposit Store up equipment to the virtual container or virtual container by other residual memory spaces associated with it higher than preset value but currently State is to restore data synchronous working after one in the storage device of Inactive is set as Active states；Wherein, virtually Only it is Active there are one the state of storage device, other are when carrying out data synchronization when container is associated with multiple storage devices For Inactive.

12. according to claim 9~11 any one of them to specifying the data of public cloud account to carry out difference automated back-up System, which is characterized in that the spider module further includes：

Supplement traversal and contrast module, for individual private possession cloud storage system periodically to publicly-owned cloud storage account associated there Catalogue under subdirectory and filename carry out supplement traversal, and compared with the subdirectory of local cache and list of file names It is right, new file is found out, download/synchronous task list is generated；

The supplement traversal and contrast module specifically include：

Data load and memory module：For individual private possession cloud storage system catalogue is loaded according to the sequence of grouping from database The json data of structure preserve corresponding structure of arrays in the memory of program, and the array are named as：old；

Supplement spider module：For in the way of traversing for the first time to the subdirectory and text under the publicly-owned each catalogue of cloud storage account Part name carries out supplement traversal, obtains the structure of arrays of newest directory traversal result, and the array is named as：new；

Data comparison module：For taking out an element from old arrays, searched and element files famous prime minister in new arrays Same element, then abandons the element in this old array if it is not found,；If having found corresponding element, two are compared The MD5 values or file size of a element and last modification time；If identical, the fetched values of element in old arrays are answered It makes to corresponding element in new arrays；This operation is repeated, until element all in old arrays all takes out；

Second data export and memory module, and after the completion of supplementing traversal, the data of new arrays are exported from the memory of program For the data of json formats, and preserved into database with packet mode.