CN105930233A - Method and system for automatically backing up data of specified public cloud account - Google Patents
Method and system for automatically backing up data of specified public cloud account Download PDFInfo
- Publication number
- CN105930233A CN105930233A CN201610338692.XA CN201610338692A CN105930233A CN 105930233 A CN105930233 A CN 105930233A CN 201610338692 A CN201610338692 A CN 201610338692A CN 105930233 A CN105930233 A CN 105930233A
- Authority
- CN
- China
- Prior art keywords
- data
- storage device
- account
- cloud storage
- publicly
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F11/00—Error detection; Error correction; Monitoring
- G06F11/07—Responding to the occurrence of a fault, e.g. fault tolerance
- G06F11/14—Error detection or correction of the data by redundancy in operation
- G06F11/1402—Saving, restoring, recovering or retrying
- G06F11/1446—Point-in-time backing up or restoration of persistent data
- G06F11/1448—Management of the data involved in backup or backup restore
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
- G06F3/0601—Interfaces specially adapted for storage systems
- G06F3/0602—Interfaces specially adapted for storage systems specifically adapted to achieve a particular effect
- G06F3/0614—Improving the reliability of storage systems
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
- G06F3/0601—Interfaces specially adapted for storage systems
- G06F3/0628—Interfaces specially adapted for storage systems making use of a particular technique
- G06F3/0646—Horizontal data movement in storage systems, i.e. moving data in between storage devices or systems
- G06F3/065—Replication mechanisms
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
- G06F3/0601—Interfaces specially adapted for storage systems
- G06F3/0668—Interfaces specially adapted for storage systems adopting a particular infrastructure
- G06F3/067—Distributed or networked storage systems, e.g. storage area networks [SAN], network attached storage [NAS]
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Human Computer Interaction (AREA)
- Quality & Reliability (AREA)
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
Abstract
The invention discloses a method and a system for automatically backing up data of a specified public cloud account. The method comprises the following steps: binding an account of a personal private cloud storage system with a certain specified public cloud storage account and a plurality of pieces of storage equipment with WIFI (Wireless Fidelity) functions; performing first traversing on subdirectories under different directories and files in the public cloud storage account by the personal private cloud storage system, exporting the subdirectories under corresponding directories and file name data, and saving the exported subdirectories and the file name data in a database; generating a plurality of task groups according to the subdirectories under the directories and the file name data in the database by the personal private cloud storage system, and waiting for the storage equipment with the WIFI functions to perform active acquisition; and after the storage equipment is networked, automatically starting to download task data from the specified public cloud storage account according to the subdirectories under the directories and the file names in a current task group. Through adoption of the method and the system, content in the specified public cloud account is intelligently and automatically backed up in different storage equipment.
Description
Technical field
The present invention relates to a kind of data to specifying publicly-owned cloud account and carry out the method and system of automated back-up respectively, belong to publicly-owned
Cloud storage account data redundancy technique field.
Background technology
Cloud storage is in cloud computing (cloud computing) conceptive extension and a new concept developed, refers to
By functions such as cluster application, grid or distributed file systems, storage device various types of in network is led to
Cross application software and gather collaborative work, the common system that data storage and Operational Visit function are externally provided.At cloud
In storage system (the most publicly-owned cloud storage account, such as Baidu's Dropbox, 360 cloud disks, Kingsoft fast disk etc.), the data that can store
Amount is very big, thus a lot of user shares file (such as photo, document etc.) with good friend, often to clear up mobile phone EMS memory simultaneously
The documentum privatum of individual can be sent and store to cloud storage system.But meanwhile, the most gradually expose new asking
Topic: such as cloud account is stolen, then the individual privacy of user is likely to will be compromised.Therefore, when using cloud storage, number
The main misgivings of user are become according to safety issue.It addition, some vital document needed for user is uploaded to cloud storage system
After, may because of some former thus result in examination & verification not by so that be deleted, thus bring certain loss to user, with
The Consumer's Experience that Shi Zaocheng is bad, thus the data in cloud storage system are backed up in time extremely important with regard to show.
Storage device, such as portable hard drive, its memory space is the biggest, has for individual subscriber, is used for storing standby
The file that part is important.If user wants (file useful in cloud storage system being included, user oneself is uploaded to cloud by mobile phone and deposits
File in storage system and other people be uploaded to cloud storage system and be shared with the file of user) be stored in its portable hard drive, then
Need to first pass through computer to be downloaded from cloud storage system by file, portable hard drive of then restoring.If additionally, cloud storage system
System there is file update, need also remain for user and go artificial cognition download to be stored in its people's portable hard drive.Additionally, a use
May have the most different catalogues in the cloud storage system at family, user needs to back up the file under certain or some catalogues respectively
In some portable hard drive, the file under other catalogues is backed up to the most respectively in one or more portable hard drive, such as,
Having aaa, bbb, ccc, ddd, eee, fff totally 6 catalogues in certain cloud storage system of user, user needs catalogue
File under aaa individually backups to, in X portable hard drive, the file under catalogue bbb, ccc individually be backuped to Y portable hard drive
In, the file under ddd, eee, fff is individually backuped in Z portable hard drive.This is also that people urgently want solve to ask
Topic.
Summary of the invention
It is an object of the invention to, it is provided that a kind of data to specifying publicly-owned cloud account carry out the method for automated back-up respectively and are
System, it can effectively solve problems of the prior art, it is achieved the content intellectuality respectively that will specify in publicly-owned cloud account
Automated back-up is to different storage devices, it is ensured that the safety of data.
For solving above-mentioned technical problem, the present invention adopts the following technical scheme that: a kind of data to specifying publicly-owned cloud account are entered
The method of row automated back-up respectively, comprises the following steps:
S1, specifies publicly-owned cloud storage account with certain and multiple with wifi function by the account of individual private possession cloud storage system
Storage device is bound;
S2, the subdirectory under each catalogue in described publicly-owned cloud storage account and file are carried out by individual private possession cloud storage system
Travel through first, after having traveled through, the subdirectory under respective directories and file name data are derived and preserved to data base;
S3, the subdirectory under each catalogue in data base and file name data are generated multiple tasks by individual private possession cloud storage system
Group also waits the storage device active obtaining with wifi function;
S4, after the described storage device with wifi function is networked, obtains task to individual private possession cloud storage system, then
Automatically start to download from the publicly-owned cloud storage account of appointment according to the subdirectory under respective directories in current task group and filename and appoint
Business data.
Preferably, step S1 specifically includes:
S11, accesses each web management interface with the storage device of wifi function, and utilizes individual private possession cloud storage system
Account and the password of system log in;After logging in successfully, each is i.e. deposited with individual private possession cloud with the storage device of wifi function
The account of storage system establishes binding relationship;
S12, initiates certain appointment publicly-owned on each described web management interface with the storage device of wifi function
The bind request of cloud storage account;Obtain access by the open DLL (i.e. OpenAPI) of publicly-owned cloud storage system to award
Power, it is thus achieved that authorize key accordingly;
S13, by the title of described publicly-owned cloud storage system, authorizes key and the equipment with the storage device of wifi function to compile
Number it is uploaded to individual private possession cloud storage system and preserves;
S14, individual private possession cloud storage system create multiple different virtual containers so that each virtual container respectively with described finger
Each catalogue one_to_one corresponding association in fixed publicly-owned cloud storage account, simultaneously each virtual container with each with wifi function
Storage device is carried out one to one, many-one or one-to-many association.
Realized by the account of individual private possession cloud storage system and publicly-owned cloud storage account and with wifi function by said method
Storage device is bound, such that it is able to realize individual private possession cloud storage system with the storage device of wifi function and publicly-owned
Carry out efficient, safe, steady between storage device and publicly-owned cloud storage system between cloud storage system and with wifi function
Fixed communication;Especially by utilize different virtual containers respectively with some specified in publicly-owned cloud storage account or a few
Individual catalogue one_to_one corresponding associates, simultaneously each virtual container carry out one to one with the storage device of wifi function with each, many
One or one-to-many are associated, such that it is able to utilize each virtual container more accurately, management and control efficiently specify phase in cloud storage account
Answer the content backup under catalogue and more new task.
In above-mentioned step S14, divide can to when individual private possession cloud storage system creates multiple different virtual container each container
Join a unique mark, when virtual container and certain catalogue specified in publicly-owned cloud storage account and certain is with WiFi function
Storage device when binding, individual private possession cloud storage system can record container and uniquely identify and specify publicly-owned cloud storage account
In certain catalogue and certain storage device with WiFi function between relation and preserve to individual private possession cloud storage system
Data base in.
Preferably, step S2 specifically includes: described different virtual container is in publicly-owned cloud storage account associated there
Subdirectory and file under respective directories travel through first, generate data structure (i.e. catalogue and the file of META DATA
Structure, further comprises last modification time, file size, MD5 value, whether have been downloaded into wifi function
The information such as storage device);After having traveled through, by described filename according to N number of be one group, after being divided into multiple groups, derive
For the data (it is all supported by multiple computer language) of json form, and preserve to data base;Wherein, traversal
Time, using subdirectory or file name as index value, with file size, last modification time, MD5 value, whether be catalogue
Etc. information as the data block of structure type;Such that it is able to optimize individual's cloud storage system management to backup tasks, it is simple to
To the storage device transmission tasks with wifi function.
Step S3 specifically includes: the data in data base are generated multiple task groups according to packet by each different virtual container,
And according to being grouped acquisition task after waiting the storage device networking with wifi function;Storage device with wifi function is every
Secondary the mission bit stream downloading a packet rather than whole mission bit streams, such that it is able to readily available new task, renewal
The performance of task and the pressure of reduction individual's cloud storage platform.
In said method, after the described storage device with wifi function is networked, obtain to individual private possession cloud storage system and appoint
Business, is then firstly connected to individual private possession cloud storage system, downloads data backup task;Wherein, all of task is all according to N
Individual is one group, all contains the account information of publicly-owned cloud storage system and need from this publicly-owned cloud storage system in every group task
File name in the catalogue of backup.
Preferably, step S4 specifically includes: after the storage device networking with wifi function, the state of detection storage device,
If Active, then initiating task to individual private possession cloud storage system and obtain request, individual private possession cloud storage system inquires and is somebody's turn to do
All virtual containers of equipment association, are then handed down to this equipment by virtual container first task groups not being fully completed;
This equipment preserves task definition and the numbering of packet, and according to the subdirectory under respective directories in current task group and filename from
Dynamic from specifying beginning downloading task data publicly-owned cloud storage account;Often complete the download of a file or complete a task
The download of all or part of file of group, then to corresponding virtual container more new task performance (with depositing of wifi function
Storage equipment, when downloading task, obtains unique mark of the virtual container generating this task the most simultaneously) and storage device
Residue free space;If the residue free space of storage device is less than preset value, then after abandoning the current group obtained
Continue task, and the state arranging storage device is Inactive, stop data synchronization service;Otherwise corresponding virtual container is connecing
After the task that receives is more newly requested, search the record of correspondence in a packet according to packet numbering and file name, if finding correspondence
File record, then arrange fetched=1 (wherein, each file corresponding a fetched value);Wherein,
Fetched is the member comprised in META DATA structure, for indicate whether to be downloaded to user with
The storage device of wifi function, the default value of fetched is 0;If not finding the file record of correspondence, then return false signal
To with the storage device of wifi function, after receiving false signal with the storage device of wifi function, abandon having obtained
The follow-up work of current group and reacquire first task groups being not fully complete (this represents that grouped task occurs in that renewal, because of
This needs to reacquire grouped task);Often complete the download of a task groups with the storage device of wifi function after, automatically please
The next one is asked to be not fully complete task groups, until completing last to be not fully complete task groups.According to the storage device with wifi function
Hardware performance, can one by one the task groups in virtual container be processed, or simultaneously in multiple virtual containers appoint
Business packet processes.Such that it is able to update list according to data to back up desired data accurately from publicly-owned cloud storage account, carry
The efficiency of high data backup and the operational efficiency of whole system.Additionally, arranging fetched is in META DATA structure
The member comprised, consequently facilitating the download performance of labelling task;So when under the storage device with wifi function
After secondary networking again, being not fully complete of task can be directly downloaded, and need not start anew all to download, alleviate with wifi merit
The pressure of the storage device of energy, improves data transmission efficiency;It also avoid when carrying out locally stored space smoothing dilatation simultaneously
The problem of the Data duplication backup caused.
In step S4, when detecting the state of storage device, storage device is needed to send its current residual memory space to individual
In people's private cloud storage system, individual private possession cloud storage system feeds back its current shape according to the size of preset value to storage device
State, for Active or Inactive.
When the state of storage device is Inactive, it is also desirable to periodically reacquire its up-to-date state.
Preferably, in aforesaid method, if the residual memory space of described storage device is less than preset value, the most virtual
The state of this storage device is set to Inactive by container, and this storage device stops simultaneously operating;By described storage is set
Standby data of deleting are allowed to revert to Active state or by the new storage device of association to this virtual container or virtual
Container by other residual memory space associated with it higher than in preset value but storage device that current state is Inactive
Individual be set to Active state after, recover data syn-chronization work;Wherein, when virtual container associates multiple storage device, entering
During row data syn-chronization, the state of only one of which storage device is Active, and other are Inactive, it is achieved thereby that to this locality
The smooth expansion of memory space.
In said method, if the current state of storage device is Active, it is possible to bind new storage device the most virtual to it
Container, and if the state of this new storage device be Active, then the upper Active associated with this virtual container
The storage device of state can be forced to be set to Inactive, then proceeds data syn-chronization in the storage device that this is new.
It is furthermore preferred that when each catalogue one_to_one corresponding in each virtual container cloud storage publicly-owned with described appointment account associates, with
Time with each with the storage device of wifi function carry out many-one associate time, if certain of individual private possession cloud storage system is virtual
Container finds the memory space of described storage device less than preset value during performing to synchronize time, then this virtual container is by it
It is set to Inactive state with the relation of this storage device;Individual private possession cloud storage system is searched and is notified to set with this storage simultaneously
Other virtual containers of standby association, its relation with this storage device is also set to Inactive state by other virtual containers;Number
According to synchronous working stop, until described storage device by delete data transfer to Active state or by association new
Other residue associated with it is deposited by the storage device with wifi function to each virtual container or each virtual container
After storage space is set to Active state higher than in preset value but storage device that current state is Inactive, continue
Carry out data syn-chronization work.Such that it is able to all publicly-owned cloud storage that quick, unified control is associated with certain storage device
Whether the carrying out of the data syn-chronization work in card of accounts.
Preferably, after the described storage device with wifi function is networked, obtain task to individual private possession cloud storage system,
Then under automatically starting from the publicly-owned cloud storage account of appointment according to the subdirectory under respective directories in current task group and filename
Load task data specifically includes: parallel processing or serial process;Described parallel processing is i.e. with the storage device of wifi function
First obtain first task groups data of all virtual containers associated with this equipment, carry out the most parallel under multiple file
Carry;Described serial process the most only obtains the task groups data of a virtual container and carries out file synchronization, has processed one
The task data of next virtual container is processed the most successively after all grouped task of individual virtual container.If with wifi function
The built-in cpu performance of storage device good, then use parallel processing, if cpu performance is poor, then use serial process;
Additionally the read or write speed of storage device also have impact on this selection arranged, and can arrange maximum according to different hardware performances
Parallel number of tasks.
The aforesaid data to specifying publicly-owned cloud account are carried out in the method for automated back-up respectively, and step S2 also includes: individual is private
There is cloud storage system that the subdirectory under the catalogue of publicly-owned cloud storage account associated there and filename periodically carry out supplementary time
Go through (interval time supplementing traversal can adjust, and gives tacit consent to 24 hours once), and rank with subdirectory and the file of local cache
Table is compared, and finds out new file, generates the list of download/synchronous task;Specifically include:
First, individual private possession cloud storage system loads the json data of bibliographic structure from data base according to the order being grouped,
The internal memory of program preserves this structure of arrays, and by named for this array: old;(element comprised in described array can lead to
Crossing filename to retrieve, each element contains a data block, saves corresponding with file name in data block
The information relevant to META DATA such as MD5 value, file size, last modification time);
Secondly, according to the mode traveled through first, the subdirectory under publicly-owned each catalogue of cloud storage account and filename are supplemented
Traversal, it is thus achieved that the structure of arrays of up-to-date directory traversal result, and by named for this array: new;(its structure and old phase
With, same, the element comprised in this array can be retrieved by filename, but each unit in this data structure
The fetched value that element comprises is all 0);
Again, from old array, take out an element, new array searched the element identical with this element files name,
Without finding, then abandon this element in this old array;If have found the element of correspondence, then contrast two elements
MD5 value or file size and last modification time are (when publicly-owned cloud storage system supports MD5 value, then by contrast MD5
Value;When publicly-owned cloud storage system does not support MD5 value, then replaced by documents length and last modification time
The comparison of MD5 value;After once downloading/backup to the storage device with wifi function due to the file of cloud disk, user can be from
Delete the file of correspondence in cloud disk, be then stored in more new file to cloud disk;Therefore at individual private possession cloud storage system to public affairs
Will appearance under the circumstances when having cloud storage account files to be scanned);If it is identical, then element in old array
Fetched value be copied in new array correspondence element;Repeat this operation, until all of element all takes in old array
Go out;
Finally, after supplementary traversal completes, the data of new array are exported as from the internal memory of program the data of json form, and
Preserve to data base with packet mode.
Such that it is able to only to each publicly-owned cloud storage account update file carry out automatic, back up in time, further increase number
According to the efficiency automatically updated;Additionally, in said method, after upper once scanning result is generated as multiple task groups, in office
Business group there is partial task have been completed (fetched is equal to 1), if these tasks are already at the shape completed
State, and file corresponding in cloud disk is not deleted, then it is necessary to according to old in up-to-date cloud disc file scanning result
Task list arranges the state of task for complete (arranging fetched is 1).Specifically, by said method, thus
The catalogue of up-to-date publicly-owned cloud storage and file structure can be merged with the old data of storage in data base.If it is old
In legacy data there is not (such as being deleted by user) in the filename of record in current publicly-owned cloud storage, then just
These records are deleted in merging process;If there being file of the same name in new and old record, also will be according to the value of MD5 or literary composition
Part length and last modification time judge the most substantial change of file, if file creates change, are just labeled as not
Download, the download state of task is the most just set according to the state of reporter's record.For the file existed in only new record
Name, then be directly disposed as not downloading.
A kind of data to specifying publicly-owned cloud account carry out the system of automated back-up respectively, including:
Binding module, for by the account of individual private possession cloud storage system with certain specify publicly-owned cloud storage account and multiple with
The storage device of wifi function is bound;
Spider module, for individual private possession cloud storage system to the subdirectory under each catalogue in described publicly-owned cloud storage account
And file travels through first;
First data derive and memory module, after traversal completes, the subdirectory under respective directories and file name data are led
Go out and preserve to data base;
Task generates and distribution module, for individual private possession cloud storage system by the subdirectory under each catalogue in data base and literary composition
The multiple task groups of part name data genaration also waits the storage device active obtaining with wifi function;
Automatically download module, after the described storage device with wifi function is networked, to individual private possession cloud storage system
Acquisition task, then according to the subdirectory under respective directories in current task group and filename automatically from specifying publicly-owned cloud storage account
Family starts downloading task data.
Preferably, described binding module also includes:
Login module, for accessing each web management interface with the storage device of wifi function, and utilizes individual private possession
Account and the password of cloud storage system log in;After logging in successfully, each with wifi function storage device i.e. with individual
The account of private cloud storage system establishes binding relationship;
Bind request sending module, for sending out on each described web management interface with the storage device of wifi function
Play the bind request to certain publicly-owned cloud storage account of appointment;
Access and authorize acquisition module, visit for being obtained by the open DLL (i.e. OpenAPI) of publicly-owned cloud storage system
Ask mandate, it is thus achieved that authorize key accordingly;
Transmission module in information, for by the title of described publicly-owned cloud storage system, mandate key and depositing with wifi function
The device numbering of storage equipment is uploaded to individual private possession cloud storage system and preserves;
Virtual container creates and relating module, creates multiple different virtual containers for individual private possession cloud storage system so that
Each catalogue one_to_one corresponding in each virtual container cloud storage account publicly-owned with described appointment respectively associates, and each is virtual simultaneously
Container is carried out one to one with the storage device of wifi function with each, many-one or one-to-many associate.
Preferably, described spider module also includes:
Structure of arrays generation module, for described different virtual container to phase in publicly-owned cloud storage account associated there
Answer the subdirectory under catalogue and file to travel through first, generate the data structure of META DATA;
First data derive and memory module also includes:
Packet module, after traversal completes, by described filename according to N number of be one group, be divided into multiple groups
After, export as the data of json form, and preserve to data base;Wherein, during traversal, it is referred to as with subdirectory or filename
For index value.
Preferably, described automatic download module also includes:
State detection module, after networking with the storage device of wifi function, the state of detection storage device;
Logging modle, if the state for storage device is Active, then initiating task acquisition to individual private possession cloud storage system please
Asking, individual private possession cloud storage system inquires all virtual containers associated with this equipment, then by virtual container first
The task groups not being fully completed is handed down to this equipment;This equipment preserves task definition and the numbering of packet;
Information feedback module, for often completing the download of a file or completing one with the storage device of wifi function
The download of all or part of file of business group, then surplus to corresponding virtual container more new task performance and storage device
Remaining free space;
File record is searched and arranges module, if when the residue free space of storage device is more than preset value, the most accordingly
Virtual container, after the task that receives is more newly requested, searches the record of correspondence in a packet according to packet numbering and file name,
If finding the file record of correspondence, then fetched=1 is set;Wherein, fetched comprises in being META DATA structure
A member, for indicating whether to be downloaded to the storage device with wifi function of user, the acquiescence of fetched
Value is 0;If not finding the file record of correspondence, then return false signal to the storage device with wifi function;
Task is abandoned and reacquires module, after receiving false signal with the storage device of wifi function, abandons
The follow-up work of current group that obtains also reacquires first task groups being not fully complete;
The automatic request module of task, after the download often completing a task groups with the storage device of wifi function, automatically
The request next one is not fully complete task groups, until completing last to be not fully complete task groups.
Preferably, described automatic download module also includes:
Arranging module, when the residual memory space of described storage device is less than preset value, then this is deposited by corresponding virtual container
The state of storage equipment is set to Inactive, and this storage device stops simultaneously operating;
Processing module, is allowed to revert to Active state or associate new depositing for described storage device is deleted data
Storage equipment to this virtual container or virtual container by associated with it other residual memory space higher than preset value but current
State is after in the storage device of Inactive is set to Active state, recovers data syn-chronization work;Wherein, empty
When intending the container multiple storage device of association, when carrying out data syn-chronization, the state of only one of which storage device is Active, other
It is Inactive.
The aforesaid data to specifying publicly-owned cloud account are carried out in the system of automated back-up respectively, and described spider module is also wrapped
Include:
Supplement traversal and contrast module, for individual private possession cloud storage system periodically to publicly-owned cloud storage account associated there
Catalogue under subdirectory and filename carry out supplementing traversal, and compare with subdirectory and the list of file names of local cache
Right, find out new file, generate the list of download/synchronous task;
Described supplementary traversal and contrast module specifically include:
Data load and memory module: for individual private possession cloud storage system order loading catalogue according to packet from data base
The json data of structure, preserve this structure of arrays in the internal memory of program, and by named for this array: old;
Supplement spider module: be used for according to the mode traveled through first the subdirectory under publicly-owned each catalogue of cloud storage account and literary composition
Part name carries out supplementing traversal, it is thus achieved that the structure of arrays of up-to-date directory traversal result, and by named for this array: new;
Data Comparison module: for taking out an element from old array, search and this element files name in new array
Identical element, without finding, then abandons this element in this old array;If have found the element of correspondence, the most right
Than the MD5 value of two elements or file size and last modification time;If it is identical, then element in old array
Fetched value is copied in new array the element of correspondence;Repeat this operation, until all of element all takes in old array
Go out;
Second data derive and memory module, are used for supplementing after traversal completes, the data of new array are led from the internal memory of program
Go out the data for json form, and preserve to data base with packet mode.
Compared with prior art, the invention have the advantages that
1, the present invention by by the account of individual private possession cloud storage system with certain specify publicly-owned cloud storage account and multiple with
The storage device of wifi function is bound;Individual private possession cloud storage system is under each catalogue in described publicly-owned cloud storage account
Subdirectory and file travel through first, after having traveled through, the subdirectory under respective directories and file name data are derived also
Preserve to data base;Subdirectory under each catalogue in data base and file name data are generated by individual private possession cloud storage system
Multiple task groups also wait the storage device active obtaining with wifi function;The described storage device with wifi function is networked
After, obtain task to individual private possession cloud storage system, then according to the subdirectory under respective directories in current task group and file
Name is automatically from specifying beginning downloading task data publicly-owned cloud storage account.It is achieved thereby that in specifying in publicly-owned cloud account
Hold and the most intelligent automatic backup to different storage devices, it is ensured that the safety of data;And whole process is all without user
Manual operations, data backup efficiency is higher;
2, by utilizing different virtual containers respectively with some or certain the several catalogues specified in publicly-owned cloud storage account one by one
Corresponding association, simultaneously each virtual container carry out one to one with the storage device of wifi function with each, many-one or one-to-many
Association, such that it is able to utilize each virtual container more accurately, management and control efficiently specify in cloud storage account under respective directories interior
Hold backup and more new task;
3, individual private possession cloud storage system is periodically to the subdirectory under the catalogue of publicly-owned cloud storage account associated there and file
Name carries out supplementing traversal, and compares with subdirectory and the list of file names of local cache, finds out new file, generates and downloads
The list of/synchronous task, such that it is able to only to each publicly-owned cloud storage account update file carry out automatic, back up in time, enter
One step improves the efficiency of automatically updating data;
4, in the present invention, if the residual memory space of described storage device is less than preset value, then corresponding virtual container should
The state of storage device is set to Inactive, and this storage device stops simultaneously operating;By described storage device is deleted number
According to being allowed to revert to Active state or will be with it to this virtual container or virtual container by associating new storage device
Other residual memory space of association is set to higher than in preset value but storage device that current state is Inactive
After Active state, recover data syn-chronization work;Wherein, when virtual container associates multiple storage device, data syn-chronization is being carried out
Time, the state of only one of which storage device is Active, and other are Inactive, it is achieved thereby that to locally stored space
Smooth expansion;
5, associate when each catalogue one_to_one corresponding in each virtual container cloud storage publicly-owned with described appointment account, simultaneously with respectively
When the individual storage device with wifi function carries out many-one association, if certain virtual container of individual private possession cloud storage system performs
When finding the memory space of described storage device during synchronization less than preset value, then this virtual container is by itself and this storage
The relation of equipment is set to Inactive state;Individual private possession cloud storage system is searched and notifies to associate with this storage device simultaneously
Other virtual containers, its relation with this storage device is also set to Inactive state by other virtual containers;Data syn-chronization work
Work stops, until described storage device transfers Active state or new with wifi merit by association to by deleting data
Can storage device to each virtual container or each virtual container, other residual memory space associated with it is higher than
After preset value but in storage device that current state is Inactive one are set to Active state, proceed data syn-chronization
Work.Such that it is able in all publicly-owned cloud storage card of accounts that is associated with certain storage device of quick, unified control
Whether the carrying out of data syn-chronization work.
Accompanying drawing explanation
Fig. 1 is the method flow diagram of a kind of embodiment of the present invention;
Fig. 2 is that the account of the individual private possession cloud storage system storage device with Baidu Yun account and with wifi function is carried out
The method flow diagram of binding;
Fig. 3 is that the storage device with wifi function performs backup tasks and individual private possession cloud storage system (drop cloud) is sent out
There is new file and generate the flow chart of backup tasks in existing publicly-owned cloud storage.
The present invention is further illustrated with detailed description of the invention below in conjunction with the accompanying drawings.
Detailed description of the invention
Embodiments of the invention 1: a kind of method that data to specifying publicly-owned cloud account carry out respectively automated back-up, as Fig. 1,
Shown in Fig. 3, comprise the following steps:
S1, specifies publicly-owned cloud storage account with certain and multiple with wifi function by the account of individual private possession cloud storage system
Storage device is bound;Specifically include:
S11, accesses each web management interface with the storage device of wifi function, and utilizes individual private possession cloud storage system
Account and the password of system log in;After logging in successfully, each is i.e. deposited with individual private possession cloud with the storage device of wifi function
The account of storage system establishes binding relationship;
S12, initiates certain appointment publicly-owned on each described web management interface with the storage device of wifi function
The bind request of cloud storage account;Obtain access by the open DLL (i.e. OpenAPI) of publicly-owned cloud storage system to award
Power, it is thus achieved that authorize key accordingly;
S13, by the title of described publicly-owned cloud storage system, authorizes key and the equipment with the storage device of wifi function to compile
Number it is uploaded to individual private possession cloud storage system and preserves;
S14, individual private possession cloud storage system create multiple different virtual containers so that each virtual container respectively with described finger
Each catalogue one_to_one corresponding association in fixed publicly-owned cloud storage account, simultaneously each virtual container with each with wifi function
Storage device is carried out one to one, many-one or one-to-many association;
S2, the subdirectory under each catalogue in described publicly-owned cloud storage account and file are carried out by individual private possession cloud storage system
Travel through first, after having traveled through, the subdirectory under respective directories and file name data are derived and preserved to data base;Tool
Body includes: described different virtual container to the subdirectory under respective directories in publicly-owned cloud storage account associated there and
File travels through first, generates the data structure of META DATA;After having traveled through, by described filename according to N
Individual is one group, after being divided into multiple groups, exports as the data of json form, and preserves to data base;Wherein, traversal
Time, using subdirectory or file name as index value;
Step S2 also includes: under individual private possession cloud storage system periodically catalogue to publicly-owned cloud storage account associated there
Subdirectory and filename carry out supplementing traversal, and compare with subdirectory and the list of file names of local cache, find out new literary composition
Part, generates the list of download/synchronous task;Specifically include:
First, individual private possession cloud storage system loads the json data of bibliographic structure from data base according to the order being grouped,
The internal memory of program preserves this structure of arrays, and by named for this array: old;
Secondly, according to the mode traveled through first, the subdirectory under publicly-owned each catalogue of cloud storage account and filename are supplemented
Traversal, it is thus achieved that the structure of arrays of up-to-date directory traversal result, and by named for this array: new;
Again, from old array, take out an element, new array searched the element identical with this element files name,
Without finding, then abandon this element in this old array;If have found the element of correspondence, then contrast two elements
MD5 value or file size and last modification time;If identical, then the fetched value of element in old array is copied to
Element corresponding in new array;Repeat this operation, until all of element all takes out in old array;
Finally, after supplementary traversal completes, the data of new array are exported as from the internal memory of program the data of json form, and
Preserve to data base with packet mode;
S3, the subdirectory under each catalogue in data base and file name data are generated multiple tasks by individual private possession cloud storage system
Group also waits the storage device active obtaining with wifi function;
S4, after the described storage device with wifi function is networked, obtains task to individual private possession cloud storage system, then
Automatically start to download from the publicly-owned cloud storage account of appointment according to the subdirectory under respective directories in current task group and filename and appoint
Business data;Specifically include: after the storage device networking with wifi function, the state of detection storage device, if
Active, then initiate task to individual private possession cloud storage system and obtain request, and individual private possession cloud storage system inquires and this equipment
All virtual containers of association, are then handed down to this equipment by virtual container first task groups not being fully completed;This sets
Standby task definition and the numbering of packet of preserving, and according to the subdirectory under respective directories in current task group and filename automatically from
Specify beginning downloading task data in publicly-owned cloud storage account;Often complete downloading or completing a task groups of a file
The download of all or part of file, then can use to the residue of corresponding virtual container more new task performance and storage device
Space;If the residue free space of storage device is less than preset value, then abandon the follow-up work of the current group obtained,
And the state arranging storage device is Inactive, stop data synchronization service;Otherwise corresponding virtual container is receiving task
After more newly requested, search the record of correspondence in a packet according to packet numbering and file name, if finding the file note of correspondence
Record, then arrange fetched=1;Wherein, fetched is the member comprised in META DATA structure, for table
Showing the storage device with wifi function whether having been downloaded into user, the default value of fetched is 0;If it is right not find
The file record answered, then return false signal and receive to the storage device with wifi function, the storage device with wifi function
After false signal, abandon the follow-up work of current group that obtained and reacquire first task groups being not fully complete;
Often complete the download of a task groups with the storage device of wifi function after, the request next one is not fully complete task groups, directly automatically
It is not fully complete task groups to completing last;If the residual memory space of described storage device is less than preset value, the most accordingly
The state of this storage device is set to Inactive by virtual container, and this storage device stops simultaneously operating;By described is deposited
Storage equipment delete data be allowed to revert to Active state or by the new storage device of association to this virtual container or
Virtual container by other residual memory space associated with it higher than in preset value but storage device that current state is Inactive
One be set to Active state after, recover data syn-chronization work;Wherein, when virtual container associates multiple storage device,
When carrying out data syn-chronization, the state of only one of which storage device is Active, and other are Inactive.
A kind of data to specifying publicly-owned cloud account carry out the system of automated back-up respectively, including:
Binding module, for by the account of individual private possession cloud storage system with certain specify publicly-owned cloud storage account and multiple with
The storage device of wifi function is bound;
Spider module, for individual private possession cloud storage system to the subdirectory under each catalogue in described publicly-owned cloud storage account
And file travels through first;
First data derive and memory module, after traversal completes, the subdirectory under respective directories and file name data are led
Go out and preserve to data base;
Task generates and distribution module, for individual private possession cloud storage system by the subdirectory under each catalogue in data base and literary composition
The multiple task groups of part name data genaration also waits the storage device active obtaining with wifi function;
Automatically download module, after the described storage device with wifi function is networked, to individual private possession cloud storage system
Acquisition task, then according to the subdirectory under respective directories in current task group and filename automatically from specifying publicly-owned cloud storage account
Family starts downloading task data.
Described binding module also includes:
Login module, for accessing each web management interface with the storage device of wifi function, and utilizes individual private possession
Account and the password of cloud storage system log in;After logging in successfully, each with wifi function storage device i.e. with individual
The account of private cloud storage system establishes binding relationship;
Bind request sending module, for sending out on each described web management interface with the storage device of wifi function
Play the bind request to certain publicly-owned cloud storage account of appointment;
Access and authorize acquisition module, visit for being obtained by the open DLL (i.e. OpenAPI) of publicly-owned cloud storage system
Ask mandate, it is thus achieved that authorize key accordingly;
Transmission module in information, for by the title of described publicly-owned cloud storage system, mandate key and depositing with wifi function
The device numbering of storage equipment is uploaded to individual private possession cloud storage system and preserves;
Virtual container creates and relating module, creates multiple different virtual containers for individual private possession cloud storage system so that
Each catalogue one_to_one corresponding in each virtual container cloud storage account publicly-owned with described appointment respectively associates, and each is virtual simultaneously
Container is carried out one to one with the storage device of wifi function with each, many-one or one-to-many associate.
Described spider module also includes:
Structure of arrays generation module, for described different virtual container to phase in publicly-owned cloud storage account associated there
Answer the subdirectory under catalogue and file to travel through first, generate the data structure of META DATA;
First data derive and memory module also includes:
Packet module, after traversal completes, by described filename according to N number of be one group, be divided into multiple groups
After, export as the data of json form, and preserve to data base;Wherein, during traversal, it is referred to as with subdirectory or filename
For index value.
Described automatic download module also includes:
State detection module, after networking with the storage device of wifi function, the state of detection storage device;
Logging modle, if the state for storage device is Active, then initiating task acquisition to individual private possession cloud storage system please
Asking, individual private possession cloud storage system inquires all virtual containers associated with this equipment, then by virtual container first
The task groups not being fully completed is handed down to this equipment;This equipment preserves task definition and the numbering of packet;
Information feedback module, for often completing the download of a file or completing one with the storage device of wifi function
The download of all or part of file of business group, then surplus to corresponding virtual container more new task performance and storage device
Remaining free space;
File record is searched and arranges module, if when the residue free space of storage device is more than preset value, the most accordingly
Virtual container, after the task that receives is more newly requested, searches the record of correspondence in a packet according to packet numbering and file name,
If finding the file record of correspondence, then fetched=1 is set;Wherein, fetched comprises in being META DATA structure
A member, for indicating whether to be downloaded to the storage device with wifi function of user, the acquiescence of fetched
Value is 0;If not finding the file record of correspondence, then return false signal to the storage device with wifi function;
Task is abandoned and reacquires module, after receiving false signal with the storage device of wifi function, abandons
The follow-up work of current group that obtains also reacquires first task groups being not fully complete;
The automatic request module of task, after the download often completing a task groups with the storage device of wifi function, automatically
The request next one is not fully complete task groups, until completing last to be not fully complete task groups.
Described automatic download module also includes:
Arranging module, when the residual memory space of described storage device is less than preset value, then corresponding virtual container should
The state of storage device is set to Inactive, and this storage device stops simultaneously operating;
Processing module, is allowed to revert to Active state or associate new depositing for described storage device is deleted data
Storage equipment to this virtual container or virtual container by associated with it other residual memory space higher than preset value but current
State is after in the storage device of Inactive is set to Active state, recovers data syn-chronization work;Wherein, empty
When intending the container multiple storage device of association, when carrying out data syn-chronization, the state of only one of which storage device is Active, other
It is Inactive.
Described spider module also includes:
Supplement traversal and contrast module, for individual private possession cloud storage system periodically to publicly-owned cloud storage account associated there
Catalogue under subdirectory and filename carry out supplementing traversal, and compare with subdirectory and the list of file names of local cache
Right, find out new file, generate the list of download/synchronous task;
Described supplementary traversal and contrast module specifically include:
Data load and memory module: for individual private possession cloud storage system order loading catalogue according to packet from data base
The json data of structure, preserve this structure of arrays in the internal memory of program, and by named for this array: old;
Supplement spider module: be used for according to the mode traveled through first the subdirectory under publicly-owned each catalogue of cloud storage account and literary composition
Part name carries out supplementing traversal, it is thus achieved that the structure of arrays of up-to-date directory traversal result, and by named for this array: new;
Data Comparison module: for taking out an element from old array, search and this element files name in new array
Identical element, without finding, then abandons this element in this old array;If have found the element of correspondence, the most right
Than the MD5 value of two elements or file size and last modification time;If it is identical, then element in old array
Fetched value is copied in new array the element of correspondence;Repeat this operation, until all of element all takes in old array
Go out;
Second data derive and memory module, are used for supplementing after traversal completes, the data of new array are led from the internal memory of program
Go out the data for json form, and preserve to data base with packet mode.
Embodiment 2: a kind of method that data to specifying publicly-owned cloud account carry out automated back-up respectively, as it is shown in figure 1, include
Following steps:
S1, specifies publicly-owned cloud storage account with certain and multiple with wifi function by the account of individual private possession cloud storage system
Storage device is bound;Specifically include:
S11, accesses each web management interface with the storage device of wifi function, and utilizes individual private possession cloud storage system
Account and the password of system log in;After logging in successfully, each is i.e. deposited with individual private possession cloud with the storage device of wifi function
The account of storage system establishes binding relationship;
S12, initiates certain appointment publicly-owned on each described web management interface with the storage device of wifi function
The bind request of cloud storage account;Obtain access by the open DLL (i.e. OpenAPI) of publicly-owned cloud storage system to award
Power, it is thus achieved that authorize key accordingly;
S13, by the title of described publicly-owned cloud storage system, authorizes key and the equipment with the storage device of wifi function to compile
Number it is uploaded to individual private possession cloud storage system and preserves;
S14, individual private possession cloud storage system create multiple different virtual containers so that each virtual container respectively with described finger
Each catalogue one_to_one corresponding association in fixed publicly-owned cloud storage account, simultaneously each virtual container with each with wifi function
Storage device is carried out one to one, many-one or one-to-many association;
S2, the subdirectory under each catalogue in described publicly-owned cloud storage account and file are carried out by individual private possession cloud storage system
Travel through first, after having traveled through, the subdirectory under respective directories and file name data are derived and preserved to data base;Tool
Body includes: described different virtual container to the subdirectory under respective directories in publicly-owned cloud storage account associated there and
File travels through first, generates the data structure of META DATA;After having traveled through, by described filename according to N
Individual is one group, after being divided into multiple groups, exports as the data of json form, and preserves to data base;Wherein, traversal
Time, using subdirectory or file name as index value;
S3, the subdirectory under each catalogue in data base and file name data are generated multiple tasks by individual private possession cloud storage system
Group also waits the storage device active obtaining with wifi function;
S4, after the described storage device with wifi function is networked, obtains task to individual private possession cloud storage system, then
Automatically start to download from the publicly-owned cloud storage account of appointment according to the subdirectory under respective directories in current task group and filename and appoint
Business data;Specifically include: after the storage device networking with wifi function, the state of detection storage device, if
Active, then initiate task to individual private possession cloud storage system and obtain request, and individual private possession cloud storage system inquires and this equipment
All virtual containers of association, are then handed down to this equipment by virtual container first task groups not being fully completed;This sets
Standby task definition and the numbering of packet of preserving, and according to the subdirectory under respective directories in current task group and filename automatically from
Specify beginning downloading task data in publicly-owned cloud storage account;Often complete downloading or completing a task groups of a file
The download of all or part of file, then can use to the residue of corresponding virtual container more new task performance and storage device
Space;If the residue free space of storage device is less than preset value, then abandon the follow-up work of the current group obtained,
And the state arranging storage device is Inactive, stop data synchronization service;Otherwise corresponding virtual container is receiving task
After more newly requested, search the record of correspondence in a packet according to packet numbering and file name, if finding the file note of correspondence
Record, then arrange fetched=1;Wherein, fetched is the member comprised in META DATA structure, for table
Showing the storage device with wifi function whether having been downloaded into user, the default value of fetched is 0;If it is right not find
The file record answered, then return false signal and receive to the storage device with wifi function, the storage device with wifi function
After false signal, abandon the follow-up work of current group that obtained and reacquire first task groups being not fully complete;
Often complete the download of a task groups with the storage device of wifi function after, the request next one is not fully complete task groups, directly automatically
It is not fully complete task groups to completing last.
A kind of data to specifying publicly-owned cloud account carry out the system of automated back-up respectively, including:
Binding module, for by the account of individual private possession cloud storage system with certain specify publicly-owned cloud storage account and multiple with
The storage device of wifi function is bound;
Spider module, for individual private possession cloud storage system to the subdirectory under each catalogue in described publicly-owned cloud storage account
And file travels through first;
First data derive and memory module, after traversal completes, the subdirectory under respective directories and file name data are led
Go out and preserve to data base;
Task generates and distribution module, for individual private possession cloud storage system by the subdirectory under each catalogue in data base and literary composition
The multiple task groups of part name data genaration also waits the storage device active obtaining with wifi function;
Automatically download module, after the described storage device with wifi function is networked, to individual private possession cloud storage system
Acquisition task, then according to the subdirectory under respective directories in current task group and filename automatically from specifying publicly-owned cloud storage account
Family starts downloading task data.
Described binding module also includes:
Login module, for accessing each web management interface with the storage device of wifi function, and utilizes individual private possession
Account and the password of cloud storage system log in;After logging in successfully, each with wifi function storage device i.e. with individual
The account of private cloud storage system establishes binding relationship;
Bind request sending module, for sending out on each described web management interface with the storage device of wifi function
Play the bind request to certain publicly-owned cloud storage account of appointment;
Access and authorize acquisition module, visit for being obtained by the open DLL (i.e. OpenAPI) of publicly-owned cloud storage system
Ask mandate, it is thus achieved that authorize key accordingly;
Transmission module in information, for by the title of described publicly-owned cloud storage system, mandate key and depositing with wifi function
The device numbering of storage equipment is uploaded to individual private possession cloud storage system and preserves;
Virtual container creates and relating module, creates multiple different virtual containers for individual private possession cloud storage system so that
Each catalogue one_to_one corresponding in each virtual container cloud storage account publicly-owned with described appointment respectively associates, and each is virtual simultaneously
Container is carried out one to one with the storage device of wifi function with each, many-one or one-to-many associate.
Described spider module also includes:
Structure of arrays generation module, for described different virtual container to phase in publicly-owned cloud storage account associated there
Answer the subdirectory under catalogue and file to travel through first, generate the data structure of META DATA;
First data derive and memory module also includes:
Packet module, after traversal completes, by described filename according to N number of be one group, be divided into multiple groups
After, export as the data of json form, and preserve to data base;Wherein, during traversal, it is referred to as with subdirectory or filename
For index value.
Described automatic download module also includes:
State detection module, after networking with the storage device of wifi function, the state of detection storage device;
Logging modle, if the state for storage device is Active, then initiating task acquisition to individual private possession cloud storage system please
Asking, individual private possession cloud storage system inquires all virtual containers associated with this equipment, then by virtual container first
The task groups not being fully completed is handed down to this equipment;This equipment preserves task definition and the numbering of packet;
Information feedback module, for often completing the download of a file or completing one with the storage device of wifi function
The download of all or part of file of business group, then surplus to corresponding virtual container more new task performance and storage device
Remaining free space;
File record is searched and arranges module, if when the residue free space of storage device is more than preset value, the most accordingly
Virtual container, after the task that receives is more newly requested, searches the record of correspondence in a packet according to packet numbering and file name,
If finding the file record of correspondence, then fetched=1 is set;Wherein, fetched comprises in being META DATA structure
A member, for indicating whether to be downloaded to the storage device with wifi function of user, the acquiescence of fetched
Value is 0;If not finding the file record of correspondence, then return false signal to the storage device with wifi function;
Task is abandoned and reacquires module, after receiving false signal with the storage device of wifi function, abandons
The follow-up work of current group that obtains also reacquires first task groups being not fully complete;
The automatic request module of task, after the download often completing a task groups with the storage device of wifi function, automatically
The request next one is not fully complete task groups, until completing last to be not fully complete task groups.
Embodiment 3: a kind of method that data to specifying publicly-owned cloud account carry out automated back-up respectively, comprises the following steps:
S1, specifies publicly-owned cloud storage account with certain and multiple with wifi function by the account of individual private possession cloud storage system
Storage device is bound;
S2, the subdirectory under each catalogue in described publicly-owned cloud storage account and file are carried out by individual private possession cloud storage system
Travel through first, after having traveled through, the subdirectory under respective directories and file name data are derived and preserved to data base;
S3, the subdirectory under each catalogue in data base and file name data are generated multiple tasks by individual private possession cloud storage system
Group also waits the storage device active obtaining with wifi function;
S4, after the described storage device with wifi function is networked, obtains task to individual private possession cloud storage system, then
Automatically start to download from the publicly-owned cloud storage account of appointment according to the subdirectory under respective directories in current task group and filename and appoint
Business data.
A kind of data to specifying publicly-owned cloud account carry out the system of automated back-up respectively, including:
Binding module, for by the account of individual private possession cloud storage system with certain specify publicly-owned cloud storage account and multiple with
The storage device of wifi function is bound;
Spider module, for individual private possession cloud storage system to the subdirectory under each catalogue in described publicly-owned cloud storage account
And file travels through first;
First data derive and memory module, after traversal completes, the subdirectory under respective directories and file name data are led
Go out and preserve to data base;
Task generates and distribution module, for individual private possession cloud storage system by the subdirectory under each catalogue in data base and literary composition
The multiple task groups of part name data genaration also waits the storage device active obtaining with wifi function;
Automatically download module, after the described storage device with wifi function is networked, to individual private possession cloud storage system
Acquisition task, then according to the subdirectory under respective directories in current task group and filename automatically from specifying publicly-owned cloud storage account
Family starts downloading task data.
The operation principle of a kind of embodiment of the present invention: as in figure 2 it is shown, access the A dish with wifi function, B respectively
Dish, C dish, D dish, the web management interface of E dish, and utilize the account of individual private possession cloud storage system and password to step on
Land;After logging in successfully, described A dish, B dish, C dish, D dish, E dish i.e. account with individual private possession cloud storage system is built
Found binding relationship;Described A dish, B dish, C dish, D dish, E dish web management interface on initiate certain is referred to
The bind request of fixed publicly-owned cloud storage account (such as Baidu Yun account);By the open DLL of Baidu Yun
(i.e. OpenAPI) obtains to access and authorizes, it is thus achieved that authorize key accordingly;Title by described publicly-owned cloud storage system
(Baidu Yun), mandate key and A dish, B dish, C dish, D dish, the device numbering of E dish are uploaded to individual private possession cloud and deposit
Storage system also preserves;Individual private possession cloud storage system creates 6 different virtual containers, such as S1 virtual container, the virtual appearance of S2
Device, S3 virtual container, S4 virtual container, S5 virtual container, S6 virtual container, and create following incidence relation:
The aaa catalogue S1 virtual container A dish of Baidu Yun account
The bbb catalogue S2 virtual container B dish of Baidu Yun account
The ccc catalogue S3 virtual container B dish of Baidu Yun account
The ddd catalogue S4 virtual container C dish of Baidu Yun account
The eee catalogue S5 virtual container C dish of Baidu Yun account
The fff catalogue S6 virtual container C dish of Baidu Yun account and D dish and E dish
Utilize S1 virtual container, S2 virtual container, S3 virtual container, S4 virtual container, S5 virtual container, S6 virtual
The data backup of different directories and more new task in container management and control Baidu cloud account respectively, and carry out a pair with portable hard drive
One, one-to-many or many-one association, it is achieved thereby that by the most standby for the data under different directories in the publicly-owned cloud account of appointment
In the portable hard drive that part is same or the most different.
In backup procedure, A dish, B dish, C dish constantly can feed back residual memory space to each virtual container, if A
The residual memory space of dish is less than preset value, then its incidence relation with A dish is set to Inactive, A by S1 virtual container
Dish stop back-up job, until by delete A dish data so that it is revert to Active state or by association new
Portable hard drive such as F dish is to after S1 virtual container, and back-up job continues.
In like manner, if in backup procedure, S2 virtual container receives the residual memory space of information B dish and is less than preset value,
Then its incidence relation with B dish is set to Inactive by S2 virtual container, and meanwhile, individual private possession cloud storage system searches it
The virtual container that he associates with B dish, finds and informs S3 virtual container, and S3 virtual container is by itself and the incidence relation of B dish
It is also configured as Inactive, B dish and stops back-up job, until by the data deleting B dish so that it is revert to Active shape
State or by the new portable hard drive such as G dish of association to S2, S3 virtual container after, back-up job continues.
By that analogy, the association of S6 virtual container has C dish, D dish and 3 storage devices of E dish, in data synchronization process
In, only one of which storage device is in Active state, such as C dish, and other 2 are Inactive state.
If in backup procedure, S4 virtual container receives the residual memory space of information C dish and is less than preset value, then S4 is empty
Intending container and its incidence relation with C dish is set to Inactive, meanwhile, individual private possession cloud storage system searches other and C
The virtual container of dish association, finds and informs that S5 virtual container and S6 virtual container, S5 virtual container and S6 virtual container will
It is also configured as Inactive, C dish stopping back-up job with the incidence relation of C dish, until by the data deleting C dish,
It is made to revert to Active state or by associating new portable hard drive such as H dish to S4, S5, S6 virtual container
After, back-up job continues.Or the state of D dish or E dish is set to Active by S6 virtual container, proceed to synchronize work
Make (only limit S6 virtual container).
Claims (12)
1. the method that the data to specifying publicly-owned cloud account carry out automated back-up respectively, it is characterised in that comprise the following steps:
S1, specifies publicly-owned cloud storage account and multiple storage with wifi function by the account of individual private possession cloud storage system with certain
Equipment is bound;
S2, the subdirectory under each catalogue in described publicly-owned cloud storage account and file are carried out first by individual private possession cloud storage system
Traversal, after having traveled through, derives the subdirectory under respective directories and file name data and preserves to data base;
S3, the subdirectory under each catalogue in data base and file name data are generated multiple task groups also by individual private possession cloud storage system
Wait the storage device active obtaining with wifi function;
S4, after the described storage device with wifi function is networked, obtains task, then basis to individual private possession cloud storage system
In current task group, the subdirectory under respective directories and filename are automatically from specifying beginning downloading task number publicly-owned cloud storage account
According to.
The method that data to specifying publicly-owned cloud account the most according to claim 1 carry out automated back-up respectively, its feature exists
In, step S1 specifically includes:
S11, accesses each web management interface with the storage device of wifi function, and utilizes individual private possession cloud storage system
Account and password log in;After logging in successfully, each with wifi function storage device i.e. with individual private possession cloud storage system
The account of system establishes binding relationship;
S12, initiates to specify publicly-owned cloud to deposit certain on each described web management interface with the storage device of wifi function
The bind request of storage account;Obtain to access by the open DLL of publicly-owned cloud storage system and authorize, it is thus achieved that authorize accordingly
key;
S13, by the title of described publicly-owned cloud storage system, authorizes on key and the device numbering with the storage device of wifi function
Reach individual private possession cloud storage system and preserve;
S14, individual private possession cloud storage system creates multiple different virtual containers so that each virtual container specifies public affairs with described respectively
Have each catalogue one_to_one corresponding in cloud storage account to associate, simultaneously each virtual container with each with the storage of wifi function
Equipment is carried out one to one, many-one or one-to-many association.
The method that data to specifying publicly-owned cloud account the most according to claim 2 carry out automated back-up respectively, its feature exists
In, step S2 specifically includes: described different virtual container is to respective directories in publicly-owned cloud storage account associated there
Under subdirectory and file travel through first, generate META DATA data structure;After having traveled through, by described
Filename according to N number of be one group, after being divided into multiple groups, export as the data of json form, and preserve to data base;
Wherein, during traversal, using subdirectory or file name as index value.
The method that data to specifying publicly-owned cloud account the most according to claim 2 carry out automated back-up respectively, its feature exists
In, step S4 specifically includes: after the storage device networking with wifi function, the state of detection storage device, if
Active, then initiate task to individual private possession cloud storage system and obtain request, and individual private possession cloud storage system inquires and this equipment
All virtual containers of association, are then handed down to this equipment by virtual container first task groups not being fully completed;This sets
Standby task definition and the numbering of packet of preserving, and according to the subdirectory under respective directories in current task group and filename automatically from
Specify beginning downloading task data in publicly-owned cloud storage account;Often complete downloading or completing a task groups of a file
The download of all or part of file, then can use to the residue of corresponding virtual container more new task performance and storage device
Space;If the residue free space of storage device is less than preset value, then abandon the follow-up work of the current group obtained,
And the state arranging storage device is Inactive, stop data synchronization service;Otherwise corresponding virtual container is receiving task
After more newly requested, search the record of correspondence in a packet according to packet numbering and file name, if finding the file note of correspondence
Record, then arrange fetched=1;Wherein, fetched is the member comprised in META DATA structure, for table
Showing the storage device with wifi function whether having been downloaded into user, the default value of fetched is 0;If it is right not find
The file record answered, then return false signal and receive to the storage device with wifi function, the storage device with wifi function
After false signal, abandon the follow-up work of current group that obtained and reacquire first task groups being not fully complete;
Often complete the download of a task groups with the storage device of wifi function after, the request next one is not fully complete task groups, directly automatically
It is not fully complete task groups to completing last.
The method that data to specifying publicly-owned cloud account the most according to claim 4 carry out automated back-up respectively, its feature exists
In, if the residual memory space of described storage device is less than preset value, then corresponding virtual container is by the shape of this storage device
State is set to Inactive, and this storage device stops simultaneously operating;It is allowed to revert to by described storage device is deleted data
Active state or by the new storage device of association to this virtual container or virtual container by associated with it other
Residual memory space is set to Active state higher than in preset value but storage device that current state is Inactive
After, recover data syn-chronization work;Wherein, when virtual container associates multiple storage device, when carrying out data syn-chronization, only
The state of one storage device is Active, and other are Inactive.
6. according to the method that the data specifying publicly-owned cloud account are carried out automated back-up respectively described in any one of Claims 1 to 5, its
Being characterised by, step S2 also includes: individual private possession cloud storage system periodically mesh to publicly-owned cloud storage account associated there
Subdirectory under Lu and filename carry out supplementing traversal, and compare with subdirectory and the list of file names of local cache, look for
Make new advances file, generates the list of download/synchronous task;Specifically include:
First, individual private possession cloud storage system loads the json data of bibliographic structure from data base according to the order being grouped, in program
Internal memory in preserve this structure of arrays, and by named for this array: old;
Secondly, according to the mode traveled through first, the subdirectory under publicly-owned each catalogue of cloud storage account and filename are carried out supplementary time
Go through, it is thus achieved that the structure of arrays of up-to-date directory traversal result, and by named for this array: new;
Again, from old array, take out an element, new array is searched the element identical with this element files name, if
Do not find, then abandon this element in this old array;If have found the element of correspondence, then contrast two elements
MD5 value or file size and last modification time;If identical, then the fetched value of element in old array is copied to
Element corresponding in new array;Repeat this operation, until all of element all takes out in old array;
Finally, after supplementary traversal completes, the data of new array are exported as from the internal memory of program the data of json form, and to divide
Prescription formula preserves to data base.
7. the data to specifying publicly-owned cloud account carry out distinguishing the system of automated back-up, it is characterised in that including:
Binding module, for specifying publicly-owned cloud storage account and multiple with wifi by the account of individual private possession cloud storage system with certain
The storage device of function is bound;
Spider module, for individual private possession cloud storage system to the subdirectory under each catalogue in described publicly-owned cloud storage account and literary composition
Part travels through first;
First data derive and memory module, after traversal completes, the subdirectory under respective directories and file name data are derived also
Preserve to data base;
Task generates and distribution module, for individual private possession cloud storage system by the subdirectory under each catalogue in data base and filename
The multiple task groups of data genaration also waits the storage device active obtaining with wifi function;
Automatically download module, after the described storage device with wifi function is networked, obtains to individual private possession cloud storage system
Task, then according to the subdirectory under respective directories in current task group and filename automatically from specifying publicly-owned cloud storage account
Start downloading task data.
Data to specifying publicly-owned cloud account the most according to claim 7 carry out the system of automated back-up respectively, and its feature exists
In, described binding module also includes:
Login module, for accessing each web management interface with the storage device of wifi function, and utilizes individual private possession cloud to deposit
Account and the password of storage system log in;After logging in successfully, each with the storage device of wifi function is and individual private possession
The account of cloud storage system establishes binding relationship;
Bind request sending module, right for initiating on each described web management interface with the storage device of wifi function
Certain specifies the bind request of publicly-owned cloud storage account;
Access and authorize acquisition module, authorize for obtaining to access by the open DLL of publicly-owned cloud storage system, it is thus achieved that corresponding
Authorize key;
Transmission module in information, for setting the title of described publicly-owned cloud storage system, mandate key and the storage with wifi function
Standby device numbering is uploaded to individual private possession cloud storage system and preserves;
Virtual container creates and relating module, creates multiple different virtual containers for individual private possession cloud storage system so that each
Each catalogue one_to_one corresponding in virtual container cloud storage account publicly-owned with described appointment respectively associates, each virtual container simultaneously
Carry out one to one with the storage device of wifi function with each, many-one or one-to-many associate.
Data to specifying publicly-owned cloud account the most according to claim 7 carry out the system of automated back-up respectively, and its feature exists
In, described spider module also includes:
Structure of arrays generation module, for described different virtual container to mesh corresponding in publicly-owned cloud storage account associated there
Subdirectory and file under Lu travel through first, generate the data structure of META DATA;
First data derive and memory module also includes:
Packet module, after traversal completes, by described filename according to N number of be one group, after being divided into multiple groups, lead
Go out the data for json form, and preserve to data base;Wherein, during traversal, using subdirectory or file name as index
Value.
Data to specifying publicly-owned cloud account the most according to claim 9 carry out the system of automated back-up respectively, and its feature exists
In, described automatic download module also includes:
State detection module, after networking with the storage device of wifi function, the state of detection storage device;
Logging modle, if the state for storage device is Active, then initiates task to individual private possession cloud storage system and obtains request,
Individual private possession cloud storage system inquires all virtual containers associated with this equipment, then the most complete by virtual container first
The task groups that portion completes is handed down to this equipment;This equipment preserves task definition and the numbering of packet;
Information feedback module, often completes the download of a file for the storage device with wifi function or completes a task groups
The download of all or part of file, then the residue to corresponding virtual container more new task performance and storage device can
Use space;
File record is searched and arranges module, if when the residue free space of storage device is more than preset value, the most virtual
Container, after the task that receives is more newly requested, searches the record of correspondence in a packet, if looking for according to packet numbering and file name
To corresponding file record, then fetched=1 is set;Wherein, fetched comprise in being META DATA structure one
Individual member, for indicating whether to be downloaded to the storage device with wifi function of user, the default value of fetched is
0;If not finding the file record of correspondence, then return false signal to the storage device with wifi function;
Task is abandoned and reacquires module, after receiving false signal with the storage device of wifi function, abandons having obtained
The follow-up work of current group and reacquire first task groups being not fully complete;
The automatic request module of task, after the download often completing a task groups with the storage device of wifi function, asks automatically
The next one is not fully complete task groups, until completing last to be not fully complete task groups.
11. data to specifying publicly-owned cloud account according to claim 10 carry out the system of automated back-up respectively, and its feature exists
In, described automatic download module also includes:
Arranging module, when the residual memory space of described storage device is less than preset value, then this is deposited by corresponding virtual container
The state of storage equipment is set to Inactive, and this storage device stops simultaneously operating;
Processing module, is allowed to revert to Active state or associate new storage set for described storage device is deleted data
Standby to this virtual container or virtual container by other residual memory space associated with it higher than preset value but current state
After being set to Active state in the storage device of Inactive, recover data syn-chronization work;Wherein, virtual appearance
When device associates multiple storage device, when carrying out data syn-chronization, the state of only one of which storage device is Active, and other are
Inactive。
12. according to the system that the data specifying publicly-owned cloud account carry out automated back-up respectively described in any one of claim 7~11,
It is characterized in that, described spider module also includes:
Supplement traversal and contrast module, the regular mesh to publicly-owned cloud storage account associated there for individual private possession cloud storage system
Subdirectory under Lu and filename carry out supplementing traversal, and compare with subdirectory and the list of file names of local cache, look for
Make new advances file, generates the list of download/synchronous task;
Described supplementary traversal and contrast module specifically include:
Data load and memory module: for individual private possession cloud storage system order loading bibliographic structure according to packet from data base
Json data, the internal memory of program preserves this structure of arrays, and by named for this array: old;
Supplement spider module: be used for according to the mode traveled through first the subdirectory under publicly-owned each catalogue of cloud storage account and filename
Carry out supplementing traversal, it is thus achieved that the structure of arrays of up-to-date directory traversal result, and by named for this array: new;
Data Comparison module: for taking out an element from old array, search identical with this element files name in new array
Element, without finding, then abandon this element in this old array;If have found the element of correspondence, then contrast two
The MD5 value of individual element or file size and last modification time;If it is identical, then the fetched of element in old array
Value is copied in new array the element of correspondence;Repeat this operation, until all of element all takes out in old array;
Second data derive and memory module, are used for supplementing after traversal completes, the data of new array are exported as from the internal memory of program
The data of json form, and preserve to data base with packet mode.
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201610338692.XA CN105930233B (en) | 2016-05-19 | 2016-05-19 | To specifying the data of public cloud account to carry out the method and system of automated back-up respectively |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201610338692.XA CN105930233B (en) | 2016-05-19 | 2016-05-19 | To specifying the data of public cloud account to carry out the method and system of automated back-up respectively |
Publications (2)
Publication Number | Publication Date |
---|---|
CN105930233A true CN105930233A (en) | 2016-09-07 |
CN105930233B CN105930233B (en) | 2018-10-16 |
Family
ID=56840997
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CN201610338692.XA Expired - Fee Related CN105930233B (en) | 2016-05-19 | 2016-05-19 | To specifying the data of public cloud account to carry out the method and system of automated back-up respectively |
Country Status (1)
Country | Link |
---|---|
CN (1) | CN105930233B (en) |
Cited By (7)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN106648965A (en) * | 2016-10-13 | 2017-05-10 | 安徽鼎集信息科技有限公司 | Real-time file backup system |
CN107277152A (en) * | 2017-06-29 | 2017-10-20 | 郑州云海信息技术有限公司 | A kind of public cloud data safety backup system |
CN108206933A (en) * | 2016-12-16 | 2018-06-26 | 杭州海康威视数字技术股份有限公司 | A kind of video data acquisition methods and device based on video cloud storage system |
CN111885175A (en) * | 2020-07-27 | 2020-11-03 | 陈军 | Method and system for downloading network disk directory file |
CN112150312A (en) * | 2020-10-06 | 2020-12-29 | 广州云莫凡信息科技有限公司 | Quality monitoring data maintenance method and system for building construction engineering |
CN112559254A (en) * | 2020-12-24 | 2021-03-26 | 杭州电魂网络科技股份有限公司 | Backup file retention method and device, electronic equipment and storage medium |
CN112866415A (en) * | 2021-02-24 | 2021-05-28 | 上海泰宇信息技术股份有限公司 | Data backup private cloud storage and downloading method |
Citations (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN102377827A (en) * | 2011-12-13 | 2012-03-14 | 方正国际软件有限公司 | Multilevel cloud storage system and storage method thereof |
US20120203742A1 (en) * | 2011-02-08 | 2012-08-09 | International Business Machines Corporation | Remote data protection in a networked storage computing environment |
CN103067406A (en) * | 2013-01-14 | 2013-04-24 | 暨南大学 | Access control system and access control method between public cloud and private cloud |
CN105025084A (en) * | 2015-06-10 | 2015-11-04 | 国网智能电网研究院 | A cloud storage system based on synchronization agent and hybrid storage |
-
2016
- 2016-05-19 CN CN201610338692.XA patent/CN105930233B/en not_active Expired - Fee Related
Patent Citations (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20120203742A1 (en) * | 2011-02-08 | 2012-08-09 | International Business Machines Corporation | Remote data protection in a networked storage computing environment |
CN102377827A (en) * | 2011-12-13 | 2012-03-14 | 方正国际软件有限公司 | Multilevel cloud storage system and storage method thereof |
CN103067406A (en) * | 2013-01-14 | 2013-04-24 | 暨南大学 | Access control system and access control method between public cloud and private cloud |
CN105025084A (en) * | 2015-06-10 | 2015-11-04 | 国网智能电网研究院 | A cloud storage system based on synchronization agent and hybrid storage |
Cited By (10)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN106648965A (en) * | 2016-10-13 | 2017-05-10 | 安徽鼎集信息科技有限公司 | Real-time file backup system |
CN108206933A (en) * | 2016-12-16 | 2018-06-26 | 杭州海康威视数字技术股份有限公司 | A kind of video data acquisition methods and device based on video cloud storage system |
CN108206933B (en) * | 2016-12-16 | 2020-05-15 | 杭州海康威视数字技术股份有限公司 | Video data acquisition method and device based on video cloud storage system |
CN107277152A (en) * | 2017-06-29 | 2017-10-20 | 郑州云海信息技术有限公司 | A kind of public cloud data safety backup system |
CN111885175A (en) * | 2020-07-27 | 2020-11-03 | 陈军 | Method and system for downloading network disk directory file |
CN111885175B (en) * | 2020-07-27 | 2023-04-07 | 陈军 | Method and system for downloading network disk directory file |
CN112150312A (en) * | 2020-10-06 | 2020-12-29 | 广州云莫凡信息科技有限公司 | Quality monitoring data maintenance method and system for building construction engineering |
CN112559254A (en) * | 2020-12-24 | 2021-03-26 | 杭州电魂网络科技股份有限公司 | Backup file retention method and device, electronic equipment and storage medium |
CN112866415A (en) * | 2021-02-24 | 2021-05-28 | 上海泰宇信息技术股份有限公司 | Data backup private cloud storage and downloading method |
CN112866415B (en) * | 2021-02-24 | 2023-07-28 | 上海泰宇信息技术股份有限公司 | Data backup private cloud storage and downloading method |
Also Published As
Publication number | Publication date |
---|---|
CN105930233B (en) | 2018-10-16 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
CN105930233A (en) | Method and system for automatically backing up data of specified public cloud account | |
CN105824723B (en) | The method and system that a kind of data to publicly-owned cloud storage account are backed up | |
CN105593804B (en) | Method and apparatus for file system virtualization, data storage system for file system virtualization, and file server for data storage system | |
CN105978981B (en) | The linear expansion method and system of data backup based on publicly-owned cloud storage account | |
CN101568919B (en) | Single view of data in a networked computer system with distributed storage | |
US20220327117A1 (en) | Servicing queries of a hybrid event index | |
CN103002027B (en) | Data-storage system and the method for tree directory structure is realized based on key-value pair system | |
US9424274B2 (en) | Management of intermediate data spills during the shuffle phase of a map-reduce job | |
CN102012933B (en) | Distributed file system and its method for storing data and providing services | |
CN110447021A (en) | Method, apparatus and system for maintaining metadata and data consistency between data centers | |
US20170193039A1 (en) | Servicing queries of an event log | |
CN103631924B (en) | A kind of application process and system of distributive database platform | |
CN105956491A (en) | Method and system for performing multi-account backup on data of public cloud storage system | |
NO326041B1 (en) | Procedure for managing data storage in a system for searching and retrieving information | |
CN102662992A (en) | Method and device for storing and accessing massive small files | |
CN106649467A (en) | Blue-ray disc jukebox archiving management method and system | |
CN114610680B (en) | Distributed file system metadata management method, device, equipment and storage medium | |
CN102664914A (en) | IS/DFS-Image distributed file storage query system | |
WO2018118287A1 (en) | Method and system for maintaining and searching index records | |
CN105608126A (en) | Method and apparatus for establishing secondary indexes for massive databases | |
US20180316756A1 (en) | Cross-platform replication of logical units | |
CN106027615A (en) | Object storage method and system | |
US10452304B2 (en) | Efficient repository migration and storage | |
CN109299059A (en) | File storage, search method, device, storage medium and server | |
CN119127825A (en) | A metadata extension method, device, equipment and storage medium under a distributed file system |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
C06 | Publication | ||
PB01 | Publication | ||
C10 | Entry into substantive examination | ||
SE01 | Entry into force of request for substantive examination | ||
CB02 | Change of applicant information |
Address after: 100190 room 10-08, building Haidian District, Haidian street, Beijing, 38 Applicant after: Beijing Spring Technology Co., Ltd. Address before: 100190 room 10-08, building Haidian District, Haidian street, Beijing, 38 Applicant before: Beijing Chunhong Enterprise Management Consulting Co., Ltd. |
|
CB02 | Change of applicant information | ||
GR01 | Patent grant | ||
GR01 | Patent grant | ||
CF01 | Termination of patent right due to non-payment of annual fee |
Granted publication date: 20181016 Termination date: 20210519 |
|
CF01 | Termination of patent right due to non-payment of annual fee |