+

CN105930233A - Method and system for automatically backing up data of specified public cloud account - Google Patents

Method and system for automatically backing up data of specified public cloud account Download PDF

Info

Publication number
CN105930233A
CN105930233A CN201610338692.XA CN201610338692A CN105930233A CN 105930233 A CN105930233 A CN 105930233A CN 201610338692 A CN201610338692 A CN 201610338692A CN 105930233 A CN105930233 A CN 105930233A
Authority
CN
China
Prior art keywords
data
storage device
account
cloud storage
publicly
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN201610338692.XA
Other languages
Chinese (zh)
Other versions
CN105930233B (en
Inventor
徐超
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Beijing Chunhong Enterprise Management Consulting Co Ltd
Original Assignee
Beijing Chunhong Enterprise Management Consulting Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Beijing Chunhong Enterprise Management Consulting Co Ltd filed Critical Beijing Chunhong Enterprise Management Consulting Co Ltd
Priority to CN201610338692.XA priority Critical patent/CN105930233B/en
Publication of CN105930233A publication Critical patent/CN105930233A/en
Application granted granted Critical
Publication of CN105930233B publication Critical patent/CN105930233B/en
Expired - Fee Related legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F11/00Error detection; Error correction; Monitoring
    • G06F11/07Responding to the occurrence of a fault, e.g. fault tolerance
    • G06F11/14Error detection or correction of the data by redundancy in operation
    • G06F11/1402Saving, restoring, recovering or retrying
    • G06F11/1446Point-in-time backing up or restoration of persistent data
    • G06F11/1448Management of the data involved in backup or backup restore
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/06Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
    • G06F3/0601Interfaces specially adapted for storage systems
    • G06F3/0602Interfaces specially adapted for storage systems specifically adapted to achieve a particular effect
    • G06F3/0614Improving the reliability of storage systems
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/06Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
    • G06F3/0601Interfaces specially adapted for storage systems
    • G06F3/0628Interfaces specially adapted for storage systems making use of a particular technique
    • G06F3/0646Horizontal data movement in storage systems, i.e. moving data in between storage devices or systems
    • G06F3/065Replication mechanisms
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/06Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
    • G06F3/0601Interfaces specially adapted for storage systems
    • G06F3/0668Interfaces specially adapted for storage systems adopting a particular infrastructure
    • G06F3/067Distributed or networked storage systems, e.g. storage area networks [SAN], network attached storage [NAS]

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Human Computer Interaction (AREA)
  • Quality & Reliability (AREA)
  • Information Retrieval, Db Structures And Fs Structures Therefor (AREA)

Abstract

The invention discloses a method and a system for automatically backing up data of a specified public cloud account. The method comprises the following steps: binding an account of a personal private cloud storage system with a certain specified public cloud storage account and a plurality of pieces of storage equipment with WIFI (Wireless Fidelity) functions; performing first traversing on subdirectories under different directories and files in the public cloud storage account by the personal private cloud storage system, exporting the subdirectories under corresponding directories and file name data, and saving the exported subdirectories and the file name data in a database; generating a plurality of task groups according to the subdirectories under the directories and the file name data in the database by the personal private cloud storage system, and waiting for the storage equipment with the WIFI functions to perform active acquisition; and after the storage equipment is networked, automatically starting to download task data from the specified public cloud storage account according to the subdirectories under the directories and the file names in a current task group. Through adoption of the method and the system, content in the specified public cloud account is intelligently and automatically backed up in different storage equipment.

Description

The data specifying publicly-owned cloud account are carried out the method and system of automated back-up respectively
Technical field
The present invention relates to a kind of data to specifying publicly-owned cloud account and carry out the method and system of automated back-up respectively, belong to publicly-owned Cloud storage account data redundancy technique field.
Background technology
Cloud storage is in cloud computing (cloud computing) conceptive extension and a new concept developed, refers to By functions such as cluster application, grid or distributed file systems, storage device various types of in network is led to Cross application software and gather collaborative work, the common system that data storage and Operational Visit function are externally provided.At cloud In storage system (the most publicly-owned cloud storage account, such as Baidu's Dropbox, 360 cloud disks, Kingsoft fast disk etc.), the data that can store Amount is very big, thus a lot of user shares file (such as photo, document etc.) with good friend, often to clear up mobile phone EMS memory simultaneously The documentum privatum of individual can be sent and store to cloud storage system.But meanwhile, the most gradually expose new asking Topic: such as cloud account is stolen, then the individual privacy of user is likely to will be compromised.Therefore, when using cloud storage, number The main misgivings of user are become according to safety issue.It addition, some vital document needed for user is uploaded to cloud storage system After, may because of some former thus result in examination & verification not by so that be deleted, thus bring certain loss to user, with The Consumer's Experience that Shi Zaocheng is bad, thus the data in cloud storage system are backed up in time extremely important with regard to show.
Storage device, such as portable hard drive, its memory space is the biggest, has for individual subscriber, is used for storing standby The file that part is important.If user wants (file useful in cloud storage system being included, user oneself is uploaded to cloud by mobile phone and deposits File in storage system and other people be uploaded to cloud storage system and be shared with the file of user) be stored in its portable hard drive, then Need to first pass through computer to be downloaded from cloud storage system by file, portable hard drive of then restoring.If additionally, cloud storage system System there is file update, need also remain for user and go artificial cognition download to be stored in its people's portable hard drive.Additionally, a use May have the most different catalogues in the cloud storage system at family, user needs to back up the file under certain or some catalogues respectively In some portable hard drive, the file under other catalogues is backed up to the most respectively in one or more portable hard drive, such as, Having aaa, bbb, ccc, ddd, eee, fff totally 6 catalogues in certain cloud storage system of user, user needs catalogue File under aaa individually backups to, in X portable hard drive, the file under catalogue bbb, ccc individually be backuped to Y portable hard drive In, the file under ddd, eee, fff is individually backuped in Z portable hard drive.This is also that people urgently want solve to ask Topic.
Summary of the invention
It is an object of the invention to, it is provided that a kind of data to specifying publicly-owned cloud account carry out the method for automated back-up respectively and are System, it can effectively solve problems of the prior art, it is achieved the content intellectuality respectively that will specify in publicly-owned cloud account Automated back-up is to different storage devices, it is ensured that the safety of data.
For solving above-mentioned technical problem, the present invention adopts the following technical scheme that: a kind of data to specifying publicly-owned cloud account are entered The method of row automated back-up respectively, comprises the following steps:
S1, specifies publicly-owned cloud storage account with certain and multiple with wifi function by the account of individual private possession cloud storage system Storage device is bound;
S2, the subdirectory under each catalogue in described publicly-owned cloud storage account and file are carried out by individual private possession cloud storage system Travel through first, after having traveled through, the subdirectory under respective directories and file name data are derived and preserved to data base;
S3, the subdirectory under each catalogue in data base and file name data are generated multiple tasks by individual private possession cloud storage system Group also waits the storage device active obtaining with wifi function;
S4, after the described storage device with wifi function is networked, obtains task to individual private possession cloud storage system, then Automatically start to download from the publicly-owned cloud storage account of appointment according to the subdirectory under respective directories in current task group and filename and appoint Business data.
Preferably, step S1 specifically includes:
S11, accesses each web management interface with the storage device of wifi function, and utilizes individual private possession cloud storage system Account and the password of system log in;After logging in successfully, each is i.e. deposited with individual private possession cloud with the storage device of wifi function The account of storage system establishes binding relationship;
S12, initiates certain appointment publicly-owned on each described web management interface with the storage device of wifi function The bind request of cloud storage account;Obtain access by the open DLL (i.e. OpenAPI) of publicly-owned cloud storage system to award Power, it is thus achieved that authorize key accordingly;
S13, by the title of described publicly-owned cloud storage system, authorizes key and the equipment with the storage device of wifi function to compile Number it is uploaded to individual private possession cloud storage system and preserves;
S14, individual private possession cloud storage system create multiple different virtual containers so that each virtual container respectively with described finger Each catalogue one_to_one corresponding association in fixed publicly-owned cloud storage account, simultaneously each virtual container with each with wifi function Storage device is carried out one to one, many-one or one-to-many association.
Realized by the account of individual private possession cloud storage system and publicly-owned cloud storage account and with wifi function by said method Storage device is bound, such that it is able to realize individual private possession cloud storage system with the storage device of wifi function and publicly-owned Carry out efficient, safe, steady between storage device and publicly-owned cloud storage system between cloud storage system and with wifi function Fixed communication;Especially by utilize different virtual containers respectively with some specified in publicly-owned cloud storage account or a few Individual catalogue one_to_one corresponding associates, simultaneously each virtual container carry out one to one with the storage device of wifi function with each, many One or one-to-many are associated, such that it is able to utilize each virtual container more accurately, management and control efficiently specify phase in cloud storage account Answer the content backup under catalogue and more new task.
In above-mentioned step S14, divide can to when individual private possession cloud storage system creates multiple different virtual container each container Join a unique mark, when virtual container and certain catalogue specified in publicly-owned cloud storage account and certain is with WiFi function Storage device when binding, individual private possession cloud storage system can record container and uniquely identify and specify publicly-owned cloud storage account In certain catalogue and certain storage device with WiFi function between relation and preserve to individual private possession cloud storage system Data base in.
Preferably, step S2 specifically includes: described different virtual container is in publicly-owned cloud storage account associated there Subdirectory and file under respective directories travel through first, generate data structure (i.e. catalogue and the file of META DATA Structure, further comprises last modification time, file size, MD5 value, whether have been downloaded into wifi function The information such as storage device);After having traveled through, by described filename according to N number of be one group, after being divided into multiple groups, derive For the data (it is all supported by multiple computer language) of json form, and preserve to data base;Wherein, traversal Time, using subdirectory or file name as index value, with file size, last modification time, MD5 value, whether be catalogue Etc. information as the data block of structure type;Such that it is able to optimize individual's cloud storage system management to backup tasks, it is simple to To the storage device transmission tasks with wifi function.
Step S3 specifically includes: the data in data base are generated multiple task groups according to packet by each different virtual container, And according to being grouped acquisition task after waiting the storage device networking with wifi function;Storage device with wifi function is every Secondary the mission bit stream downloading a packet rather than whole mission bit streams, such that it is able to readily available new task, renewal The performance of task and the pressure of reduction individual's cloud storage platform.
In said method, after the described storage device with wifi function is networked, obtain to individual private possession cloud storage system and appoint Business, is then firstly connected to individual private possession cloud storage system, downloads data backup task;Wherein, all of task is all according to N Individual is one group, all contains the account information of publicly-owned cloud storage system and need from this publicly-owned cloud storage system in every group task File name in the catalogue of backup.
Preferably, step S4 specifically includes: after the storage device networking with wifi function, the state of detection storage device, If Active, then initiating task to individual private possession cloud storage system and obtain request, individual private possession cloud storage system inquires and is somebody's turn to do All virtual containers of equipment association, are then handed down to this equipment by virtual container first task groups not being fully completed; This equipment preserves task definition and the numbering of packet, and according to the subdirectory under respective directories in current task group and filename from Dynamic from specifying beginning downloading task data publicly-owned cloud storage account;Often complete the download of a file or complete a task The download of all or part of file of group, then to corresponding virtual container more new task performance (with depositing of wifi function Storage equipment, when downloading task, obtains unique mark of the virtual container generating this task the most simultaneously) and storage device Residue free space;If the residue free space of storage device is less than preset value, then after abandoning the current group obtained Continue task, and the state arranging storage device is Inactive, stop data synchronization service;Otherwise corresponding virtual container is connecing After the task that receives is more newly requested, search the record of correspondence in a packet according to packet numbering and file name, if finding correspondence File record, then arrange fetched=1 (wherein, each file corresponding a fetched value);Wherein, Fetched is the member comprised in META DATA structure, for indicate whether to be downloaded to user with The storage device of wifi function, the default value of fetched is 0;If not finding the file record of correspondence, then return false signal To with the storage device of wifi function, after receiving false signal with the storage device of wifi function, abandon having obtained The follow-up work of current group and reacquire first task groups being not fully complete (this represents that grouped task occurs in that renewal, because of This needs to reacquire grouped task);Often complete the download of a task groups with the storage device of wifi function after, automatically please The next one is asked to be not fully complete task groups, until completing last to be not fully complete task groups.According to the storage device with wifi function Hardware performance, can one by one the task groups in virtual container be processed, or simultaneously in multiple virtual containers appoint Business packet processes.Such that it is able to update list according to data to back up desired data accurately from publicly-owned cloud storage account, carry The efficiency of high data backup and the operational efficiency of whole system.Additionally, arranging fetched is in META DATA structure The member comprised, consequently facilitating the download performance of labelling task;So when under the storage device with wifi function After secondary networking again, being not fully complete of task can be directly downloaded, and need not start anew all to download, alleviate with wifi merit The pressure of the storage device of energy, improves data transmission efficiency;It also avoid when carrying out locally stored space smoothing dilatation simultaneously The problem of the Data duplication backup caused.
In step S4, when detecting the state of storage device, storage device is needed to send its current residual memory space to individual In people's private cloud storage system, individual private possession cloud storage system feeds back its current shape according to the size of preset value to storage device State, for Active or Inactive.
When the state of storage device is Inactive, it is also desirable to periodically reacquire its up-to-date state.
Preferably, in aforesaid method, if the residual memory space of described storage device is less than preset value, the most virtual The state of this storage device is set to Inactive by container, and this storage device stops simultaneously operating;By described storage is set Standby data of deleting are allowed to revert to Active state or by the new storage device of association to this virtual container or virtual Container by other residual memory space associated with it higher than in preset value but storage device that current state is Inactive Individual be set to Active state after, recover data syn-chronization work;Wherein, when virtual container associates multiple storage device, entering During row data syn-chronization, the state of only one of which storage device is Active, and other are Inactive, it is achieved thereby that to this locality The smooth expansion of memory space.
In said method, if the current state of storage device is Active, it is possible to bind new storage device the most virtual to it Container, and if the state of this new storage device be Active, then the upper Active associated with this virtual container The storage device of state can be forced to be set to Inactive, then proceeds data syn-chronization in the storage device that this is new.
It is furthermore preferred that when each catalogue one_to_one corresponding in each virtual container cloud storage publicly-owned with described appointment account associates, with Time with each with the storage device of wifi function carry out many-one associate time, if certain of individual private possession cloud storage system is virtual Container finds the memory space of described storage device less than preset value during performing to synchronize time, then this virtual container is by it It is set to Inactive state with the relation of this storage device;Individual private possession cloud storage system is searched and is notified to set with this storage simultaneously Other virtual containers of standby association, its relation with this storage device is also set to Inactive state by other virtual containers;Number According to synchronous working stop, until described storage device by delete data transfer to Active state or by association new Other residue associated with it is deposited by the storage device with wifi function to each virtual container or each virtual container After storage space is set to Active state higher than in preset value but storage device that current state is Inactive, continue Carry out data syn-chronization work.Such that it is able to all publicly-owned cloud storage that quick, unified control is associated with certain storage device Whether the carrying out of the data syn-chronization work in card of accounts.
Preferably, after the described storage device with wifi function is networked, obtain task to individual private possession cloud storage system, Then under automatically starting from the publicly-owned cloud storage account of appointment according to the subdirectory under respective directories in current task group and filename Load task data specifically includes: parallel processing or serial process;Described parallel processing is i.e. with the storage device of wifi function First obtain first task groups data of all virtual containers associated with this equipment, carry out the most parallel under multiple file Carry;Described serial process the most only obtains the task groups data of a virtual container and carries out file synchronization, has processed one The task data of next virtual container is processed the most successively after all grouped task of individual virtual container.If with wifi function The built-in cpu performance of storage device good, then use parallel processing, if cpu performance is poor, then use serial process; Additionally the read or write speed of storage device also have impact on this selection arranged, and can arrange maximum according to different hardware performances Parallel number of tasks.
The aforesaid data to specifying publicly-owned cloud account are carried out in the method for automated back-up respectively, and step S2 also includes: individual is private There is cloud storage system that the subdirectory under the catalogue of publicly-owned cloud storage account associated there and filename periodically carry out supplementary time Go through (interval time supplementing traversal can adjust, and gives tacit consent to 24 hours once), and rank with subdirectory and the file of local cache Table is compared, and finds out new file, generates the list of download/synchronous task;Specifically include:
First, individual private possession cloud storage system loads the json data of bibliographic structure from data base according to the order being grouped, The internal memory of program preserves this structure of arrays, and by named for this array: old;(element comprised in described array can lead to Crossing filename to retrieve, each element contains a data block, saves corresponding with file name in data block The information relevant to META DATA such as MD5 value, file size, last modification time);
Secondly, according to the mode traveled through first, the subdirectory under publicly-owned each catalogue of cloud storage account and filename are supplemented Traversal, it is thus achieved that the structure of arrays of up-to-date directory traversal result, and by named for this array: new;(its structure and old phase With, same, the element comprised in this array can be retrieved by filename, but each unit in this data structure The fetched value that element comprises is all 0);
Again, from old array, take out an element, new array searched the element identical with this element files name, Without finding, then abandon this element in this old array;If have found the element of correspondence, then contrast two elements MD5 value or file size and last modification time are (when publicly-owned cloud storage system supports MD5 value, then by contrast MD5 Value;When publicly-owned cloud storage system does not support MD5 value, then replaced by documents length and last modification time The comparison of MD5 value;After once downloading/backup to the storage device with wifi function due to the file of cloud disk, user can be from Delete the file of correspondence in cloud disk, be then stored in more new file to cloud disk;Therefore at individual private possession cloud storage system to public affairs Will appearance under the circumstances when having cloud storage account files to be scanned);If it is identical, then element in old array Fetched value be copied in new array correspondence element;Repeat this operation, until all of element all takes in old array Go out;
Finally, after supplementary traversal completes, the data of new array are exported as from the internal memory of program the data of json form, and Preserve to data base with packet mode.
Such that it is able to only to each publicly-owned cloud storage account update file carry out automatic, back up in time, further increase number According to the efficiency automatically updated;Additionally, in said method, after upper once scanning result is generated as multiple task groups, in office Business group there is partial task have been completed (fetched is equal to 1), if these tasks are already at the shape completed State, and file corresponding in cloud disk is not deleted, then it is necessary to according to old in up-to-date cloud disc file scanning result Task list arranges the state of task for complete (arranging fetched is 1).Specifically, by said method, thus The catalogue of up-to-date publicly-owned cloud storage and file structure can be merged with the old data of storage in data base.If it is old In legacy data there is not (such as being deleted by user) in the filename of record in current publicly-owned cloud storage, then just These records are deleted in merging process;If there being file of the same name in new and old record, also will be according to the value of MD5 or literary composition Part length and last modification time judge the most substantial change of file, if file creates change, are just labeled as not Download, the download state of task is the most just set according to the state of reporter's record.For the file existed in only new record Name, then be directly disposed as not downloading.
A kind of data to specifying publicly-owned cloud account carry out the system of automated back-up respectively, including:
Binding module, for by the account of individual private possession cloud storage system with certain specify publicly-owned cloud storage account and multiple with The storage device of wifi function is bound;
Spider module, for individual private possession cloud storage system to the subdirectory under each catalogue in described publicly-owned cloud storage account And file travels through first;
First data derive and memory module, after traversal completes, the subdirectory under respective directories and file name data are led Go out and preserve to data base;
Task generates and distribution module, for individual private possession cloud storage system by the subdirectory under each catalogue in data base and literary composition The multiple task groups of part name data genaration also waits the storage device active obtaining with wifi function;
Automatically download module, after the described storage device with wifi function is networked, to individual private possession cloud storage system Acquisition task, then according to the subdirectory under respective directories in current task group and filename automatically from specifying publicly-owned cloud storage account Family starts downloading task data.
Preferably, described binding module also includes:
Login module, for accessing each web management interface with the storage device of wifi function, and utilizes individual private possession Account and the password of cloud storage system log in;After logging in successfully, each with wifi function storage device i.e. with individual The account of private cloud storage system establishes binding relationship;
Bind request sending module, for sending out on each described web management interface with the storage device of wifi function Play the bind request to certain publicly-owned cloud storage account of appointment;
Access and authorize acquisition module, visit for being obtained by the open DLL (i.e. OpenAPI) of publicly-owned cloud storage system Ask mandate, it is thus achieved that authorize key accordingly;
Transmission module in information, for by the title of described publicly-owned cloud storage system, mandate key and depositing with wifi function The device numbering of storage equipment is uploaded to individual private possession cloud storage system and preserves;
Virtual container creates and relating module, creates multiple different virtual containers for individual private possession cloud storage system so that Each catalogue one_to_one corresponding in each virtual container cloud storage account publicly-owned with described appointment respectively associates, and each is virtual simultaneously Container is carried out one to one with the storage device of wifi function with each, many-one or one-to-many associate.
Preferably, described spider module also includes:
Structure of arrays generation module, for described different virtual container to phase in publicly-owned cloud storage account associated there Answer the subdirectory under catalogue and file to travel through first, generate the data structure of META DATA;
First data derive and memory module also includes:
Packet module, after traversal completes, by described filename according to N number of be one group, be divided into multiple groups After, export as the data of json form, and preserve to data base;Wherein, during traversal, it is referred to as with subdirectory or filename For index value.
Preferably, described automatic download module also includes:
State detection module, after networking with the storage device of wifi function, the state of detection storage device;
Logging modle, if the state for storage device is Active, then initiating task acquisition to individual private possession cloud storage system please Asking, individual private possession cloud storage system inquires all virtual containers associated with this equipment, then by virtual container first The task groups not being fully completed is handed down to this equipment;This equipment preserves task definition and the numbering of packet;
Information feedback module, for often completing the download of a file or completing one with the storage device of wifi function The download of all or part of file of business group, then surplus to corresponding virtual container more new task performance and storage device Remaining free space;
File record is searched and arranges module, if when the residue free space of storage device is more than preset value, the most accordingly Virtual container, after the task that receives is more newly requested, searches the record of correspondence in a packet according to packet numbering and file name, If finding the file record of correspondence, then fetched=1 is set;Wherein, fetched comprises in being META DATA structure A member, for indicating whether to be downloaded to the storage device with wifi function of user, the acquiescence of fetched Value is 0;If not finding the file record of correspondence, then return false signal to the storage device with wifi function;
Task is abandoned and reacquires module, after receiving false signal with the storage device of wifi function, abandons The follow-up work of current group that obtains also reacquires first task groups being not fully complete;
The automatic request module of task, after the download often completing a task groups with the storage device of wifi function, automatically The request next one is not fully complete task groups, until completing last to be not fully complete task groups.
Preferably, described automatic download module also includes:
Arranging module, when the residual memory space of described storage device is less than preset value, then this is deposited by corresponding virtual container The state of storage equipment is set to Inactive, and this storage device stops simultaneously operating;
Processing module, is allowed to revert to Active state or associate new depositing for described storage device is deleted data Storage equipment to this virtual container or virtual container by associated with it other residual memory space higher than preset value but current State is after in the storage device of Inactive is set to Active state, recovers data syn-chronization work;Wherein, empty When intending the container multiple storage device of association, when carrying out data syn-chronization, the state of only one of which storage device is Active, other It is Inactive.
The aforesaid data to specifying publicly-owned cloud account are carried out in the system of automated back-up respectively, and described spider module is also wrapped Include:
Supplement traversal and contrast module, for individual private possession cloud storage system periodically to publicly-owned cloud storage account associated there Catalogue under subdirectory and filename carry out supplementing traversal, and compare with subdirectory and the list of file names of local cache Right, find out new file, generate the list of download/synchronous task;
Described supplementary traversal and contrast module specifically include:
Data load and memory module: for individual private possession cloud storage system order loading catalogue according to packet from data base The json data of structure, preserve this structure of arrays in the internal memory of program, and by named for this array: old;
Supplement spider module: be used for according to the mode traveled through first the subdirectory under publicly-owned each catalogue of cloud storage account and literary composition Part name carries out supplementing traversal, it is thus achieved that the structure of arrays of up-to-date directory traversal result, and by named for this array: new;
Data Comparison module: for taking out an element from old array, search and this element files name in new array Identical element, without finding, then abandons this element in this old array;If have found the element of correspondence, the most right Than the MD5 value of two elements or file size and last modification time;If it is identical, then element in old array Fetched value is copied in new array the element of correspondence;Repeat this operation, until all of element all takes in old array Go out;
Second data derive and memory module, are used for supplementing after traversal completes, the data of new array are led from the internal memory of program Go out the data for json form, and preserve to data base with packet mode.
Compared with prior art, the invention have the advantages that
1, the present invention by by the account of individual private possession cloud storage system with certain specify publicly-owned cloud storage account and multiple with The storage device of wifi function is bound;Individual private possession cloud storage system is under each catalogue in described publicly-owned cloud storage account Subdirectory and file travel through first, after having traveled through, the subdirectory under respective directories and file name data are derived also Preserve to data base;Subdirectory under each catalogue in data base and file name data are generated by individual private possession cloud storage system Multiple task groups also wait the storage device active obtaining with wifi function;The described storage device with wifi function is networked After, obtain task to individual private possession cloud storage system, then according to the subdirectory under respective directories in current task group and file Name is automatically from specifying beginning downloading task data publicly-owned cloud storage account.It is achieved thereby that in specifying in publicly-owned cloud account Hold and the most intelligent automatic backup to different storage devices, it is ensured that the safety of data;And whole process is all without user Manual operations, data backup efficiency is higher;
2, by utilizing different virtual containers respectively with some or certain the several catalogues specified in publicly-owned cloud storage account one by one Corresponding association, simultaneously each virtual container carry out one to one with the storage device of wifi function with each, many-one or one-to-many Association, such that it is able to utilize each virtual container more accurately, management and control efficiently specify in cloud storage account under respective directories interior Hold backup and more new task;
3, individual private possession cloud storage system is periodically to the subdirectory under the catalogue of publicly-owned cloud storage account associated there and file Name carries out supplementing traversal, and compares with subdirectory and the list of file names of local cache, finds out new file, generates and downloads The list of/synchronous task, such that it is able to only to each publicly-owned cloud storage account update file carry out automatic, back up in time, enter One step improves the efficiency of automatically updating data;
4, in the present invention, if the residual memory space of described storage device is less than preset value, then corresponding virtual container should The state of storage device is set to Inactive, and this storage device stops simultaneously operating;By described storage device is deleted number According to being allowed to revert to Active state or will be with it to this virtual container or virtual container by associating new storage device Other residual memory space of association is set to higher than in preset value but storage device that current state is Inactive After Active state, recover data syn-chronization work;Wherein, when virtual container associates multiple storage device, data syn-chronization is being carried out Time, the state of only one of which storage device is Active, and other are Inactive, it is achieved thereby that to locally stored space Smooth expansion;
5, associate when each catalogue one_to_one corresponding in each virtual container cloud storage publicly-owned with described appointment account, simultaneously with respectively When the individual storage device with wifi function carries out many-one association, if certain virtual container of individual private possession cloud storage system performs When finding the memory space of described storage device during synchronization less than preset value, then this virtual container is by itself and this storage The relation of equipment is set to Inactive state;Individual private possession cloud storage system is searched and notifies to associate with this storage device simultaneously Other virtual containers, its relation with this storage device is also set to Inactive state by other virtual containers;Data syn-chronization work Work stops, until described storage device transfers Active state or new with wifi merit by association to by deleting data Can storage device to each virtual container or each virtual container, other residual memory space associated with it is higher than After preset value but in storage device that current state is Inactive one are set to Active state, proceed data syn-chronization Work.Such that it is able in all publicly-owned cloud storage card of accounts that is associated with certain storage device of quick, unified control Whether the carrying out of data syn-chronization work.
Accompanying drawing explanation
Fig. 1 is the method flow diagram of a kind of embodiment of the present invention;
Fig. 2 is that the account of the individual private possession cloud storage system storage device with Baidu Yun account and with wifi function is carried out The method flow diagram of binding;
Fig. 3 is that the storage device with wifi function performs backup tasks and individual private possession cloud storage system (drop cloud) is sent out There is new file and generate the flow chart of backup tasks in existing publicly-owned cloud storage.
The present invention is further illustrated with detailed description of the invention below in conjunction with the accompanying drawings.
Detailed description of the invention
Embodiments of the invention 1: a kind of method that data to specifying publicly-owned cloud account carry out respectively automated back-up, as Fig. 1, Shown in Fig. 3, comprise the following steps:
S1, specifies publicly-owned cloud storage account with certain and multiple with wifi function by the account of individual private possession cloud storage system Storage device is bound;Specifically include:
S11, accesses each web management interface with the storage device of wifi function, and utilizes individual private possession cloud storage system Account and the password of system log in;After logging in successfully, each is i.e. deposited with individual private possession cloud with the storage device of wifi function The account of storage system establishes binding relationship;
S12, initiates certain appointment publicly-owned on each described web management interface with the storage device of wifi function The bind request of cloud storage account;Obtain access by the open DLL (i.e. OpenAPI) of publicly-owned cloud storage system to award Power, it is thus achieved that authorize key accordingly;
S13, by the title of described publicly-owned cloud storage system, authorizes key and the equipment with the storage device of wifi function to compile Number it is uploaded to individual private possession cloud storage system and preserves;
S14, individual private possession cloud storage system create multiple different virtual containers so that each virtual container respectively with described finger Each catalogue one_to_one corresponding association in fixed publicly-owned cloud storage account, simultaneously each virtual container with each with wifi function Storage device is carried out one to one, many-one or one-to-many association;
S2, the subdirectory under each catalogue in described publicly-owned cloud storage account and file are carried out by individual private possession cloud storage system Travel through first, after having traveled through, the subdirectory under respective directories and file name data are derived and preserved to data base;Tool Body includes: described different virtual container to the subdirectory under respective directories in publicly-owned cloud storage account associated there and File travels through first, generates the data structure of META DATA;After having traveled through, by described filename according to N Individual is one group, after being divided into multiple groups, exports as the data of json form, and preserves to data base;Wherein, traversal Time, using subdirectory or file name as index value;
Step S2 also includes: under individual private possession cloud storage system periodically catalogue to publicly-owned cloud storage account associated there Subdirectory and filename carry out supplementing traversal, and compare with subdirectory and the list of file names of local cache, find out new literary composition Part, generates the list of download/synchronous task;Specifically include:
First, individual private possession cloud storage system loads the json data of bibliographic structure from data base according to the order being grouped, The internal memory of program preserves this structure of arrays, and by named for this array: old;
Secondly, according to the mode traveled through first, the subdirectory under publicly-owned each catalogue of cloud storage account and filename are supplemented Traversal, it is thus achieved that the structure of arrays of up-to-date directory traversal result, and by named for this array: new;
Again, from old array, take out an element, new array searched the element identical with this element files name, Without finding, then abandon this element in this old array;If have found the element of correspondence, then contrast two elements MD5 value or file size and last modification time;If identical, then the fetched value of element in old array is copied to Element corresponding in new array;Repeat this operation, until all of element all takes out in old array;
Finally, after supplementary traversal completes, the data of new array are exported as from the internal memory of program the data of json form, and Preserve to data base with packet mode;
S3, the subdirectory under each catalogue in data base and file name data are generated multiple tasks by individual private possession cloud storage system Group also waits the storage device active obtaining with wifi function;
S4, after the described storage device with wifi function is networked, obtains task to individual private possession cloud storage system, then Automatically start to download from the publicly-owned cloud storage account of appointment according to the subdirectory under respective directories in current task group and filename and appoint Business data;Specifically include: after the storage device networking with wifi function, the state of detection storage device, if Active, then initiate task to individual private possession cloud storage system and obtain request, and individual private possession cloud storage system inquires and this equipment All virtual containers of association, are then handed down to this equipment by virtual container first task groups not being fully completed;This sets Standby task definition and the numbering of packet of preserving, and according to the subdirectory under respective directories in current task group and filename automatically from Specify beginning downloading task data in publicly-owned cloud storage account;Often complete downloading or completing a task groups of a file The download of all or part of file, then can use to the residue of corresponding virtual container more new task performance and storage device Space;If the residue free space of storage device is less than preset value, then abandon the follow-up work of the current group obtained, And the state arranging storage device is Inactive, stop data synchronization service;Otherwise corresponding virtual container is receiving task After more newly requested, search the record of correspondence in a packet according to packet numbering and file name, if finding the file note of correspondence Record, then arrange fetched=1;Wherein, fetched is the member comprised in META DATA structure, for table Showing the storage device with wifi function whether having been downloaded into user, the default value of fetched is 0;If it is right not find The file record answered, then return false signal and receive to the storage device with wifi function, the storage device with wifi function After false signal, abandon the follow-up work of current group that obtained and reacquire first task groups being not fully complete; Often complete the download of a task groups with the storage device of wifi function after, the request next one is not fully complete task groups, directly automatically It is not fully complete task groups to completing last;If the residual memory space of described storage device is less than preset value, the most accordingly The state of this storage device is set to Inactive by virtual container, and this storage device stops simultaneously operating;By described is deposited Storage equipment delete data be allowed to revert to Active state or by the new storage device of association to this virtual container or Virtual container by other residual memory space associated with it higher than in preset value but storage device that current state is Inactive One be set to Active state after, recover data syn-chronization work;Wherein, when virtual container associates multiple storage device, When carrying out data syn-chronization, the state of only one of which storage device is Active, and other are Inactive.
A kind of data to specifying publicly-owned cloud account carry out the system of automated back-up respectively, including:
Binding module, for by the account of individual private possession cloud storage system with certain specify publicly-owned cloud storage account and multiple with The storage device of wifi function is bound;
Spider module, for individual private possession cloud storage system to the subdirectory under each catalogue in described publicly-owned cloud storage account And file travels through first;
First data derive and memory module, after traversal completes, the subdirectory under respective directories and file name data are led Go out and preserve to data base;
Task generates and distribution module, for individual private possession cloud storage system by the subdirectory under each catalogue in data base and literary composition The multiple task groups of part name data genaration also waits the storage device active obtaining with wifi function;
Automatically download module, after the described storage device with wifi function is networked, to individual private possession cloud storage system Acquisition task, then according to the subdirectory under respective directories in current task group and filename automatically from specifying publicly-owned cloud storage account Family starts downloading task data.
Described binding module also includes:
Login module, for accessing each web management interface with the storage device of wifi function, and utilizes individual private possession Account and the password of cloud storage system log in;After logging in successfully, each with wifi function storage device i.e. with individual The account of private cloud storage system establishes binding relationship;
Bind request sending module, for sending out on each described web management interface with the storage device of wifi function Play the bind request to certain publicly-owned cloud storage account of appointment;
Access and authorize acquisition module, visit for being obtained by the open DLL (i.e. OpenAPI) of publicly-owned cloud storage system Ask mandate, it is thus achieved that authorize key accordingly;
Transmission module in information, for by the title of described publicly-owned cloud storage system, mandate key and depositing with wifi function The device numbering of storage equipment is uploaded to individual private possession cloud storage system and preserves;
Virtual container creates and relating module, creates multiple different virtual containers for individual private possession cloud storage system so that Each catalogue one_to_one corresponding in each virtual container cloud storage account publicly-owned with described appointment respectively associates, and each is virtual simultaneously Container is carried out one to one with the storage device of wifi function with each, many-one or one-to-many associate.
Described spider module also includes:
Structure of arrays generation module, for described different virtual container to phase in publicly-owned cloud storage account associated there Answer the subdirectory under catalogue and file to travel through first, generate the data structure of META DATA;
First data derive and memory module also includes:
Packet module, after traversal completes, by described filename according to N number of be one group, be divided into multiple groups After, export as the data of json form, and preserve to data base;Wherein, during traversal, it is referred to as with subdirectory or filename For index value.
Described automatic download module also includes:
State detection module, after networking with the storage device of wifi function, the state of detection storage device;
Logging modle, if the state for storage device is Active, then initiating task acquisition to individual private possession cloud storage system please Asking, individual private possession cloud storage system inquires all virtual containers associated with this equipment, then by virtual container first The task groups not being fully completed is handed down to this equipment;This equipment preserves task definition and the numbering of packet;
Information feedback module, for often completing the download of a file or completing one with the storage device of wifi function The download of all or part of file of business group, then surplus to corresponding virtual container more new task performance and storage device Remaining free space;
File record is searched and arranges module, if when the residue free space of storage device is more than preset value, the most accordingly Virtual container, after the task that receives is more newly requested, searches the record of correspondence in a packet according to packet numbering and file name, If finding the file record of correspondence, then fetched=1 is set;Wherein, fetched comprises in being META DATA structure A member, for indicating whether to be downloaded to the storage device with wifi function of user, the acquiescence of fetched Value is 0;If not finding the file record of correspondence, then return false signal to the storage device with wifi function;
Task is abandoned and reacquires module, after receiving false signal with the storage device of wifi function, abandons The follow-up work of current group that obtains also reacquires first task groups being not fully complete;
The automatic request module of task, after the download often completing a task groups with the storage device of wifi function, automatically The request next one is not fully complete task groups, until completing last to be not fully complete task groups.
Described automatic download module also includes:
Arranging module, when the residual memory space of described storage device is less than preset value, then corresponding virtual container should The state of storage device is set to Inactive, and this storage device stops simultaneously operating;
Processing module, is allowed to revert to Active state or associate new depositing for described storage device is deleted data Storage equipment to this virtual container or virtual container by associated with it other residual memory space higher than preset value but current State is after in the storage device of Inactive is set to Active state, recovers data syn-chronization work;Wherein, empty When intending the container multiple storage device of association, when carrying out data syn-chronization, the state of only one of which storage device is Active, other It is Inactive.
Described spider module also includes:
Supplement traversal and contrast module, for individual private possession cloud storage system periodically to publicly-owned cloud storage account associated there Catalogue under subdirectory and filename carry out supplementing traversal, and compare with subdirectory and the list of file names of local cache Right, find out new file, generate the list of download/synchronous task;
Described supplementary traversal and contrast module specifically include:
Data load and memory module: for individual private possession cloud storage system order loading catalogue according to packet from data base The json data of structure, preserve this structure of arrays in the internal memory of program, and by named for this array: old;
Supplement spider module: be used for according to the mode traveled through first the subdirectory under publicly-owned each catalogue of cloud storage account and literary composition Part name carries out supplementing traversal, it is thus achieved that the structure of arrays of up-to-date directory traversal result, and by named for this array: new;
Data Comparison module: for taking out an element from old array, search and this element files name in new array Identical element, without finding, then abandons this element in this old array;If have found the element of correspondence, the most right Than the MD5 value of two elements or file size and last modification time;If it is identical, then element in old array Fetched value is copied in new array the element of correspondence;Repeat this operation, until all of element all takes in old array Go out;
Second data derive and memory module, are used for supplementing after traversal completes, the data of new array are led from the internal memory of program Go out the data for json form, and preserve to data base with packet mode.
Embodiment 2: a kind of method that data to specifying publicly-owned cloud account carry out automated back-up respectively, as it is shown in figure 1, include Following steps:
S1, specifies publicly-owned cloud storage account with certain and multiple with wifi function by the account of individual private possession cloud storage system Storage device is bound;Specifically include:
S11, accesses each web management interface with the storage device of wifi function, and utilizes individual private possession cloud storage system Account and the password of system log in;After logging in successfully, each is i.e. deposited with individual private possession cloud with the storage device of wifi function The account of storage system establishes binding relationship;
S12, initiates certain appointment publicly-owned on each described web management interface with the storage device of wifi function The bind request of cloud storage account;Obtain access by the open DLL (i.e. OpenAPI) of publicly-owned cloud storage system to award Power, it is thus achieved that authorize key accordingly;
S13, by the title of described publicly-owned cloud storage system, authorizes key and the equipment with the storage device of wifi function to compile Number it is uploaded to individual private possession cloud storage system and preserves;
S14, individual private possession cloud storage system create multiple different virtual containers so that each virtual container respectively with described finger Each catalogue one_to_one corresponding association in fixed publicly-owned cloud storage account, simultaneously each virtual container with each with wifi function Storage device is carried out one to one, many-one or one-to-many association;
S2, the subdirectory under each catalogue in described publicly-owned cloud storage account and file are carried out by individual private possession cloud storage system Travel through first, after having traveled through, the subdirectory under respective directories and file name data are derived and preserved to data base;Tool Body includes: described different virtual container to the subdirectory under respective directories in publicly-owned cloud storage account associated there and File travels through first, generates the data structure of META DATA;After having traveled through, by described filename according to N Individual is one group, after being divided into multiple groups, exports as the data of json form, and preserves to data base;Wherein, traversal Time, using subdirectory or file name as index value;
S3, the subdirectory under each catalogue in data base and file name data are generated multiple tasks by individual private possession cloud storage system Group also waits the storage device active obtaining with wifi function;
S4, after the described storage device with wifi function is networked, obtains task to individual private possession cloud storage system, then Automatically start to download from the publicly-owned cloud storage account of appointment according to the subdirectory under respective directories in current task group and filename and appoint Business data;Specifically include: after the storage device networking with wifi function, the state of detection storage device, if Active, then initiate task to individual private possession cloud storage system and obtain request, and individual private possession cloud storage system inquires and this equipment All virtual containers of association, are then handed down to this equipment by virtual container first task groups not being fully completed;This sets Standby task definition and the numbering of packet of preserving, and according to the subdirectory under respective directories in current task group and filename automatically from Specify beginning downloading task data in publicly-owned cloud storage account;Often complete downloading or completing a task groups of a file The download of all or part of file, then can use to the residue of corresponding virtual container more new task performance and storage device Space;If the residue free space of storage device is less than preset value, then abandon the follow-up work of the current group obtained, And the state arranging storage device is Inactive, stop data synchronization service;Otherwise corresponding virtual container is receiving task After more newly requested, search the record of correspondence in a packet according to packet numbering and file name, if finding the file note of correspondence Record, then arrange fetched=1;Wherein, fetched is the member comprised in META DATA structure, for table Showing the storage device with wifi function whether having been downloaded into user, the default value of fetched is 0;If it is right not find The file record answered, then return false signal and receive to the storage device with wifi function, the storage device with wifi function After false signal, abandon the follow-up work of current group that obtained and reacquire first task groups being not fully complete; Often complete the download of a task groups with the storage device of wifi function after, the request next one is not fully complete task groups, directly automatically It is not fully complete task groups to completing last.
A kind of data to specifying publicly-owned cloud account carry out the system of automated back-up respectively, including:
Binding module, for by the account of individual private possession cloud storage system with certain specify publicly-owned cloud storage account and multiple with The storage device of wifi function is bound;
Spider module, for individual private possession cloud storage system to the subdirectory under each catalogue in described publicly-owned cloud storage account And file travels through first;
First data derive and memory module, after traversal completes, the subdirectory under respective directories and file name data are led Go out and preserve to data base;
Task generates and distribution module, for individual private possession cloud storage system by the subdirectory under each catalogue in data base and literary composition The multiple task groups of part name data genaration also waits the storage device active obtaining with wifi function;
Automatically download module, after the described storage device with wifi function is networked, to individual private possession cloud storage system Acquisition task, then according to the subdirectory under respective directories in current task group and filename automatically from specifying publicly-owned cloud storage account Family starts downloading task data.
Described binding module also includes:
Login module, for accessing each web management interface with the storage device of wifi function, and utilizes individual private possession Account and the password of cloud storage system log in;After logging in successfully, each with wifi function storage device i.e. with individual The account of private cloud storage system establishes binding relationship;
Bind request sending module, for sending out on each described web management interface with the storage device of wifi function Play the bind request to certain publicly-owned cloud storage account of appointment;
Access and authorize acquisition module, visit for being obtained by the open DLL (i.e. OpenAPI) of publicly-owned cloud storage system Ask mandate, it is thus achieved that authorize key accordingly;
Transmission module in information, for by the title of described publicly-owned cloud storage system, mandate key and depositing with wifi function The device numbering of storage equipment is uploaded to individual private possession cloud storage system and preserves;
Virtual container creates and relating module, creates multiple different virtual containers for individual private possession cloud storage system so that Each catalogue one_to_one corresponding in each virtual container cloud storage account publicly-owned with described appointment respectively associates, and each is virtual simultaneously Container is carried out one to one with the storage device of wifi function with each, many-one or one-to-many associate.
Described spider module also includes:
Structure of arrays generation module, for described different virtual container to phase in publicly-owned cloud storage account associated there Answer the subdirectory under catalogue and file to travel through first, generate the data structure of META DATA;
First data derive and memory module also includes:
Packet module, after traversal completes, by described filename according to N number of be one group, be divided into multiple groups After, export as the data of json form, and preserve to data base;Wherein, during traversal, it is referred to as with subdirectory or filename For index value.
Described automatic download module also includes:
State detection module, after networking with the storage device of wifi function, the state of detection storage device;
Logging modle, if the state for storage device is Active, then initiating task acquisition to individual private possession cloud storage system please Asking, individual private possession cloud storage system inquires all virtual containers associated with this equipment, then by virtual container first The task groups not being fully completed is handed down to this equipment;This equipment preserves task definition and the numbering of packet;
Information feedback module, for often completing the download of a file or completing one with the storage device of wifi function The download of all or part of file of business group, then surplus to corresponding virtual container more new task performance and storage device Remaining free space;
File record is searched and arranges module, if when the residue free space of storage device is more than preset value, the most accordingly Virtual container, after the task that receives is more newly requested, searches the record of correspondence in a packet according to packet numbering and file name, If finding the file record of correspondence, then fetched=1 is set;Wherein, fetched comprises in being META DATA structure A member, for indicating whether to be downloaded to the storage device with wifi function of user, the acquiescence of fetched Value is 0;If not finding the file record of correspondence, then return false signal to the storage device with wifi function;
Task is abandoned and reacquires module, after receiving false signal with the storage device of wifi function, abandons The follow-up work of current group that obtains also reacquires first task groups being not fully complete;
The automatic request module of task, after the download often completing a task groups with the storage device of wifi function, automatically The request next one is not fully complete task groups, until completing last to be not fully complete task groups.
Embodiment 3: a kind of method that data to specifying publicly-owned cloud account carry out automated back-up respectively, comprises the following steps:
S1, specifies publicly-owned cloud storage account with certain and multiple with wifi function by the account of individual private possession cloud storage system Storage device is bound;
S2, the subdirectory under each catalogue in described publicly-owned cloud storage account and file are carried out by individual private possession cloud storage system Travel through first, after having traveled through, the subdirectory under respective directories and file name data are derived and preserved to data base;
S3, the subdirectory under each catalogue in data base and file name data are generated multiple tasks by individual private possession cloud storage system Group also waits the storage device active obtaining with wifi function;
S4, after the described storage device with wifi function is networked, obtains task to individual private possession cloud storage system, then Automatically start to download from the publicly-owned cloud storage account of appointment according to the subdirectory under respective directories in current task group and filename and appoint Business data.
A kind of data to specifying publicly-owned cloud account carry out the system of automated back-up respectively, including:
Binding module, for by the account of individual private possession cloud storage system with certain specify publicly-owned cloud storage account and multiple with The storage device of wifi function is bound;
Spider module, for individual private possession cloud storage system to the subdirectory under each catalogue in described publicly-owned cloud storage account And file travels through first;
First data derive and memory module, after traversal completes, the subdirectory under respective directories and file name data are led Go out and preserve to data base;
Task generates and distribution module, for individual private possession cloud storage system by the subdirectory under each catalogue in data base and literary composition The multiple task groups of part name data genaration also waits the storage device active obtaining with wifi function;
Automatically download module, after the described storage device with wifi function is networked, to individual private possession cloud storage system Acquisition task, then according to the subdirectory under respective directories in current task group and filename automatically from specifying publicly-owned cloud storage account Family starts downloading task data.
The operation principle of a kind of embodiment of the present invention: as in figure 2 it is shown, access the A dish with wifi function, B respectively Dish, C dish, D dish, the web management interface of E dish, and utilize the account of individual private possession cloud storage system and password to step on Land;After logging in successfully, described A dish, B dish, C dish, D dish, E dish i.e. account with individual private possession cloud storage system is built Found binding relationship;Described A dish, B dish, C dish, D dish, E dish web management interface on initiate certain is referred to The bind request of fixed publicly-owned cloud storage account (such as Baidu Yun account);By the open DLL of Baidu Yun (i.e. OpenAPI) obtains to access and authorizes, it is thus achieved that authorize key accordingly;Title by described publicly-owned cloud storage system (Baidu Yun), mandate key and A dish, B dish, C dish, D dish, the device numbering of E dish are uploaded to individual private possession cloud and deposit Storage system also preserves;Individual private possession cloud storage system creates 6 different virtual containers, such as S1 virtual container, the virtual appearance of S2 Device, S3 virtual container, S4 virtual container, S5 virtual container, S6 virtual container, and create following incidence relation:
The aaa catalogue S1 virtual container A dish of Baidu Yun account
The bbb catalogue S2 virtual container B dish of Baidu Yun account
The ccc catalogue S3 virtual container B dish of Baidu Yun account
The ddd catalogue S4 virtual container C dish of Baidu Yun account
The eee catalogue S5 virtual container C dish of Baidu Yun account
The fff catalogue S6 virtual container C dish of Baidu Yun account and D dish and E dish
Utilize S1 virtual container, S2 virtual container, S3 virtual container, S4 virtual container, S5 virtual container, S6 virtual The data backup of different directories and more new task in container management and control Baidu cloud account respectively, and carry out a pair with portable hard drive One, one-to-many or many-one association, it is achieved thereby that by the most standby for the data under different directories in the publicly-owned cloud account of appointment In the portable hard drive that part is same or the most different.
In backup procedure, A dish, B dish, C dish constantly can feed back residual memory space to each virtual container, if A The residual memory space of dish is less than preset value, then its incidence relation with A dish is set to Inactive, A by S1 virtual container Dish stop back-up job, until by delete A dish data so that it is revert to Active state or by association new Portable hard drive such as F dish is to after S1 virtual container, and back-up job continues.
In like manner, if in backup procedure, S2 virtual container receives the residual memory space of information B dish and is less than preset value, Then its incidence relation with B dish is set to Inactive by S2 virtual container, and meanwhile, individual private possession cloud storage system searches it The virtual container that he associates with B dish, finds and informs S3 virtual container, and S3 virtual container is by itself and the incidence relation of B dish It is also configured as Inactive, B dish and stops back-up job, until by the data deleting B dish so that it is revert to Active shape State or by the new portable hard drive such as G dish of association to S2, S3 virtual container after, back-up job continues.
By that analogy, the association of S6 virtual container has C dish, D dish and 3 storage devices of E dish, in data synchronization process In, only one of which storage device is in Active state, such as C dish, and other 2 are Inactive state.
If in backup procedure, S4 virtual container receives the residual memory space of information C dish and is less than preset value, then S4 is empty Intending container and its incidence relation with C dish is set to Inactive, meanwhile, individual private possession cloud storage system searches other and C The virtual container of dish association, finds and informs that S5 virtual container and S6 virtual container, S5 virtual container and S6 virtual container will It is also configured as Inactive, C dish stopping back-up job with the incidence relation of C dish, until by the data deleting C dish, It is made to revert to Active state or by associating new portable hard drive such as H dish to S4, S5, S6 virtual container After, back-up job continues.Or the state of D dish or E dish is set to Active by S6 virtual container, proceed to synchronize work Make (only limit S6 virtual container).

Claims (12)

1. the method that the data to specifying publicly-owned cloud account carry out automated back-up respectively, it is characterised in that comprise the following steps:
S1, specifies publicly-owned cloud storage account and multiple storage with wifi function by the account of individual private possession cloud storage system with certain Equipment is bound;
S2, the subdirectory under each catalogue in described publicly-owned cloud storage account and file are carried out first by individual private possession cloud storage system Traversal, after having traveled through, derives the subdirectory under respective directories and file name data and preserves to data base;
S3, the subdirectory under each catalogue in data base and file name data are generated multiple task groups also by individual private possession cloud storage system Wait the storage device active obtaining with wifi function;
S4, after the described storage device with wifi function is networked, obtains task, then basis to individual private possession cloud storage system In current task group, the subdirectory under respective directories and filename are automatically from specifying beginning downloading task number publicly-owned cloud storage account According to.
The method that data to specifying publicly-owned cloud account the most according to claim 1 carry out automated back-up respectively, its feature exists In, step S1 specifically includes:
S11, accesses each web management interface with the storage device of wifi function, and utilizes individual private possession cloud storage system Account and password log in;After logging in successfully, each with wifi function storage device i.e. with individual private possession cloud storage system The account of system establishes binding relationship;
S12, initiates to specify publicly-owned cloud to deposit certain on each described web management interface with the storage device of wifi function The bind request of storage account;Obtain to access by the open DLL of publicly-owned cloud storage system and authorize, it is thus achieved that authorize accordingly key;
S13, by the title of described publicly-owned cloud storage system, authorizes on key and the device numbering with the storage device of wifi function Reach individual private possession cloud storage system and preserve;
S14, individual private possession cloud storage system creates multiple different virtual containers so that each virtual container specifies public affairs with described respectively Have each catalogue one_to_one corresponding in cloud storage account to associate, simultaneously each virtual container with each with the storage of wifi function Equipment is carried out one to one, many-one or one-to-many association.
The method that data to specifying publicly-owned cloud account the most according to claim 2 carry out automated back-up respectively, its feature exists In, step S2 specifically includes: described different virtual container is to respective directories in publicly-owned cloud storage account associated there Under subdirectory and file travel through first, generate META DATA data structure;After having traveled through, by described Filename according to N number of be one group, after being divided into multiple groups, export as the data of json form, and preserve to data base; Wherein, during traversal, using subdirectory or file name as index value.
The method that data to specifying publicly-owned cloud account the most according to claim 2 carry out automated back-up respectively, its feature exists In, step S4 specifically includes: after the storage device networking with wifi function, the state of detection storage device, if Active, then initiate task to individual private possession cloud storage system and obtain request, and individual private possession cloud storage system inquires and this equipment All virtual containers of association, are then handed down to this equipment by virtual container first task groups not being fully completed;This sets Standby task definition and the numbering of packet of preserving, and according to the subdirectory under respective directories in current task group and filename automatically from Specify beginning downloading task data in publicly-owned cloud storage account;Often complete downloading or completing a task groups of a file The download of all or part of file, then can use to the residue of corresponding virtual container more new task performance and storage device Space;If the residue free space of storage device is less than preset value, then abandon the follow-up work of the current group obtained, And the state arranging storage device is Inactive, stop data synchronization service;Otherwise corresponding virtual container is receiving task After more newly requested, search the record of correspondence in a packet according to packet numbering and file name, if finding the file note of correspondence Record, then arrange fetched=1;Wherein, fetched is the member comprised in META DATA structure, for table Showing the storage device with wifi function whether having been downloaded into user, the default value of fetched is 0;If it is right not find The file record answered, then return false signal and receive to the storage device with wifi function, the storage device with wifi function After false signal, abandon the follow-up work of current group that obtained and reacquire first task groups being not fully complete; Often complete the download of a task groups with the storage device of wifi function after, the request next one is not fully complete task groups, directly automatically It is not fully complete task groups to completing last.
The method that data to specifying publicly-owned cloud account the most according to claim 4 carry out automated back-up respectively, its feature exists In, if the residual memory space of described storage device is less than preset value, then corresponding virtual container is by the shape of this storage device State is set to Inactive, and this storage device stops simultaneously operating;It is allowed to revert to by described storage device is deleted data Active state or by the new storage device of association to this virtual container or virtual container by associated with it other Residual memory space is set to Active state higher than in preset value but storage device that current state is Inactive After, recover data syn-chronization work;Wherein, when virtual container associates multiple storage device, when carrying out data syn-chronization, only The state of one storage device is Active, and other are Inactive.
6. according to the method that the data specifying publicly-owned cloud account are carried out automated back-up respectively described in any one of Claims 1 to 5, its Being characterised by, step S2 also includes: individual private possession cloud storage system periodically mesh to publicly-owned cloud storage account associated there Subdirectory under Lu and filename carry out supplementing traversal, and compare with subdirectory and the list of file names of local cache, look for Make new advances file, generates the list of download/synchronous task;Specifically include:
First, individual private possession cloud storage system loads the json data of bibliographic structure from data base according to the order being grouped, in program Internal memory in preserve this structure of arrays, and by named for this array: old;
Secondly, according to the mode traveled through first, the subdirectory under publicly-owned each catalogue of cloud storage account and filename are carried out supplementary time Go through, it is thus achieved that the structure of arrays of up-to-date directory traversal result, and by named for this array: new;
Again, from old array, take out an element, new array is searched the element identical with this element files name, if Do not find, then abandon this element in this old array;If have found the element of correspondence, then contrast two elements MD5 value or file size and last modification time;If identical, then the fetched value of element in old array is copied to Element corresponding in new array;Repeat this operation, until all of element all takes out in old array;
Finally, after supplementary traversal completes, the data of new array are exported as from the internal memory of program the data of json form, and to divide Prescription formula preserves to data base.
7. the data to specifying publicly-owned cloud account carry out distinguishing the system of automated back-up, it is characterised in that including:
Binding module, for specifying publicly-owned cloud storage account and multiple with wifi by the account of individual private possession cloud storage system with certain The storage device of function is bound;
Spider module, for individual private possession cloud storage system to the subdirectory under each catalogue in described publicly-owned cloud storage account and literary composition Part travels through first;
First data derive and memory module, after traversal completes, the subdirectory under respective directories and file name data are derived also Preserve to data base;
Task generates and distribution module, for individual private possession cloud storage system by the subdirectory under each catalogue in data base and filename The multiple task groups of data genaration also waits the storage device active obtaining with wifi function;
Automatically download module, after the described storage device with wifi function is networked, obtains to individual private possession cloud storage system Task, then according to the subdirectory under respective directories in current task group and filename automatically from specifying publicly-owned cloud storage account Start downloading task data.
Data to specifying publicly-owned cloud account the most according to claim 7 carry out the system of automated back-up respectively, and its feature exists In, described binding module also includes:
Login module, for accessing each web management interface with the storage device of wifi function, and utilizes individual private possession cloud to deposit Account and the password of storage system log in;After logging in successfully, each with the storage device of wifi function is and individual private possession The account of cloud storage system establishes binding relationship;
Bind request sending module, right for initiating on each described web management interface with the storage device of wifi function Certain specifies the bind request of publicly-owned cloud storage account;
Access and authorize acquisition module, authorize for obtaining to access by the open DLL of publicly-owned cloud storage system, it is thus achieved that corresponding Authorize key;
Transmission module in information, for setting the title of described publicly-owned cloud storage system, mandate key and the storage with wifi function Standby device numbering is uploaded to individual private possession cloud storage system and preserves;
Virtual container creates and relating module, creates multiple different virtual containers for individual private possession cloud storage system so that each Each catalogue one_to_one corresponding in virtual container cloud storage account publicly-owned with described appointment respectively associates, each virtual container simultaneously Carry out one to one with the storage device of wifi function with each, many-one or one-to-many associate.
Data to specifying publicly-owned cloud account the most according to claim 7 carry out the system of automated back-up respectively, and its feature exists In, described spider module also includes:
Structure of arrays generation module, for described different virtual container to mesh corresponding in publicly-owned cloud storage account associated there Subdirectory and file under Lu travel through first, generate the data structure of META DATA;
First data derive and memory module also includes:
Packet module, after traversal completes, by described filename according to N number of be one group, after being divided into multiple groups, lead Go out the data for json form, and preserve to data base;Wherein, during traversal, using subdirectory or file name as index Value.
Data to specifying publicly-owned cloud account the most according to claim 9 carry out the system of automated back-up respectively, and its feature exists In, described automatic download module also includes:
State detection module, after networking with the storage device of wifi function, the state of detection storage device;
Logging modle, if the state for storage device is Active, then initiates task to individual private possession cloud storage system and obtains request, Individual private possession cloud storage system inquires all virtual containers associated with this equipment, then the most complete by virtual container first The task groups that portion completes is handed down to this equipment;This equipment preserves task definition and the numbering of packet;
Information feedback module, often completes the download of a file for the storage device with wifi function or completes a task groups The download of all or part of file, then the residue to corresponding virtual container more new task performance and storage device can Use space;
File record is searched and arranges module, if when the residue free space of storage device is more than preset value, the most virtual Container, after the task that receives is more newly requested, searches the record of correspondence in a packet, if looking for according to packet numbering and file name To corresponding file record, then fetched=1 is set;Wherein, fetched comprise in being META DATA structure one Individual member, for indicating whether to be downloaded to the storage device with wifi function of user, the default value of fetched is 0;If not finding the file record of correspondence, then return false signal to the storage device with wifi function;
Task is abandoned and reacquires module, after receiving false signal with the storage device of wifi function, abandons having obtained The follow-up work of current group and reacquire first task groups being not fully complete;
The automatic request module of task, after the download often completing a task groups with the storage device of wifi function, asks automatically The next one is not fully complete task groups, until completing last to be not fully complete task groups.
11. data to specifying publicly-owned cloud account according to claim 10 carry out the system of automated back-up respectively, and its feature exists In, described automatic download module also includes:
Arranging module, when the residual memory space of described storage device is less than preset value, then this is deposited by corresponding virtual container The state of storage equipment is set to Inactive, and this storage device stops simultaneously operating;
Processing module, is allowed to revert to Active state or associate new storage set for described storage device is deleted data Standby to this virtual container or virtual container by other residual memory space associated with it higher than preset value but current state After being set to Active state in the storage device of Inactive, recover data syn-chronization work;Wherein, virtual appearance When device associates multiple storage device, when carrying out data syn-chronization, the state of only one of which storage device is Active, and other are Inactive。
12. according to the system that the data specifying publicly-owned cloud account carry out automated back-up respectively described in any one of claim 7~11, It is characterized in that, described spider module also includes:
Supplement traversal and contrast module, the regular mesh to publicly-owned cloud storage account associated there for individual private possession cloud storage system Subdirectory under Lu and filename carry out supplementing traversal, and compare with subdirectory and the list of file names of local cache, look for Make new advances file, generates the list of download/synchronous task;
Described supplementary traversal and contrast module specifically include:
Data load and memory module: for individual private possession cloud storage system order loading bibliographic structure according to packet from data base Json data, the internal memory of program preserves this structure of arrays, and by named for this array: old;
Supplement spider module: be used for according to the mode traveled through first the subdirectory under publicly-owned each catalogue of cloud storage account and filename Carry out supplementing traversal, it is thus achieved that the structure of arrays of up-to-date directory traversal result, and by named for this array: new;
Data Comparison module: for taking out an element from old array, search identical with this element files name in new array Element, without finding, then abandon this element in this old array;If have found the element of correspondence, then contrast two The MD5 value of individual element or file size and last modification time;If it is identical, then the fetched of element in old array Value is copied in new array the element of correspondence;Repeat this operation, until all of element all takes out in old array;
Second data derive and memory module, are used for supplementing after traversal completes, the data of new array are exported as from the internal memory of program The data of json form, and preserve to data base with packet mode.
CN201610338692.XA 2016-05-19 2016-05-19 To specifying the data of public cloud account to carry out the method and system of automated back-up respectively Expired - Fee Related CN105930233B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201610338692.XA CN105930233B (en) 2016-05-19 2016-05-19 To specifying the data of public cloud account to carry out the method and system of automated back-up respectively

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201610338692.XA CN105930233B (en) 2016-05-19 2016-05-19 To specifying the data of public cloud account to carry out the method and system of automated back-up respectively

Publications (2)

Publication Number Publication Date
CN105930233A true CN105930233A (en) 2016-09-07
CN105930233B CN105930233B (en) 2018-10-16

Family

ID=56840997

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201610338692.XA Expired - Fee Related CN105930233B (en) 2016-05-19 2016-05-19 To specifying the data of public cloud account to carry out the method and system of automated back-up respectively

Country Status (1)

Country Link
CN (1) CN105930233B (en)

Cited By (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN106648965A (en) * 2016-10-13 2017-05-10 安徽鼎集信息科技有限公司 Real-time file backup system
CN107277152A (en) * 2017-06-29 2017-10-20 郑州云海信息技术有限公司 A kind of public cloud data safety backup system
CN108206933A (en) * 2016-12-16 2018-06-26 杭州海康威视数字技术股份有限公司 A kind of video data acquisition methods and device based on video cloud storage system
CN111885175A (en) * 2020-07-27 2020-11-03 陈军 Method and system for downloading network disk directory file
CN112150312A (en) * 2020-10-06 2020-12-29 广州云莫凡信息科技有限公司 Quality monitoring data maintenance method and system for building construction engineering
CN112559254A (en) * 2020-12-24 2021-03-26 杭州电魂网络科技股份有限公司 Backup file retention method and device, electronic equipment and storage medium
CN112866415A (en) * 2021-02-24 2021-05-28 上海泰宇信息技术股份有限公司 Data backup private cloud storage and downloading method

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102377827A (en) * 2011-12-13 2012-03-14 方正国际软件有限公司 Multilevel cloud storage system and storage method thereof
US20120203742A1 (en) * 2011-02-08 2012-08-09 International Business Machines Corporation Remote data protection in a networked storage computing environment
CN103067406A (en) * 2013-01-14 2013-04-24 暨南大学 Access control system and access control method between public cloud and private cloud
CN105025084A (en) * 2015-06-10 2015-11-04 国网智能电网研究院 A cloud storage system based on synchronization agent and hybrid storage

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20120203742A1 (en) * 2011-02-08 2012-08-09 International Business Machines Corporation Remote data protection in a networked storage computing environment
CN102377827A (en) * 2011-12-13 2012-03-14 方正国际软件有限公司 Multilevel cloud storage system and storage method thereof
CN103067406A (en) * 2013-01-14 2013-04-24 暨南大学 Access control system and access control method between public cloud and private cloud
CN105025084A (en) * 2015-06-10 2015-11-04 国网智能电网研究院 A cloud storage system based on synchronization agent and hybrid storage

Cited By (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN106648965A (en) * 2016-10-13 2017-05-10 安徽鼎集信息科技有限公司 Real-time file backup system
CN108206933A (en) * 2016-12-16 2018-06-26 杭州海康威视数字技术股份有限公司 A kind of video data acquisition methods and device based on video cloud storage system
CN108206933B (en) * 2016-12-16 2020-05-15 杭州海康威视数字技术股份有限公司 Video data acquisition method and device based on video cloud storage system
CN107277152A (en) * 2017-06-29 2017-10-20 郑州云海信息技术有限公司 A kind of public cloud data safety backup system
CN111885175A (en) * 2020-07-27 2020-11-03 陈军 Method and system for downloading network disk directory file
CN111885175B (en) * 2020-07-27 2023-04-07 陈军 Method and system for downloading network disk directory file
CN112150312A (en) * 2020-10-06 2020-12-29 广州云莫凡信息科技有限公司 Quality monitoring data maintenance method and system for building construction engineering
CN112559254A (en) * 2020-12-24 2021-03-26 杭州电魂网络科技股份有限公司 Backup file retention method and device, electronic equipment and storage medium
CN112866415A (en) * 2021-02-24 2021-05-28 上海泰宇信息技术股份有限公司 Data backup private cloud storage and downloading method
CN112866415B (en) * 2021-02-24 2023-07-28 上海泰宇信息技术股份有限公司 Data backup private cloud storage and downloading method

Also Published As

Publication number Publication date
CN105930233B (en) 2018-10-16

Similar Documents

Publication Publication Date Title
CN105930233A (en) Method and system for automatically backing up data of specified public cloud account
CN105824723B (en) The method and system that a kind of data to publicly-owned cloud storage account are backed up
CN105593804B (en) Method and apparatus for file system virtualization, data storage system for file system virtualization, and file server for data storage system
CN105978981B (en) The linear expansion method and system of data backup based on publicly-owned cloud storage account
CN101568919B (en) Single view of data in a networked computer system with distributed storage
US20220327117A1 (en) Servicing queries of a hybrid event index
CN103002027B (en) Data-storage system and the method for tree directory structure is realized based on key-value pair system
US9424274B2 (en) Management of intermediate data spills during the shuffle phase of a map-reduce job
CN102012933B (en) Distributed file system and its method for storing data and providing services
CN110447021A (en) Method, apparatus and system for maintaining metadata and data consistency between data centers
US20170193039A1 (en) Servicing queries of an event log
CN103631924B (en) A kind of application process and system of distributive database platform
CN105956491A (en) Method and system for performing multi-account backup on data of public cloud storage system
NO326041B1 (en) Procedure for managing data storage in a system for searching and retrieving information
CN102662992A (en) Method and device for storing and accessing massive small files
CN106649467A (en) Blue-ray disc jukebox archiving management method and system
CN114610680B (en) Distributed file system metadata management method, device, equipment and storage medium
CN102664914A (en) IS/DFS-Image distributed file storage query system
WO2018118287A1 (en) Method and system for maintaining and searching index records
CN105608126A (en) Method and apparatus for establishing secondary indexes for massive databases
US20180316756A1 (en) Cross-platform replication of logical units
CN106027615A (en) Object storage method and system
US10452304B2 (en) Efficient repository migration and storage
CN109299059A (en) File storage, search method, device, storage medium and server
CN119127825A (en) A metadata extension method, device, equipment and storage medium under a distributed file system

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
CB02 Change of applicant information

Address after: 100190 room 10-08, building Haidian District, Haidian street, Beijing, 38

Applicant after: Beijing Spring Technology Co., Ltd.

Address before: 100190 room 10-08, building Haidian District, Haidian street, Beijing, 38

Applicant before: Beijing Chunhong Enterprise Management Consulting Co., Ltd.

CB02 Change of applicant information
GR01 Patent grant
GR01 Patent grant
CF01 Termination of patent right due to non-payment of annual fee

Granted publication date: 20181016

Termination date: 20210519

CF01 Termination of patent right due to non-payment of annual fee
点击 这是indexloc提供的php浏览器服务,不要输入任何密码和下载