CN103634410A - Data synchronization method based on content distribution network (CDN), client end and server - Google Patents

Abstract

The invention discloses a data synchronization method based on content distribution network CDN, a client and a server. The method includes: the client downloads a data file from a node server assigned to it; the client downloads a data file according to the data file The latest feature information, to determine whether the data file is up-to-date; if not, the client submits a query request for the latest data file to the seed resource query server; The seed resource information corresponding to the latest data file returned by the request; the client downloads the latest data file from the node server and/or client side indicated by the seed resource information. The invention can improve the efficiency of data synchronization, and at the same time ensure the accuracy and safety of the latest data.

Description

Data synchronization method based on content distribution network CDN, client and server

technical field

The present invention relates to the technical field of data processing, in particular to a data synchronization method based on a content distribution network CDN, a data synchronization client based on a content distribution network CDN, and a data synchronization seed resource query based on a content distribution network CDN server.

Background technique

CDN (Content Distribution Network, Content Distribution Network) is a new type of network content service system, which is built on the basis of the Internet, and provides content distribution and services based on the efficiency requirements, quality requirements and content order of content access and application. CDN can avoid bottlenecks and links on the Internet that may affect the speed and stability of data transmission as much as possible, so as to make content transmission faster and more stable. Specifically, CDN can direct users to the nearest node server based on comprehensive information such as network traffic, connection of each node, load status, distance to the user, and response time in real time, so that the user can obtain the required data nearby. Solve the situation of network congestion and increase the speed of users downloading data.

However, the data synchronization problem of files has always been a difficult problem to solve in CDN. Some of the files transmitted in the CDN are tens of M, and some are hundreds of M. Therefore, due to delays or network failures, etc., the files of each network element in the CDN are not all up-to-date.

Referring to the architecture diagram of a content distribution network CDN in the prior art shown in FIG. 1 , in the CDN, users usually download files from adjacent node servers, but sometimes although the download configuration index of files on the adjacent node servers, etc. It has been updated, but the node server has not downloaded the latest data from other servers, and the data stored in it may be old data, so the data actually downloaded by the user may not be the latest file. At this time, CDN The data is not synchronized, causing inconvenience to users. In a specific implementation, the files that users need to download may be virus databases, installation packages, etc., which are used to update virus databases, or data files of software. infected by the virus.

Contents of the invention

In view of the above problems, the present invention is proposed to provide a CDN-based data synchronization method, a CDN-based data synchronization client, and a CDN-based data synchronization seed resource query server.

According to one aspect of the present invention, a data synchronization method based on a content distribution network CDN is provided, and the content distribution network CDN includes a distribution server, a node server communicating with the distribution server, and a client communicating with the node server terminal, and a seed resource query server communicating with the client; the latest feature information of the data file is stored in the client;

The methods include:

The client downloads the data file from its assigned node server;

The client determines whether the data file is up-to-date according to the latest characteristic information of the data file;

If not, the client submits a query request for the latest data file to the seed resource query server;

The client receives the seed resource information corresponding to the latest data file returned by the seed resource query server for the request;

The client downloads the latest data file from the node server and/or client side indicated by the seed resource information.

Optionally, the step of downloading the data file from the assigned node server by the client includes:

The client receives the HTTP download information sent by the distribution server; the HTTP download information includes the instruction information of the node server;

The client connects to the corresponding node server to download the data file according to the HTTP download information.

Optionally, the step of connecting the client to the corresponding node server to download the data file according to the HTTP download information includes:

The client is connected to the corresponding node server according to the HTTP download information, and downloads the data file in segments from a plurality of preset start and end positions in the node server;

The client combines the data files obtained by the segment download.

Optionally, the step of determining whether the data file is up-to-date according to the latest characteristic information of the data file by the client includes:

The client calculates current feature information according to the data file;

The client judges whether the latest characteristic information is consistent with the current characteristic information;

If so, then the client judges that the data file is the latest;

If not, the client determines that the data file is not the latest.

Optionally, the latest characteristic information is the data content identifier of the latest data file, and the current characteristic information is the data content identifier of the current data file.

Optionally, the data content of the latest data file is identified as the MD5 value of the latest data file; the data content of the current data file is identified as the MD5 value of the current data file.

Optionally, the seed resource information includes one or more pieces of P2SP download index information, after the client downloads the latest data file from the node server and/or client side indicated by the seed resource information , the method also includes:

The client reports its own P2SP download index information to the seed resource query server.

Optionally, also include:

If the client judges that the data file is the latest according to the latest feature information of the data file, it reports its own P2SP download index information to the seed resource query server.

Optionally, the HTTP download information includes a Uniform Resource Locator URL; the P2SP download index information includes the storage location of the file, the file size, the address of the server and/or client where the file is located, and/or the address of the file publisher.

According to another aspect of the present invention, a data synchronization method based on a content distribution network CDN is also disclosed, the content distribution network CDN includes a distribution server, a node server communicating with the distribution server, and a node server communicating with the node server A client, and a seed resource query server communicating with the client; the latest feature information of the data file is stored in the client;

The methods include:

The seed resource query server receives a query request for the latest data file sent by the client; the request is submitted when the client judges that the data file is not the latest according to the latest feature information of the data file;

The seed resource query server queries the seed resource information of the latest data file according to the request;

The torrent resource query server returns the torrent resource information to the client.

Optionally, the seed resource information includes one or more pieces of P2SP download index information, and the method further includes:

The seed resource query server receives its own P2SP download index information reported by the client.

According to another aspect of the present invention, a client in a content distribution network CDN is also disclosed, wherein the client communicates with a node server, the node server communicates with a distribution server, and the client also communicates with a seed resource Query server communication, and the latest feature information of the data file is stored in the client;

The clients include:

a first download module adapted to download data files from a node server assigned thereto;

The judging module is adapted to judge whether the data file is up-to-date according to the latest feature information of the data file; if not, execute the submission module;

A submission module, adapted to submit a query request for the latest data file to the seed resource query server;

The receiving module is adapted to receive the seed resource information corresponding to the latest data file returned by the seed resource query server for the request;

The second downloading module is adapted to download the latest data file from the node server and/or client side indicated by the seed resource information.

Optionally, the first download module includes:

The HTTP download information receiving submodule is adapted to receive the HTTP download information sent by the distribution server; the HTTP download information includes the instruction information of the node server;

The connection sub-module is adapted to connect to the corresponding node server to download the data file according to the HTTP download information.

Optionally, the connection submodule includes:

The segment download unit is adapted to connect to the corresponding node server according to the HTTP download information, and download the data file in segments from a plurality of preset start and end positions in the node server;

The combining unit is adapted to combine the data files obtained by the segment downloading.

Optionally, the judging module includes:

A calculation submodule, adapted to calculate current feature information according to the data file;

The judging submodule is adapted to judge whether the latest feature information is consistent with the current feature information; if so, call the first judging submodule, and if not, call the second judging submodule;

The first judging submodule is adapted to judge that the data file is the latest;

The second determining submodule is adapted to determine that the data file is not up-to-date.

Optionally, the latest characteristic information is the data content identifier of the latest data file, and the current characteristic information is the data content identifier of the current data file.

Optionally, the latest feature information is the MD5 value of the latest data file; the current feature information is the MD5 value of the current data file.

Optionally, the seed resource information includes one or more pieces of P2SP download index information, and the client further includes:

The first reporting module is adapted to report its own P2SP download index information to the seed resource query server.

Optionally, the client also includes:

The second reporting module is adapted to report its own P2SP download index information to the seed resource query server when judging that the data file is the latest according to the latest characteristic information of the data file.

Optionally, the HTTP download information includes a Uniform Resource Locator URL; the P2SP download index information includes the storage location of the file, the file size, the address of the server and/or client where the file is located, and/or the address of the file publisher.

According to another aspect of the present invention, a seed resource query server based on data synchronization of content distribution network CDN is also disclosed, wherein the seed resource query server communicates with a client, and the client communicates with a node server. The node server communicates with the distribution server, wherein the latest feature information of the data file is stored in the client;

The seed resource query server includes:

The receiving module is adapted to receive the query request of the latest data file sent by the client; the request is submitted when the client judges that the data file is not the latest according to the latest feature information of the data file;

A query module, adapted to query the seed resource information of the latest data file according to the request;

A return module, adapted to return the seed resource information to the client.

Optionally, the seed resource information includes one or more pieces of P2SP download index information, and the seed resource query server also includes:

The download information receiving module is adapted to receive the P2SP download index information reported by the client.

In the embodiment of the present invention, the CDN allocates node servers for each client, and sends the latest feature information to each client when a new data file is released. When the client downloads the data file from the node server, it can judge whether the data file is the latest according to the latest feature information. If it is determined that the data file is not the latest, it can also send a request to the seed resource query server to obtain the seeds of the adjacent node server Resource information, and according to the node server and/or client indicated by the seed resource information, quickly download the latest data file, which can improve the efficiency of data synchronization, and at the same time ensure the accuracy and security of the latest data.

In addition, the client that has downloaded the latest data can also report its own P2SP download index information to the seed resource query server, and the seed resource query server can keep the P2SP download index information as the seed resource information after receiving it. In this way, the original isolated server, its mirror resources and P2P resources can be integrated together effectively. When there are many clients downloading data files, the downloading efficiency is higher.

The above description is only an overview of the technical solution of the present invention. In order to better understand the technical means of the present invention, it can be implemented according to the contents of the description, and in order to make the above and other purposes, features and advantages of the present invention more obvious and understandable , the specific embodiments of the present invention are enumerated below.

Description of drawings

Various other advantages and benefits will become apparent to those of ordinary skill in the art upon reading the following detailed description of the preferred embodiment. The drawings are only for the purpose of illustrating a preferred embodiment and are not to be considered as limiting the invention. Also throughout the drawings, the same reference numerals are used to designate the same parts. In the attached picture:

Fig. 1 shows the architectural diagram of a kind of content distribution network CDN of prior art;

FIG. 2 shows a flow chart of steps in Embodiment 1 of a data synchronization method based on a content distribution network CDN according to an embodiment of the present invention;

FIG. 3 shows a flow chart of steps in Embodiment 2 of a data synchronization method based on a content distribution network CDN according to an embodiment of the present invention;

FIG. 4 shows a schematic diagram of a data synchronization implementation structure based on a content distribution network CDN according to an embodiment of the present invention;

FIG. 5 shows a structural block diagram of an embodiment of a data synchronization client based on a content distribution network CDN according to an embodiment of the present invention;

Fig. 6 shows a structural block diagram of an embodiment of a CDN-based data synchronization seed resource query server according to an embodiment of the present invention.

Detailed ways

Exemplary embodiments of the present disclosure will be described in more detail below with reference to the accompanying drawings. Although exemplary embodiments of the present disclosure are shown in the drawings, it should be understood that the present disclosure may be embodied in various forms and should not be limited by the embodiments set forth herein. Rather, these embodiments are provided for more thorough understanding of the present disclosure and to fully convey the scope of the present disclosure to those skilled in the art.

One of the cores of the embodiments of the present invention is that the problem of data synchronization is handled through P2SP with the CDN solution. When the data file downloaded by the client is found to be not the latest after verification, the P2SP download method can be used to download to other node servers or clients. Download the latest data file from the terminal.

Referring to FIG. 2 , it shows a flow chart of the steps of Embodiment 1 of a data synchronization method based on a content distribution network CDN according to an embodiment of the present invention. The content distribution network CDN may include a distribution server, and the distribution server A communicating node server, a client communicating with the node server, and a seed resource query server communicating with the client; the latest feature information of the data file may be stored in the client;

The method may specifically include the following steps:

Step 101, the client downloads the data file from the node server assigned to it;

In a preferred embodiment of the present invention, the step 101 may include the following sub-steps:

Sub-step S11, the client receives the HTTP download information sent by the distribution server; the HTTP download information includes the instruction information of the node server;

Sub-step S12, the client connects to the corresponding node server to download the data file according to the HTTP download information.

In a specific implementation, when a distribution server in the CDN or other servers with strong timeliness release a new data file, the latest feature information and download information corresponding to the data file can be released to each network element in the CDN, That is, in the node server or client. Since the latest feature information is relatively small in content, there will be no out-of-sync problems in the CDN, so it can be used as a basis for judging whether the data file is up-to-date.

In practical applications, CDN can make judgments based on proximity and server load, and can provide services to users in an extremely efficient manner. Specifically, the CDN usually assigns a node server nearby to the user's client. When the client receives the HTTP download information of the adjacent network element sent by the distribution server, it can quickly download the data by connecting to the corresponding node server according to the HTTP download information. document.

As an example of a specific application of the present invention, the HTTP download information may be an address (URL, Uniform Resource Locator) of a specified node server. The distribution server can distribute the HTTP download information of the specified node server for the client, or the distribution server can be a node server with a fixed mapping. Of course, it can avoid as much as possible the bottleneck and The link, the node server that is tailored for the client, can be determined according to actual needs, which is not limited in the present invention.

In a preferred embodiment of the present invention, the sub-step S12, that is, the step in which the client connects to the corresponding node server to download the data file according to the HTTP download information may include the following sub-steps:

Sub-step S12-1, the client connects to the corresponding node server according to the HTTP download information, and downloads the data file in sections from a plurality of preset start and end positions in the node server;

Sub-step S12-2, the client assembles the data files obtained by the segment download.

In a specific implementation, when the client connects to the corresponding node server according to the HTTP download information, it can start to download the corresponding data file from the node server. Due to the large size of some data files, in order to speed up the download progress, a concurrent file multi-segment download method can be used, that is, the data files can be downloaded in segments from different start and end positions, for example, from the first byte of file a Start downloading, and you can also download from the 100th byte of file a. After the client downloads the file in sections, it will splice it locally and combine it into a complete data file again. Due to the multi-segment concurrent downloading method, the speed of downloading files is greatly improved.

Step 102, the client judges whether the data file is up-to-date according to the latest feature information of the data file; if not, execute step 103;

In a preferred embodiment of the present invention, the step 102 may include the following sub-steps:

Sub-step S31, the client calculates current feature information according to the data file;

Sub-step S32, the client judges whether the latest feature information is consistent with the current feature information; if yes, execute sub-step S33, if not, execute sub-step S34;

Sub-step S33, the client judges that the data file is the latest;

In sub-step S34, the client determines that the data file is not the latest.

In a preferred example of the present invention, the latest characteristic information may be the data content identifier of the latest data file, and the current characteristic information may be the data content identifier of the current data file.

In a specific implementation, the latest feature information may be a unique data content identifier generated according to the content of the data file, for example, it may be calculated by using CRC (Cyclic Redundancy Check, cyclic redundancy check code). When the latest data file is released, the content identifier of the latest data file can be released to each network element in the CDN at the same time. Since the data content identifier is generated based on the content of the data file, if the file is rewritten, the current The data content ID of the data file is inconsistent with the data content ID of the latest data file, indicating that there may be a problem with the current data file.

Preferably, the data content identifier of the latest data file may be the MD5 value of the latest data file; the data content identifier of the current data file may be the MD5 value of the current data file.

In the embodiment of the present invention, the MD5 value may be a unique identifier of a data file calculated by using MD5 (Message-Digest Algorithm 5, Message-Digest Algorithm 5). Specifically, an MD5 algorithm may be used to calculate the MD5 value according to the binary information of the file.

The MD5 algorithm is one of the hash algorithms widely used by computers. It operates data into another fixed-length value and compresses information into a confidential format. MD5 has the characteristics of low collision rate. Using MD5 algorithm to calculate the unique identifier of a file can effectively prevent file duplication and collision. For example, if the file is invaded by a virus or Trojan horse, or the file is not up-to-date, then the calculated MD5 value will be inconsistent with the MD5 value saved locally on the client, and it is easy to find that there is a problem with the file.

Of course, in practical applications, it is not limited to the MD5 algorithm, and those skilled in the art can also choose other appropriate algorithms to generate the unique identifier of the file based on the principle of low collision rate, and the present invention does not need to limit this.

Step 103, the client submits a query request for the latest data file to the seed resource query server;

Step 104, the client receives the seed resource information corresponding to the latest data file returned by the seed resource query server for the request;

Step 105, the client downloads the latest data file from the node server and/or client side indicated by the seed resource information.

In the embodiment of the present invention, if the downloaded data file verification fails, it can be explained that the downloaded data is not up-to-date. At this time, the file can also be downloaded in other ways, such as P2SP (Peer to Server&Peer, user to server and user) .

Using P2SP technology, data files can be transferred among various network elements on the CDN, effectively integrating the original isolated server and its mirror resources and P2P (peer-to-peer, point-to-point) resources. Specifically, the P2SP download index information is information with a query seed key value, and corresponding resources can be obtained from a specific server.

In a specific implementation, the client can query the seed resource information from the seed resource query server, obtain the server with the latest resource (ie data file), or, after the client has the seed resource information of the client with the latest resource, the client can go to The server or client indicated in the seed resource information downloads the latest data file.

In a preferred example of the present invention, the request sent by the client to the seed resource query server may also include the MD5 value calculated according to the data file, and the seed resource query server may compare it with the MD5 value in the locally stored seed resource information after receiving the request. Values are compared, if the seed resource information with the same MD5 value is found, it means that the data file in the network element corresponding to the seed resource information is still old, and the seed resource query server can choose to mark it or delete it directly to avoid Send the same seed resource information to the client, causing the client to download the old data again.

In addition, when resources such as new data files are released on the CDN, the information of the server that is scheduled to download the resource can be uploaded to the seed resource query server, so that it can be guaranteed that some servers must store new data. When the data in these servers or clients is up-to-date, the corresponding seed resource information of the predetermined server can be directly sent to the client requesting the seed resource information.

In a preferred embodiment of the present invention, the seed resource information may include one or more pieces of P2SP download index information, and the client side downloads all After the step of the latest data file, the method may also include the following steps:

The client reports its own P2SP download index information to the seed resource query server.

In another preferred embodiment of the present invention, described method can also comprise the following steps:

If the client judges that the data file is the latest according to the latest feature information of the data file, it reports its own P2SP download index information to the seed resource query server.

In the embodiment of the present invention, when the client downloads the latest data file, it can also report its own IP address and related information of resources, that is, the P2SP download index information to the seed resource query server, and the seed resource query server can send its Included, so that other clients can communicate with this client. Specifically, the P2SP download index information may include the storage location of the file, the file size, the address of the server where the file is located and/or the client, and/or the address of the file publisher, etc. Of course, it may also include the MD5 value.

Referring to FIG. 3 , it shows a flow chart of steps in Embodiment 2 of a data synchronization method based on a content distribution network CDN according to an embodiment of the present invention. The content distribution network CDN may include a distribution server, and the distribution server A communicating node server, a client communicating with the node server, and a seed resource query server communicating with the client; the latest feature information of the data file may be stored in the client;

Described method specifically can comprise the steps:

Step 201, the seed resource query server receives a query request for the latest data file sent by the client; the request is submitted when the client judges that the data file is not the latest according to the latest feature information of the data file ;

Step 202, the seed resource query server queries the seed resource information of the latest data file according to the request;

Step 203, the torrent resource query server returns the torrent resource information to the client.

In a preferred embodiment of the present invention, the seed resource information may include one or more pieces of P2SP download index information, and the method may also include the following steps:

The seed resource query server receives its own P2SP download index information reported by the client.

In practical applications, a torrent resource query server may be set in the CDN, and multiple torrent resource information is stored in the torrent resource query server. When the client detects that the data file is not up-to-date, the torrent resource query server will receive the query request sent by the client, and the torrent resource query server can send the server or the torrent resource information of the client to the server, and the client can quickly Download the latest data from the node server or client indicated in the seed resource information.

In order for those skilled in the art to further understand the embodiments of the present invention, a specific application example is used below for description.

In actual implementation, due to security reasons, the networks of some enterprises and government agencies are isolated from external networks, that is, they cannot be connected to the Internet. In a complex enterprise network, any omission of any employee or vulnerability management may pose a threat to the security of the enterprise. Even though the networks of enterprises and government agencies are isolated from the external network, they still need to run new versions of software or transfer data internally, and these problems become difficult.

Referring to the schematic diagram of a data synchronization implementation structure based on the content distribution network CDN of the present invention shown in Figure 4, the CDN may include a distribution server, a node server communicating with the distribution server, and a client communicating with the node server , and, the seed resource in communication with the client queries the server. Wherein, the CDN can be established by itself, of course, a third-party CDN can also be used.

In the isolated network, the normal download method of CDN can be used first to download resources, and general clients can directly download data files from adjacent node servers. If the data file downloaded by the client fails to verify and finds that it is not the latest data file, then the P2SP download method can also be used. Specifically, the client can query and obtain the torrent resource information from the torrent resource query server. The node servers indicated in the seed resource information quickly download the latest data files.

It should be noted that, for the method embodiment, for the sake of simple description, it is expressed as a series of action combinations, but those skilled in the art should know that the embodiment of the present invention is not limited by the described action sequence, because According to the embodiment of the present invention, certain steps may be performed in other orders or simultaneously. Secondly, those skilled in the art should also know that the embodiments described in the specification belong to preferred embodiments, and the actions involved are not necessarily required by the embodiments of the present invention.

Referring to FIG. 5 , it shows a structural block diagram of an embodiment of a data synchronization client based on a content distribution network CDN according to an embodiment of the present invention, wherein, the client communicates with a node server, and the node server communicates with a distribution server Communication, the client also communicates with the seed resource query server, and the latest feature information of the data file is stored in the client;

The client may specifically include the following modules:

The first download module 301 is suitable for downloading data files from the node server assigned to it;

In a preferred embodiment of the present invention, the first download module 301 may include:

The HTTP download information receiving submodule is suitable for the client to receive the HTTP download information sent by the distribution server; the HTTP download information includes the instruction information of the node server;

The connection sub-module is adapted to connect to the corresponding node server to download the data file according to the HTTP download information.

In a preferred embodiment of the present invention, the connection submodule may include:

The segment download unit is adapted to connect to the corresponding node server according to the HTTP download information, and download the data file in segments from a plurality of preset start and end positions in the node server;

The combining unit is adapted to combine the data files obtained by the segment downloading.

The judging module 302 is adapted to judge whether the data file is up-to-date according to the latest characteristic information of the data file; if not, execute the submission module;

In a preferred embodiment of the present invention, the judging module 302 may include:

A calculation submodule, adapted to calculate current feature information according to the data file;

The judging submodule is adapted to judge whether the latest feature information is consistent with the current feature information; if so, call the first judging submodule, and if not, call the second judging submodule;

The first judging submodule is adapted to judge that the data file is the latest;

The second determining submodule is adapted to determine that the data file is not up-to-date.

In a preferred embodiment of the present invention, the latest characteristic information may be the data content identifier of the latest data file, and the current characteristic information may be the data content identifier of the current data file.

In a preferred embodiment of the present invention, the data content identifier of the latest data file may be the MD5 value of the latest data file; the data content identifier of the current data file may be the MD5 value of the current data file.

A submission module 303, adapted to submit a query request for the latest data file to the seed resource query server;

The receiving module is adapted to receive the seed resource information corresponding to the latest data file returned by the seed resource query server for the request;

The second downloading module is adapted to download the latest data file from the node server and/or client side indicated by the seed resource information.

In a preferred embodiment of the present invention, the seed resource information includes one or more pieces of P2SP download index information, and the device may also include:

The first reporting module is adapted to report its own P2SP download index information to the seed resource query server.

In a preferred embodiment of the present invention, the device may also include:

The second reporting module is adapted to report its own P2SP download index information to the seed resource query server when judging that the data file is the latest according to the latest characteristic information of the data file.

In a preferred embodiment of the present invention, the HTTP download information may include a Uniform Resource Locator URL; the P2SP download index information may include the storage location of the file, the size of the file, the address of the server where the file is located and/or the client, and/or the address of the publisher of the document.

Referring to FIG. 6 , it shows a structural block diagram of an embodiment of a data synchronization seed resource query server based on a content distribution network CDN according to an embodiment of the present invention.

Wherein, the seed resource query server communicates with the client, the client communicates with the node server, and the node server communicates with the distribution server, wherein the latest characteristic information of the data file is stored in the client;

The seed resource query server includes:

The receiving module 301 is adapted to receive the query request of the latest data file sent by the client; the request is submitted when the client judges that the data file is not the latest according to the latest feature information of the data file;

The query module 302 is adapted to query the seed resource information of the latest data file according to the request;

The returning module 303 is adapted to return the seed resource information to the client.

In a preferred embodiment of the present invention, the seed resource information may include one or more pieces of P2SP download index information, and the seed resource query server may also include:

The download information receiving module is adapted to receive the P2SP download index information reported by the client.

As for the device embodiment, since it is basically similar to the method embodiment, the description is relatively simple, and for related parts, please refer to the part of the description of the method embodiment.

The algorithms and displays presented herein are not inherently related to any particular computer, virtual system, or other device. Various generic systems can also be used with the teachings based on this. The structure required to construct such a system is apparent from the above description. Furthermore, the present invention is not specific to any particular programming language. It should be understood that various programming languages can be used to implement the content of the present invention described herein, and the above description of specific languages is for disclosing the best mode of the present invention.

In the description provided herein, numerous specific details are set forth. However, it is understood that embodiments of the invention may be practiced without these specific details. In some instances, well-known methods, structures and techniques have not been shown in detail in order not to obscure the understanding of this description.

Similarly, it should be appreciated that in the foregoing description of exemplary embodiments of the invention, in order to streamline this disclosure and to facilitate an understanding of one or more of the various inventive aspects, various features of the invention are sometimes grouped together in a single embodiment, figure, or its description. This method of disclosure, however, is not to be interpreted as reflecting an intention that the claimed invention requires more features than are expressly recited in each claim. Rather, as the following claims reflect, inventive aspects lie in less than all features of a single foregoing disclosed embodiment. Thus, the claims following the Detailed Description are hereby expressly incorporated into this Detailed Description, with each claim standing on its own as a separate embodiment of this invention.

Those skilled in the art can understand that the modules in the device in the embodiment can be adaptively changed and arranged in one or more devices different from the embodiment. Modules or units or components in the embodiments may be combined into one module or unit or component, and furthermore may be divided into a plurality of sub-modules or sub-units or sub-assemblies. All features disclosed in this specification (including accompanying claims, abstract and drawings), as well as any method or method so disclosed, may be used in any combination, except that at least some of such features and/or processes or units are mutually exclusive. All processes or units of equipment are combined. Each feature disclosed in this specification (including accompanying claims, abstract and drawings) may be replaced by alternative features serving the same, equivalent or similar purpose, unless expressly stated otherwise.

Furthermore, those skilled in the art will understand that although some embodiments described herein include some features included in other embodiments but not others, combinations of features from different embodiments are meant to be within the scope of the invention. and form different embodiments. For example, in the following claims, any of the claimed embodiments may be used in any combination.

The various component embodiments of the present invention may be implemented in hardware, or in software modules running on one or more processors, or in a combination thereof. Those skilled in the art should understand that a microprocessor or a digital signal processor (DSP) can be used in practice to implement some or all of the components in the data synchronization device based on the content distribution network CDN according to the embodiment of the present invention. Full functionality. The present invention can also be implemented as an apparatus or an apparatus program (for example, a computer program and a computer program product) for performing a part or all of the methods described herein. Such a program for realizing the present invention may be stored on a computer-readable medium, or may be in the form of one or more signals. Such a signal may be downloaded from an Internet site, or provided on a carrier signal, or provided in any other form.

It should be noted that the above-mentioned embodiments illustrate rather than limit the invention, and that those skilled in the art will be able to design alternative embodiments without departing from the scope of the appended claims. In the claims, any reference signs placed between parentheses shall not be construed as limiting the claim. The word "comprising" does not exclude the presence of elements or steps not listed in a claim. The word "a" or "an" preceding an element does not exclude the presence of a plurality of such elements. The invention can be implemented by means of hardware comprising several distinct elements, and by means of a suitably programmed computer. In a unit claim enumerating several means, several of these means can be embodied by one and the same item of hardware. The use of the words first, second, and third, etc. does not indicate any order. These words can be interpreted as names.

The invention discloses A1, a data synchronization method based on a content distribution network CDN, the content distribution network CDN includes a distribution server, a node server communicating with the distribution server, a client communicating with the node server, and , a seed resource query server communicating with the client; the latest feature information of the data file is stored in the client;

The methods include:

The client downloads the data file from its assigned node server;

The client determines whether the data file is up-to-date according to the latest characteristic information of the data file;

If not, the client submits a query request for the latest data file to the seed resource query server;

The client receives the seed resource information corresponding to the latest data file returned by the seed resource query server for the request;

The client downloads the latest data file from the node server and/or client side indicated by the seed resource information.

A2. The method according to claim A1, wherein the step of downloading the data file from the assigned node server for the client comprises:

The client receives the HTTP download information sent by the distribution server; the HTTP download information includes the instruction information of the node server;

The client connects to the corresponding node server to download the data file according to the HTTP download information.

A3, the method as claimed in claim A2, is characterized in that, the step that described client connects corresponding node server to download data file according to described HTTP download information comprises:

The client is connected to the corresponding node server according to the HTTP download information, and downloads the data file in segments from a plurality of preset start and end positions in the node server;

The client combines the data files obtained by the segment download.

A4. The method according to claim A1 or A2 or A3, wherein the step of determining whether the data file is up-to-date according to the latest characteristic information of the data file by the client comprises:

The client calculates current feature information according to the data file;

The client judges whether the latest characteristic information is consistent with the current characteristic information;

If so, then the client judges that the data file is the latest;

If not, the client determines that the data file is not the latest.

A5. The method according to claim A4, wherein the latest feature information is the data content identifier of the latest data file, and the current feature information is the data content identifier of the current data file.

A6. The method according to claim A4, wherein the data content of the latest data file is identified as the MD5 value of the latest data file; the data content of the current data file is identified as the MD5 value of the current data file.

A7. The method according to claim A6, wherein the seed resource information includes one or more pieces of P2SP download index information, and the node server and/or client end indicated by the seed resource information at the client end After the step of side downloading the latest data file, the method further includes:

The client reports its own P2SP download index information to the seed resource query server.

A8. The method according to claim A7, further comprising:

If the client judges that the data file is the latest according to the latest feature information of the data file, it reports its own P2SP download index information to the seed resource query server.

A9. The method according to claim A7, wherein the HTTP download information includes a Uniform Resource Locator URL; the P2SP download index information includes the storage location of the file, the size of the file, and the location of the server and/or the client where the file is located. address, and/or the address of the publisher of the document.

The present invention also discloses B10, a data synchronization method based on a content distribution network CDN, wherein the content distribution network CDN includes a distribution server, a node server communicating with the distribution server, a client communicating with the node server, And, the seed resource query server communicated with the client; the latest characteristic information of the data file is stored in the client;

The methods include:

The seed resource query server receives a query request for the latest data file sent by the client; the request is submitted when the client judges that the data file is not the latest according to the latest feature information of the data file;

The seed resource query server queries the seed resource information of the latest data file according to the request;

The torrent resource query server returns the torrent resource information to the client.

B11, the method as claimed in claim B10, is characterized in that, described seed resource information comprises one or more P2SP download index information, and described method also comprises:

The seed resource query server receives its own P2SP download index information reported by the client.

The present invention also discloses C12, a client in a content distribution network CDN, wherein the client communicates with a node server, the node server communicates with a distribution server, and the client also communicates with a seed resource query server, And, the latest feature information of the data file is stored in the client;

The clients include:

a first download module adapted to download data files from a node server assigned thereto;

The judging module is adapted to judge whether the data file is up-to-date according to the latest feature information of the data file; if not, execute the submission module;

A submission module, adapted to submit a query request for the latest data file to the seed resource query server;

The receiving module is adapted to receive the seed resource information corresponding to the latest data file returned by the seed resource query server for the request;

The second downloading module is adapted to download the latest data file from the node server and/or client side indicated by the seed resource information.

C13. The client according to claim C12, wherein the first download module comprises:

The HTTP download information receiving submodule is suitable for the client to receive the HTTP download information sent by the distribution server; the HTTP download information includes the instruction information of the node server;

The connection sub-module is adapted to connect to the corresponding node server to download the data file according to the HTTP download information.

C14, the client as claimed in claim C13, is characterized in that, described connection submodule comprises:

The segment download unit is adapted to connect to the corresponding node server according to the HTTP download information, and download the data file in segments from a plurality of preset start and end positions in the node server;

The combining unit is adapted to combine the data files obtained by the segment downloading.

C15. The client as claimed in claim C12 or C13 or C14, wherein the judging module comprises:

A calculation submodule, adapted to calculate current feature information according to the data file;

The judging submodule is adapted to judge whether the latest feature information is consistent with the current feature information; if so, call the first judging submodule, and if not, call the second judging submodule;

The first judging submodule is adapted to judge that the data file is the latest;

The second determining submodule is adapted to determine that the data file is not up-to-date.

C16. The client according to claim C15, wherein the latest characteristic information is the data content identifier of the latest data file, and the current characteristic information is the data content identifier of the current data file.

C17. The client according to claim C16, wherein the latest feature information is the MD5 value of the latest data file; the current feature information is the MD5 value of the current data file.

C18. The client according to claim C17, wherein the seed resource information includes one or more pieces of P2SP download index information, and the device also includes:

The first reporting module is adapted to report its own P2SP download index information to the seed resource query server.

C19. The client according to claim C18, further comprising:

The second reporting module is adapted to report its own P2SP download index information to the seed resource query server when judging that the data file is the latest according to the latest characteristic information of the data file.

C20. The client according to claim C18, wherein the HTTP download information includes a Uniform Resource Locator URL; the P2SP download index information includes the storage location of the file, the file size, the server where the file is located and/or the client the address of the client, and/or the address of the file publisher.

The present invention also discloses D21, a seed resource query server based on data synchronization of content distribution network CDN, wherein, the seed resource query server communicates with a client, the client communicates with a node server, and the node server communicates with Distributing server communication, wherein, the latest feature information of the data file is stored in the client;

The seed resource query server includes:

The receiving module is adapted to receive the query request of the latest data file sent by the client; the request is submitted when the client judges that the data file is not the latest according to the latest feature information of the data file;

A query module, adapted to query the seed resource information of the latest data file according to the request;

A return module, adapted to return the seed resource information to the client.

D22. The seed resource query server according to claim D21, wherein the seed resource information includes one or more pieces of P2SP download index information, and the seed resource query server also includes:

The download information receiving module is adapted to receive the P2SP download index information reported by the client.

Claims (10)

1. the method for data synchronization of a content-based distributing network CDN, described content distributing network CDN comprises Distributor, the node server of communicating by letter with described Distributor, the client of communicating by letter with described node server, and, with the seed resource querying server of described client communication; In described client, store the latest features information of data file;

Described method comprises:

Described client is from being the node server download data files of its distribution;

Described client, according to the latest features information of described data file, judges that whether described data file is up-to-date;

If not, described client is submitted the inquiry request of up-to-date data file to described seed resource querying server;

Seed resource information corresponding to described up-to-date data file that described in described client, seed resource querying server returns for described request;

Described client is downloaded described up-to-date data file from node server and/or the client-side of described seed resource information indication.

2. the method for claim 1, is characterized in that, described client comprises from the step of the node server download data files for its distribution:

The HTTP Download Info that client Distributor sends; Described HTTP Download Info comprises the indication information of node server;

Described client connects corresponding node server download data files according to described HTTP Download Info.

3. method as claimed in claim 2, is characterized in that, the step that described client connects corresponding node server download data files according to described HTTP Download Info comprises:

Described client is connected to corresponding node server according to described HTTP Download Info, and from described node server, a plurality of preset start-stop location segment are downloaded described data file;

Described client combines described segmentation and downloads the data file obtaining.

4. the method as described in claim 1 or 2 or 3, is characterized in that, described client, according to the latest features information of described data file, judges that the whether up-to-date step of described data file comprises:

Described client is calculated current characteristic information according to described data file;

Described client judges that whether described latest features information is consistent with current characteristic information;

If so, described client judges that described data file is up-to-date;

If not, described client judges that described data file is not for up-to-date.

5. method as claimed in claim 4, is characterized in that, the data content sign that described latest features information is latest data file, the data content sign that described current characteristic information is current data file.

6. method as claimed in claim 5, is characterized in that, the data content of described latest data file is designated the MD5 value of latest data file; The data content of described current data file is designated the MD5 value of current data file.

7. method as claimed in claim 6, it is characterized in that, described seed resource information comprises that one or more P2SP downloads index information, in described client, from node server and/or the client-side of described seed resource information indication, download the step of described up-to-date data file, described method also comprises:

Described client reports the P2SP of self to download index information to described seed resource querying server.

8. the method for data synchronization of a content-based distributing network CDN, described content distributing network CDN comprises Distributor, the node server of communicating by letter with described Distributor, the client of communicating by letter with described node server, and, with the seed resource querying server of described client communication; In described client, store the latest features information of data file;

Described method comprises:

Described seed resource querying server receives the inquiry request of the up-to-date data file of client transmission; Described request is the latest features information of the described data file of described client foundation, does not judge when described data file is not up-to-date and submits to;

Described seed resource querying server is according to the seed resource information of the described up-to-date data file of described request inquiry;

Described seed resource querying server returns to described seed resource information to described client.

9. the client in content distributing network CDN, wherein, described client is communicated by letter with node server, described node server is communicated by letter with Distributor, described client is also communicated by letter with seed resource querying server, and, in described client, store the latest features information of data file;

Described client comprises:

The first download module, is suitable for from being the node server download data files of its distribution;

Judge module, is suitable for the latest features information according to described data file, judges that whether described data file is up-to-date; If not, carry out and submit module to;

Submit module to, be suitable for submitting to described seed resource querying server the inquiry request of up-to-date data file;

Receiver module, is suitable for receiving seed resource information corresponding to described up-to-date data file that described seed resource querying server returns for described request;

The second download module, is suitable for downloading described up-to-date data file from node server and/or the client-side of described seed resource information indication.

10. the synchronous seed resource querying server of the data of a content-based distributing network CDN, wherein, described seed resource querying server and client communication, described client is communicated by letter with node server, described node server is communicated by letter with Distributor, wherein, in described client, store the latest features information of data file;

Described seed resource querying server comprises:

Receiver module, is suitable for receiving the inquiry request of the up-to-date data file that client sends; Described request is the latest features information of the described data file of described client foundation, does not judge when described data file is not up-to-date and submits to;

Enquiry module, is suitable for the seed resource information according to the described up-to-date data file of described request inquiry;

Return to module, be suitable for returning described seed resource information to described client.

Images