CN106453668A - Reverse file uploading method and system - Google Patents

Abstract

The invention discloses a file reverse upload method and system. The method includes the following steps: a sending terminal sends file information of a file to be sent to a target server; the target server assigns a download task according to the file information, and generates a download task, Send the download task to the cache server; the cache server establishes a connection with the sending terminal after receiving the download task, downloads the corresponding file from the sending terminal according to the download task, and sends the downloaded file to the target server to complete the upload. The technical scheme of the invention successfully solves the problem of file uploading under the circumstances of poor network, cache server failure, operator restriction, etc., and improves the efficiency of file uploading.

Description

A file reverse upload method and system

technical field

The invention relates to the field of computers, in particular to a method and system for reverse uploading of files.

Background technique

In recent years, with the development of Internet technology, more and more file transfers are used in the network, mainly divided into two categories: downloading files and uploading files.

In the application process of uploading files, at present, the main method of uploading files is that users use their sending terminals to directly upload files to the target server. However, the defects of this method include:

First, uploading is easily affected by the network environment, and uploading will often fail when the network is poor;

Second, the volume of files is getting bigger and bigger. For example, the size of general movies, data, game clients and other files is basically on the order of gigabytes (GB), or even larger, which leads to uploading the speed is slower;

Third, because some carriers restrict uploading in reality, when the target server is inside the carrier, it will not be able to upload quickly, or even upload successfully.

The above defects lead to the problems of poor upload quality and low upload speed in the way of directly uploading files to the target server in the prior art.

Contents of the invention

In order to solve the problems in the prior art, an embodiment of the present invention provides a method and system for reverse uploading of files. Described technical scheme is as follows:

On the one hand, a method for uploading files in reverse, comprising the following steps:

The sending terminal sends the file information of the file to be sent to the target server;

The target server assigns download tasks according to the file information, generates download tasks, and sends the download tasks to the cache server;

The cache server establishes a connection with the sending terminal after receiving the download task, downloads the corresponding file from the sending terminal according to the download task, and sends the downloaded file to the target server to complete the upload .

Further, the file information includes: the file size of the file to be sent and the uniform resource identifier of the file.

Further, the target server assigns the download task according to the file information, and generates the download task, and the step of sending the download task to the cache server specifically includes:

The target server fragments the file to be sent according to the number of available cache servers and the file information, and then generates the download task according to the fragmentation;

The target server sends the download task to the cache server.

Further, there are multiple cache servers, and the target server specifies to download different segments for different cache servers.

Further, the cache server establishes a connection with the sending terminal after receiving the download task, downloads the corresponding file from the sending terminal according to the download task, and sends the downloaded file to the target server The steps to complete the upload include:

Each cache server establishes a connection with the sending terminal after receiving its respective download task;

Each cache server sends a download request to the sending terminal according to its respective download task;

Each cache server downloads specified fragments from the sending terminal according to respective download tasks;

After each cache server finishes downloading, it sends the downloaded specified segment to the target server to complete the upload.

Further, the method further includes the following steps:

If a connection interruption occurs during the cache server downloading the specified segment, the cache server re-establishes a connection with the sending terminal, and continues to download the undownloaded part of the specified segment.

Further, the method further includes the following steps:

The target server receives the specified fragments downloaded respectively from multiple cache servers;

Combine multiple specified shards into a complete file.

Further, the method further includes the following steps:

The target server monitors the running status of multiple cache servers;

When any cache server fails, the target server sends the download task of the failed cache server to other available cache servers;

The other available cache servers re-download the specified segment according to the download task.

In another aspect, a file reverse upload system, the system includes a sending terminal, a target server and a cache server, wherein,

a sending terminal, configured to send the file information of the file to be sent to the target server;

The target server is configured to allocate download tasks according to the file information, generate download tasks, and send the download tasks to the cache server;

The cache server is configured to establish a connection with the sending terminal after receiving the download task, download a corresponding file from the sending terminal according to the download task, and send the downloaded file to the target server to complete the upload.

Further, the file information includes: the file size of the file to be sent and the uniform resource identifier of the file.

Further, the target server includes an allocation module, wherein,

The allocation module is configured to segment the file to be sent according to the number of available cache servers and the file information, then generate the download task according to the segment, and send the download task to the cache server.

Further, there are multiple cache servers, and the allocating module is further configured to designate and download different segments to different cache servers.

Further, the cache server includes:

A connection module, configured to establish a connection with the sending terminal after receiving the respective download tasks;

A download module, configured to send a download request to the sending terminal according to respective download tasks, and download specified fragments from the sending terminal;

The sending module is configured to send the downloaded specified segment to the target server to complete the upload after the download is completed.

Further, the connection module is further configured to re-establish a connection with the sending terminal if a connection interruption occurs during the downloading of the specified segment by the download module;

The download module is further configured to continue to download the undownloaded part of the specified segment.

Further, the target server also includes a combination module, wherein,

The combining module is configured to compose a plurality of specified segments into a complete file when receiving the downloaded specified segments from multiple cache servers.

Further, the target server further includes a monitoring module, which is used to monitor the running status of multiple cache servers;

Wherein, the allocation module is further configured to send the download task of the failed cache server to other available cache servers when any cache server fails;

Wherein, the other available cache servers are used to re-download the specified segment according to the download task.

The beneficial effect brought by the technical solution provided by the embodiment of the present invention is: by changing the original upload from the sending terminal to downloading from the sending terminal by the cache server, and sending the downloaded file to the target server, the reverse uploading, thereby avoiding the defect of uploading files directly to the target server in the prior art, and usually the downloading speed of the network is much faster than the uploading speed, and the equipment on the operator side, such as the cache server, downloads files from the sending terminal and is less affected by the operation Therefore, the present invention greatly improves the speed and quality of file uploading in the network by using this reverse uploading mode.

Description of drawings

In order to more clearly illustrate the technical solutions in the embodiments of the present invention, the drawings that need to be used in the description of the embodiments will be briefly introduced below. Obviously, the drawings in the following description are only some embodiments of the present invention. For those skilled in the art, other drawings can also be obtained based on these drawings without creative effort.

Fig. 1 is a flow chart of a file reverse upload method in an embodiment of the present invention;

Fig. 2 is a detailed sub-step flowchart of step S2 shown in Fig. 1 in an embodiment of the present invention;

Fig. 3 is a detailed sub-step flowchart of step S3 shown in Fig. 1 in an embodiment of the present invention;

FIG. 4 is a schematic diagram of the internal structure of the file reverse upload system 10 in an embodiment of the present invention;

FIG. 5 is a schematic diagram of the internal structure of the file reverse upload system 10 in another embodiment of the present invention.

detailed description

In order to make the object, technical solution and advantages of the present invention clearer, the implementation manner of the present invention will be further described in detail below in conjunction with the accompanying drawings. It should be understood that the specific embodiments described here are only used to explain the present invention, not to limit the present invention.

A file reverse upload method provided by the present invention will be described in detail below.

Please refer to FIG. 1 , which is a flow chart of a file reverse upload method in an embodiment of the present invention.

In one embodiment, the file reverse upload method is applied to a file reverse upload system, wherein the file reverse upload system includes a sending terminal, a target server, and a cache server, and each user connects to the network through a respective sending terminal, And the application of downloading files and uploading files is carried out, and the sending terminal is mainly a device facing the user side, such as user terminal devices such as mobile phones, tablet computers, and handheld computers. The target server and the cache server are mainly devices facing the network operator side, and the file transfer between the target server and the cache server will not limit uploading.

In step S1, the sending terminal sends the file information of the file to be sent to the target server.

In one embodiment, the file to be sent is stored in the user's sending terminal and is a file for uploading to the target server, wherein the file information includes: the file size of the file to be sent and the uniform resource identifier of the file character (Uniform Resource Identifier, URI).

In step S2, the target server distributes the download task according to the file information, generates a download task, and sends the download task to the cache server.

In one embodiment, the target server assigns download tasks according to the file information, and generates download tasks, and the step S2 of sending the download tasks to the cache server specifically includes two sub-steps of S21-S22, as shown in FIG. 2 Show.

Please refer to FIG. 2 , which shows a detailed sub-step flowchart of step S2 shown in FIG. 1 in an embodiment of the present invention.

In step S21, the target server fragments the file to be sent according to the number of available cache servers and file information, and then generates download tasks according to the fragments.

In one embodiment, if there is only one cache server, the target server does not need to fragment the file to be sent, but processes the file as a whole; The file is fragmented. For example, if the number of cache servers includes 5, the file to be sent is divided into 5 fragments. Of course, it can also be divided into 4 fragments or 6 fragments, which is not limited here.

In one embodiment, when the target server fragments the file to be sent, it will also refer to the factors of the file information. If the file to be sent has a large The smaller the number of fragments will be, for example, a 10GB file to be sent can be divided into 50 fragments or 100 fragments, and a 100MB file to be sent can be divided into 2 fragments or 3 fragments. piece.

In one embodiment, the specific number of fragments for the file to be sent depends on the number of available cache servers and file information and is determined comprehensively, and then different download tasks are generated according to the fragmentation results. Moreover, in this embodiment, the target server considers the number of fragments according to the number of available cache servers, which can avoid the number of fragments of the file to be sent when the sending terminal cannot know the number of available cache servers in the prior art Too many or too few, resulting in slow upload or waste of resources.

In step S22, the target server sends the download task to the cache server.

In one embodiment, if there is only one cache server, the target server sends the download task as a whole to the cache server for processing; if there are multiple cache servers, the generated download tasks are sent separately For different cache servers, a cache server handles at least one download task. Of course, if the network resources are sufficient, for example, the number of cache servers is large enough, some cache servers are allowed to be idle, that is, no download tasks are performed.

Please continue to refer to Figure 1, in step S3, the cache server establishes a connection with the sending terminal after receiving the download task, downloads the corresponding file from the sending terminal according to the download task, and downloads the downloaded file to the target server to complete the upload.

In one embodiment, if there are multiple cache servers, the target server specifies to download different segments for different cache servers as download tasks for each cache server. Among them, these cache servers will be placed in different places to form a distributed network, and each cache server can not only handle download tasks within its own area, but also handle download tasks outside its own area, and cooperate with each other.

In one embodiment, the cache server establishes a connection with the sending terminal after receiving the download task, downloads the corresponding file from the sending terminal according to the download task, and sends the downloaded file to the The step S3 of uploading to the target server specifically includes four sub-steps of S31-S34, as shown in FIG. 3 .

Please refer to FIG. 3 , which shows a detailed sub-step flowchart of step S3 shown in FIG. 1 in an embodiment of the present invention.

In step S31, each cache server establishes a connection with the sending terminal after receiving its respective download task.

In one embodiment, after the target server fragments the file to be sent according to the number of available cache servers and file information, it distributes the fragmentation information together with the URI of the file to be sent as a download task to each cache server. After each cache server receives its own download task, it first establishes a connection with the sending terminal.

In step S32, each cache server sends a download request to the sending terminal according to its own download task.

In one embodiment, after receiving the download request, the sending terminal transmits the requested segment to the corresponding cache server.

In step S33, each cache server downloads the specified segment from the sending terminal according to its own download task.

In one embodiment, each cache server downloads a specified segment from the sending terminal according to the segment information and the URI of the file to be sent.

In step S34, after each cache server completes the download, it sends the downloaded specified segment to the target server to complete the upload.

In one embodiment, the reverse file upload method further includes the following steps:

The target server receives the specified fragments downloaded from multiple cache servers;

Combine multiple specified shards into a complete file.

Among them, when different cache servers finish downloading their specified fragments, they will be sent to the target server for reorganization to form a complete file, which completes the uploading action from the sending terminal to the target server. In this embodiment of the present invention, since the file transfer between the target server and the cache server will not limit uploading, the file transfer between the target server and the cache server will be very smooth, and the file transfer speed is extremely fast. The quality of the file transfer is guaranteed.

In one embodiment, the reverse file upload method further includes the following steps:

If a connection interruption occurs during the cache server downloading the specified segment, the cache server re-establishes a connection with the sending terminal, and continues to download the undownloaded part of the specified segment.

Among them, setting the number of cache servers to multiple in the present invention has another advantage, that is, the integrity and smoothness of file uploading in the network can be guaranteed. After the target server sends different download tasks to each cache server, it will monitor the current working status of each cache server in real time. If the connection is interrupted during the cache server downloading the specified fragment, the cache server will reconnect with the sending terminal. Establish a connection and continue to download the undownloaded part of the specified segment without re-downloading the previously downloaded part.

In one embodiment, the reverse file upload method further includes the following steps:

The target server monitors the running status of multiple cache servers;

When any cache server fails, the target server sends the download task of the failed cache server to other available cache servers;

Other available cache servers re-download the specified segment according to the download task.

Among them, setting the number of cache servers to multiple in the present invention has another advantage, that is, it can share the pressure of file transmission in the network. For example, when any cache server breaks down, the target server can transfer the download task of the cache server that has failed. Send to other available cache servers, so as to ensure that the pressure of file transfer will not be concentrated on a certain cache server or a few cache servers, and use this distributed network to share the file transfer pressure of some sites .

A file reverse upload method provided by the present invention, by changing the method of uploading from the sending terminal to downloading from the sending terminal by the cache server, and sending the downloaded file to the target server, the reverse upload is realized, and then It avoids the defect of uploading files directly to the target server in the prior art, and usually the speed of downloading from the network is much faster than the speed of uploading, and the equipment on the operator’s side, such as the cache server, is less restricted by the operator when downloading files from the sending terminal Therefore, the present invention greatly improves the speed and quality of file uploading in the network by using this reverse uploading method.

A file reverse upload system provided by the present invention will be described in detail below.

Please refer to FIG. 4 , which is a schematic diagram of the internal structure of the file reverse upload system 10 in an embodiment of the present invention.

In one embodiment, the file reverse upload system 10 includes a sending terminal 11, a target server 12, and a cache server 13. Each user connects to the network through a respective sending terminal 11, and performs applications for downloading and uploading files. The sending terminal 11 is mainly user-oriented devices, such as mobile phones, tablet computers, handheld computers and other user terminal devices. The target server 12 and the cache server 13 are mainly devices facing the network operator side, and the file transfer between the target server 12 and the cache server 13 does not have the situation of restricting uploading.

The sending terminal 11 is configured to send the file information of the file to be sent to the target server 12 .

In one embodiment, the file to be sent is stored in the sending terminal 11 of the user, and is a file for uploading to the target server 12, wherein the file information includes: the file size of the file to be sent and the URI of the file .

The target server 12 is configured to allocate download tasks according to the file information, generate download tasks, and send the download tasks to the cache server 13 .

The cache server 13 is configured to establish a connection with the sending terminal 11 after receiving the download task, download the corresponding file from the sending terminal 11 according to the download task, and send the downloaded file to the target server 12 to complete the upload.

In one embodiment, the target server 12 includes an allocation module 121 , a combination module 122 and a monitoring module 123 .

The allocation module 121 is configured to segment the file to be sent according to the number of available cache servers 13 and file information, and then generate a download task according to the segments, and send the download task to the cache server 13 .

In one embodiment, the number of cache servers 13 is multiple, as shown in Figure 5, these cache servers 13 will be placed in different places to form a distributed network, each cache server 13 can handle both It can also handle the download tasks outside the region, and cooperate with each other. Wherein, the allocation module 121 is further configured to designate and download different segments to different cache servers.

In one embodiment, the cache server 13 includes a connection module 131 , a download module 132 and a sending module 133 .

The connection module 131 is configured to establish a connection with the sending terminal 11 after receiving respective download tasks.

The download module 132 is configured to send a download request to the sending terminal 11 according to respective download tasks, and download specified segments from the sending terminal 11 .

The sending module 133 is configured to send the downloaded specified segment to the target server 12 to complete the upload after the download is completed.

In one embodiment, the connection module 131 is further configured to re-establish a connection with the sending terminal 11 if a connection interruption occurs during the downloading of the specified segment by the download module 132 .

In one embodiment, the download module 132 is further configured to continue downloading undownloaded parts of the specified segment.

In one embodiment, the combination module 122 is configured to compose a plurality of specified segments into a complete file when receiving the downloaded specified segments from multiple cache servers 13 .

In one embodiment, the monitoring module 123 is configured to monitor the running status of one or more cache servers 13 .

Wherein, the allocation module 121 is further configured to send the download task of the failed cache server to other available cache servers when any cache server fails. Wherein, the other available cache servers are used to re-download the specified segment according to the download task.

A file reverse upload system 10 provided by the present invention realizes reverse upload by changing the method of uploading from the sending terminal to downloading from the sending terminal by the cache server, and sending the downloaded file to the target server. Furthermore, the defect of directly uploading files to the target server in the prior art is avoided, and the speed of downloading from the network is usually much faster than the speed of uploading, and equipment on the operator’s side, such as a cache server, downloads files from the sending terminal and is less affected by the operator. Therefore, the present invention greatly improves the speed and quality of file uploading in the network by using this reverse uploading method.

The device embodiments described above are only illustrative, and the units described as separate components may or may not be physically separated, and the components shown as units may or may not be physical units, that is, they may be located in One place, or it can be distributed to multiple network elements. Part or all of the modules can be selected according to actual needs to achieve the purpose of the solution of this embodiment. It can be understood and implemented by those skilled in the art without any creative efforts.

Through the above description of the implementations, those skilled in the art can clearly understand that each implementation can be implemented by means of software plus a necessary general hardware platform, and of course also by hardware. Based on this understanding, the essence of the above technical solution or the part that contributes to the prior art can be embodied in the form of software products, and the computer software products can be stored in computer-readable storage media, such as ROM/RAM, magnetic discs, optical discs, etc., including several instructions to make a computer device (which may be a personal computer, server, or network device, etc.) execute the methods described in various embodiments or some parts of the embodiments.

The above descriptions are only preferred embodiments of the present invention, and are not intended to limit the present invention. Any modifications, equivalent replacements, improvements, etc. made within the spirit and principles of the present invention shall be included in the protection of the present invention. within range.

Claims (16)

1. A method for reverse uploading of files, characterized in that said method comprises the following steps: The sending terminal sends the file information of the file to be sent to the target server; The target server assigns download tasks according to the file information, generates download tasks, and sends the download tasks to the cache server; The cache server establishes a connection with the sending terminal after receiving the download task, downloads the corresponding file from the sending terminal according to the download task, and sends the downloaded file to the target server to complete the upload . 2. The file reverse upload method according to claim 1, wherein the file information includes: the file size of the file to be sent and the uniform resource identifier of the file. 3. The file reverse upload method according to claim 2, wherein the target server assigns download tasks according to the file information and generates download tasks, and the step of sending the download tasks to the cache server is specific include: The target server fragments the file to be sent according to the number of available cache servers and the file information, and then generates the download task according to the fragmentation; The target server sends the download task to the cache server. 4. The file reverse upload method according to claim 3, wherein there are multiple cache servers, and the target server specifies to download different fragments for different cache servers. 5. The file reverse upload method according to claim 4, wherein the cache server establishes a connection with the sending terminal after receiving the download task, and downloads from the sending terminal according to the download task. corresponding file, and the downloaded file is sent to the target server to complete the steps of uploading specifically comprising: Each cache server establishes a connection with the sending terminal after receiving its respective download task; Each cache server sends a download request to the sending terminal according to its respective download task; Each cache server downloads specified fragments from the sending terminal according to respective download tasks; After each cache server finishes downloading, it sends the downloaded specified segment to the target server to complete the upload. 6. The file reverse upload method as claimed in claim 5, wherein said method further comprises the following steps: If a connection interruption occurs during the cache server downloading the specified segment, the cache server re-establishes a connection with the sending terminal, and continues to download the undownloaded part of the specified segment. 7. The file reverse upload method according to claim 4 or 5, wherein the method further comprises the following steps: The target server receives the specified fragments downloaded respectively from multiple cache servers; Combine multiple specified shards into a complete file. 8. The file reverse upload method according to claim 4, characterized in that said method further comprises the following steps: The target server monitors the running status of multiple cache servers; When any cache server fails, the target server sends the download task of the failed cache server to other available cache servers; The other available cache servers re-download the specified segment according to the download task. 9. A file reverse upload system, characterized in that the system includes a sending terminal, a target server and a cache server, wherein, a sending terminal, configured to send the file information of the file to be sent to the target server; The target server is configured to allocate download tasks according to the file information, generate download tasks, and send the download tasks to the cache server; The cache server is configured to establish a connection with the sending terminal after receiving the download task, download a corresponding file from the sending terminal according to the download task, and send the downloaded file to the target server to complete the upload. 10. The file reverse upload system according to claim 9, wherein the file information includes: the file size of the file to be sent and the uniform resource identifier of the file. 11. The reverse file upload system according to claim 10, wherein the target server includes a distribution module, wherein, The allocation module is configured to segment the file to be sent according to the number of available cache servers and the file information, then generate the download task according to the segment, and send the download task to the cache server. 12. The file reverse upload system according to claim 11, wherein there are multiple cache servers, and the allocation module is further configured to designate and download different segments for different cache servers. 13. The file reverse upload system according to claim 12, wherein the cache server comprises: A connection module, configured to establish a connection with the sending terminal after receiving the respective download tasks; A download module, configured to send a download request to the sending terminal according to respective download tasks, and download specified fragments from the sending terminal; The sending module is configured to send the downloaded specified segment to the target server to complete the upload after the download is completed. 14. The file reverse upload system as claimed in claim 13, wherein the connection module is further configured to reconnect with the sending module if a connection interruption occurs during the downloading of the specified fragment by the download module. The terminal establishes a connection; The download module is further configured to continue downloading undownloaded parts of the specified segment. 15. The file reverse upload system as claimed in claim 12 or 13, wherein the target server further comprises a combination module, wherein, The combining module is configured to compose a plurality of specified segments into a complete file when receiving the downloaded specified segments from multiple cache servers. 16. The file reverse upload system according to claim 12, wherein the target server further comprises a monitoring module, the monitoring module is used to monitor the operating status of multiple cache servers; Wherein, the allocation module is further configured to send the download task of the failed cache server to other available cache servers when any cache server fails; Wherein, the other available cache servers are used to re-download the specified segment according to the download task.