CN105656794B - Data distributing method, device and computer readable storage medium - Google Patents
Data distributing method, device and computer readable storage medium Download PDFInfo
- Publication number
- CN105656794B CN105656794B CN201410648461.XA CN201410648461A CN105656794B CN 105656794 B CN105656794 B CN 105656794B CN 201410648461 A CN201410648461 A CN 201410648461A CN 105656794 B CN105656794 B CN 105656794B
- Authority
- CN
- China
- Prior art keywords
- data
- target terminal
- intermediate node
- target
- virtual machine
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000003860 storage Methods 0.000 title claims abstract description 68
- 238000000034 method Methods 0.000 title claims abstract description 43
- 230000005540 biological transmission Effects 0.000 claims description 37
- 230000000694 effects Effects 0.000 abstract description 11
- 238000005516 engineering process Methods 0.000 abstract description 8
- 230000000875 corresponding effect Effects 0.000 description 15
- 230000006870 function Effects 0.000 description 14
- 238000010586 diagram Methods 0.000 description 8
- 230000015654 memory Effects 0.000 description 8
- 238000012546 transfer Methods 0.000 description 6
- 238000012545 processing Methods 0.000 description 4
- 230000008901 benefit Effects 0.000 description 3
- 230000008569 process Effects 0.000 description 3
- 230000014759 maintenance of location Effects 0.000 description 2
- 238000004891 communication Methods 0.000 description 1
- 239000012141 concentrate Substances 0.000 description 1
- 230000002596 correlated effect Effects 0.000 description 1
- 238000013461 design Methods 0.000 description 1
- 230000006872 improvement Effects 0.000 description 1
- 210000003127 knee Anatomy 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 239000011800 void material Substances 0.000 description 1
Landscapes
- Data Exchanges In Wide-Area Networks (AREA)
- Information Transfer Between Computers (AREA)
Abstract
The invention discloses a kind of data distributing method and devices, belong to field of computer technology.The data distributing method includes: to receive the triggering command that data distribution is carried out at least two target terminals；At least two target terminal is grouped；Select a target terminal as the intermediate node of the target terminal group in each target terminal group that grouping obtains；Distribute target data to the corresponding target terminal group by the intermediate node.The present invention distributes target data to corresponding target terminal group by the way that the intermediate node of every group of target terminal is grouped and determined to target terminal, by intermediate node；Due to distributing data by intermediate node, the data traffic of storage server is shared, therefore the flow pressure for solving storage server is excessive, the lower problem of data distribution efficiency；Achieve the effect that improve data distribution efficiency.
Description
Technical field
The present invention relates to field of computer technology, in particular to a kind of data distributing method and device.
Background technique
Most of data center now is all the data different come storage and distribution by the distribution server group.These numbers
It is also likely to be to add various software and application program, such as mirror image in operating system again according to may be simple operating system
File.The distribution server group generally includes the distribution server and storage server, to realize distribution data and storing data respectively.
A kind of data distributing method provided in the related art, the distribution server directly data from storage server according to
Secondary to be transferred on each target terminal, target terminal can be virtual machine.
In the implementation of the present invention, the inventor finds that the existing technology has at least the following problems: due to storage service
Device needs to distribute data to each target terminal respectively, data distribution effect excessive so as to cause the flow pressure of storage server
Rate is lower.
Summary of the invention
In order to which the flow pressure for solving storage server in the prior art is excessive, the lower problem of distribution efficiency, the present invention
Embodiment provides a kind of data distributing method and device.The technical solution is as follows:
In a first aspect, providing a kind of data distributing method, which comprises
The distribution server receives the triggering command that data distribution is carried out at least two target virtual machines；
The distribution server determines number of packet N, the number of packet N and institute according to the sum of the target virtual machine
The total correlation of target virtual machine is stated, alternatively, the number for the image file that the distribution server is distributed as needed
Number of packet N is determined according to size, and the size of data correlation of the number of packet N and the image file, N is just whole
Number；
The distribution server is according to the transmission rate between the number of packet N and the target virtual machine, to institute
It states at least two target virtual machines to be grouped, the transmission rate belonged between the target virtual machine in same group is greater than default
Rate-valve value；
The distribution server selects a target virtual machine as institute in each destination virtual unit that grouping obtains
State the intermediate node of destination virtual unit；
The image file is distributed in each intermediate node by the distribution server from storage server；
The distribution server logs in each intermediate node by safety shell protocol, will be described using Data Backup Tool
Image file is distributed in the target virtual machine with same group of the intermediate node from each intermediate node.
Second aspect provides a kind of data delivery device, is applied in the distribution server, described device includes:
Receiving module, for receiving the triggering command for carrying out data distribution at least two target virtual machines；
Grouping module, for being grouped at least two target virtual machine；
Selecting module, for selecting a target void in each destination virtual unit that the grouping module is grouped
Quasi- intermediate node of the machine as the destination virtual unit；
Distribution module, for image file to be distributed in each intermediate node from storage server；Pass through Secure Shell
The each intermediate node of protocol entry, using Data Backup Tool by the image file from each intermediate node be distributed to it is described
In the target virtual machine that same group of intermediate node；
The grouping module includes:
First determination unit, for determining that number of packet N, N are positive integer；
Grouped element, for according to the transmission rate between the number of packet N and the target virtual machine, to described
At least two target virtual machines are grouped, and the transmission rate belonged between the target virtual machine in same group is greater than default speed
Rate threshold value；
Wherein, first determination unit, comprising:
First determines subelement, for determining number of packet N, the number of packet according to the sum of the target virtual machine
The total correlation of N and the target virtual machine；
Or,
Second determines subelement, for determining number of packet N, the packet count according to the size of data of the image file
Measure the size of data correlation of N and the image file.
The third aspect provides a kind of computer readable storage medium, is stored thereon with program, described program is by processor
It executes to realize data distributing method as described in relation to the first aspect.
Technical solution provided in an embodiment of the present invention has the benefit that
By the way that the intermediate node of every group of target terminal is grouped and determined to target terminal, by intermediate node to correspondence
Target terminal group distribute target data；Due to distributing data by intermediate node, the data flow of storage server has been shared
Amount, therefore the flow pressure for solving storage server is excessive, the lower problem of data distribution efficiency；Raising data point are reached
Send out the effect of efficiency.
Detailed description of the invention
To describe the technical solutions in the embodiments of the present invention more clearly, make required in being described below to embodiment
Attached drawing is briefly described, it should be apparent that, drawings in the following description are only some embodiments of the invention, for
For those of ordinary skill in the art, without creative efforts, it can also be obtained according to these attached drawings other
Attached drawing.
Fig. 1 is the schematic diagram of implementation environment involved in the data distributing method that provides in section Example of the present invention；
Fig. 2 is the method flow diagram of the data distributing method provided in one embodiment of the invention；
Fig. 3 is the method flow diagram of the data distributing method provided in another embodiment of the present invention；
Fig. 4 is the structural schematic diagram of the data delivery device provided in one embodiment of the invention；
Fig. 5 is the structural schematic diagram of the data delivery device provided in another embodiment of the present invention；
Fig. 6 is the structural schematic diagram at the data distribution end provided in section Example of the present invention.
Specific embodiment
To make the object, technical solutions and advantages of the present invention clearer, below in conjunction with attached drawing to embodiment party of the present invention
Formula is described in further detail.
Shown in Figure 1, it illustrates real involved in the data distributing method provided in section Example of the present invention
The schematic diagram of environment is applied, as shown in Figure 1, the implementation environment may include the distribution server 120, storage server 140 and at least
One target terminal 160.
The distribution server 120 is for sending distribution command.The distribution server 120 said here can be a service
Device, or the server cluster consisted of several servers or a cloud computing service center.
Storage server 140 is for storing target data.Storage server 140 said here can be a service
Device, or the server cluster consisted of several servers or a cloud computing service center.
The distribution server 120 can be connected with storage server 140 by cable network mode or wireless network mode.
At least one target terminal 160 passes through cable network mode or wireless network mode and the distribution server 120 respectively
And storage server 140 connects.
Target terminal 160 can be terminal for receiving target data, the target terminal 160 can be smart phone,
Tablet computer, smart television, E-book reader, multimedia player, pocket computer on knee and desktop computer etc..
Shown in Figure 2, it illustrates the method flows of the data distributing method provided in one embodiment of the invention
Figure.The present embodiment is applied to illustrate in the distribution server with the data distributing method.The data distributing method can wrap
It includes:
Step 201, the triggering command that data distribution is carried out at least two target terminals is received.
Step 202, at least two target terminals are grouped.
Step 203, select a target terminal as target terminal group in each target terminal group that grouping obtains
Intermediate node.
Step 204, target data is distributed to corresponding target terminal group by intermediate node.
In conclusion data distributing method provided in an embodiment of the present invention, by being grouped and determining to target terminal
The intermediate node of every group of target terminal distributes target data to corresponding target terminal group by intermediate node；In passing through
Intermediate node distributes data, has shared the data traffic of storage server, therefore solve the flow pressure mistake of storage server
Greatly, the lower problem of data distribution efficiency；Achieve the effect that improve data distribution efficiency.
Shown in Figure 3, it illustrates the method streams of the data distributing method provided in another embodiment of the present invention
Cheng Tu.The present embodiment is applied to illustrate in the distribution server with the data distributing method.The data distributing method can be with
Include:
Step 301, the triggering command that data distribution is carried out at least two target terminals is received.
In general, the triggering command is to be sent from user by target terminal to the distribution server.The triggering command can be with
It is the request for downloading data that user passes through that target terminal is sent to the distribution server, is also possible to other requests, this reality
It applies example and this is not construed as limiting.
Optionally, which also may include the letter such as network address, configuration parameter, Network status of target terminal
Breath.
The distribution server, can be corresponding with the triggering command according to triggering command determination after receiving triggering command
The information such as network address, configuration parameter, the Network status of target terminal.
In a kind of usage scenario, the distribution server, can be to mesh after receiving the triggering command for carrying out data distribution
Data distribution is carried out after mark end packet, to improve data distribution efficiency.Detailed process when being grouped to target terminal
It then may refer to following step 302 to 303.
Step 302, determine that number of packet N, N are positive integer.
The distribution server can be realized when determining number of packet N by any one in the following two kinds mode.
In one implementation, the distribution server determines number of packet N, number of packet N according to the sum of target terminal
With the total correlation of target terminal.
The distribution server can determine the sum of target terminal when determining number of packet N according to the sum of target terminal
M, according to formulaDetermine number of packet N.
Here ceil is the function that rounds up, to ensure number of packet N as positive integer.For example, working as the total of target terminal
When number M is 200, it is calculatedValue be 14.14, round up to 14.14 can obtain number of packet N be 15.
In general, the corresponding target terminal of a triggering command, the distribution server is in the sum M for determining target terminal
When, it can be determined according to the triggering command received.For example, the distribution server receives 200 triggering commands, then target
The sum M of terminal is 200.
In another implementation, the distribution server determines number of packet N according to the size of data of target data, point
The size of data correlation of group quantity N and target data.
In general, will accordingly increase the time required to distribution procedure when the target data that the distribution server needs to distribute is excessive
Add, therefore the distribution server can determine, so that score when determining number of packet N according to the size of data of target data
Time needed for hair process is most short.
In general, target terminal in every group is just corresponding fewer when number of packet N is bigger, thus can accordingly shorten
The time required to distribution procedure.Therefore, number of packet N can be with the size of data correlation of target data.
Optionally, in order to mitigate the flow pressure of storage server, number of packet threshold value, the distribution server institute can be set
The value of determining number of packet N cannot be greater than the number of packet threshold value.
It should be noted that the storage server is the server in the distribution server group for storing data.
Step 303, at least two target terminals are grouped according to number of packet N.
The distribution server can pass through following two when being grouped according to number of packet N at least two target terminals
Any one realization in kind mode.
In one implementation, at least two target terminals are divided into N group by the distribution server, are belonged in same group
Target terminal is under the same network address section or the same gateway, in the same network address section or the same gateway
Target terminal under equipment belongs to same group or different groups.
The distribution server, can be according to the target received after obtaining target terminal sum M and determining number of packet N
The triggering command that terminal is sent, obtains the network address of each target terminal, and carry out respective stored.
As a kind of possible implementation, the distribution server is analyzed and is obtained in each according to the network address of storage
The target terminal quantity A of network address section.When the target terminal quantity A in some network address section is greater than M/N, by the net
Target terminal in network address field is divided intoGroup；When the target terminal quantity A in some network address section is less than M/N
And when being greater than M/2N, using the target terminal in the network address section as one group；Target terminal in some network address section
When quantity A is less than M/2N, the target terminal in the network address section is merged into the immediate network of network address section
In target terminal group corresponding to the section of location.
It should be noted that the target in each target terminal group obtained by the group technology in this implementation
Terminal quantity is not necessarily equal to M/N, and the quantity of the target terminal group obtained by the group technology in this implementation
Also it is not necessarily equal to N.
In another implementation, at least two target terminals are divided into N group by the distribution server, are belonged in same group
Target terminal between transmission rate be greater than scheduled rate threshold value.
The distribution server can require target terminal to report after obtaining target terminal sum M and determining number of packet N
With the transmission rate between each target terminal, the transmission rate between each target terminal and each target terminal is recorded, and
It determines the peak transfer rate between each target terminal and each target terminal, that is, M peak transfer rate has been determined.Distribution
Server sets rate-valve value according to this M peak transfer rate, and the rate-valve value is lower than the minimum in M peak transfer rate
Value.
Transmission rate between target terminal is greater than the mesh of the rate-valve value after setting rate-valve value by the distribution server
Mark terminal is classified as a target terminal collection.When some target terminal belongs to multiple target terminal collection, will with the target terminal it
Between target terminal collection where the target terminal with peak transfer rate be determined as the target terminal collection of the target terminal.When every
When a target terminal all corresponds to a target terminal collection, the target terminal quantity B that each target terminal is concentrated is determined.When some mesh
When marking the target terminal quantity B in termination set greater than M/N, the target terminal which concentrates is divided into
Group；When the target terminal quantity B that some target terminal is concentrated is less than M/N and is greater than M/2N, mesh which is concentrated
Terminal is marked as one group；When the target terminal quantity B that some target terminal is concentrated is less than M/2N, by the target terminal collection and its
Target terminal collection of its target terminal quantity less than M/2N is incorporated as one group.
It should be noted that the target in each target terminal group obtained by the group technology in this implementation
Terminal quantity is not necessarily equal to M/N, and the quantity of the target terminal group obtained by the group technology in this implementation
Also it is not necessarily equal to N.
Step 304, select a target terminal as the target terminal group in each target terminal group that grouping obtains
Intermediate node.
The distribution server selects middle node of the target terminal as the target terminal group in each target terminal group
When point, it can be realized by any one in the following two kinds mode.
In one implementation, for each target terminal group, the distribution server obtains each mesh in target terminal group
The transmission rate between terminal and storage server is marked, the highest target terminal of transmission rate is determined as the target terminal group
Intermediate node.
The distribution server, can be according to the triggering command that target terminal is sent come really after to all target terminal groupings
The transmission rate between target terminal and storage server in fixed each target terminal group.Optionally, the distribution server can also
To require the target terminal in each target terminal group to report the transmission rate between storage server.
The distribution server is obtaining the target terminal in each target terminal group and the transmission rate between storage server
Afterwards, the target terminal between storage server with peak transfer rate is determined in each target terminal group, and by the target
The intermediate node of target terminal group where terminal is determined as the target terminal.
In another implementation, for each target terminal group, the distribution server obtains each in target terminal group
The highest target terminal of performance is determined as the intermediate node of the target terminal group by the performance of target terminal.
The distribution server, can be according to the triggering command that target terminal is sent come really after to all target terminal groupings
The performance of target terminal in fixed each target terminal group.Optionally, the distribution server may also require that each target terminal group
In target terminal report its performance.
The distribution server determines each target terminal group after the performance for obtaining the target terminal in each target terminal group
In the target terminal with peak performance, and the target terminal is determined as to the middle node of target terminal group where the target terminal
Point.
Step 305, target data is distributed in each intermediate node from storage server.
The distribution server starts to distribute the mesh in storage server after determining the intermediate node in each target terminal group
Mark data.
The distribution server can log in storage server by safety shell protocol (SSH, Secure Shell), use number
The target data in storage server is distributed in each intermediate node according to backup tool (RSYNC, remote sync).
Step 306, target data is distributed in the target terminal with same group of the intermediate node from each intermediate node.
After target data is distributed in each intermediate node, the distribution server can be logged in by safety shell protocol
Target data in each intermediate node is distributed to using Data Backup Tool and is belonged to the intermediate node by each intermediate node
In same group of target terminal.
In conclusion data distributing method provided in an embodiment of the present invention, by being grouped and determining to target terminal
The intermediate node of every group of target terminal distributes target data to corresponding target terminal group by intermediate node；In passing through
Intermediate node distributes data, has shared the data traffic of storage server, therefore solve the flow pressure mistake of storage server
Greatly, the lower problem of data distribution efficiency；Achieve the effect that improve data distribution efficiency.
Data distributing method provided in an embodiment of the present invention is belonged to same by the way that at least two target terminals are divided into N group
Target terminal in group is under the same network address section or the same gateway；Due to by the same network address section
Or the target terminal under the same gateway is assigned in identical group, therefore solves in same group that target terminal is mixed and disorderly,
So as to cause the lower problem of transmission rate；Achieve the effect that improve data distribution efficiency.
Data distributing method provided in an embodiment of the present invention, by obtaining each target terminal and storage in target terminal group
The highest target terminal of transmission rate is determined as the intermediate node of target terminal group by the transmission rate between server；Due to
Using the target terminal between storage server with maximum transmission rate as intermediate node, therefore solves intermediate node biography
Defeated performance is poor, so as to cause the lower problem of distribution efficiency；Achieve the effect that improve data distribution efficiency.
In a specific example, target data is image file, and target terminal is virtual machine, and user passes through virtual machine
Distribution operation is initiated to mirror image the distribution server.Virtual machine is divided into N group by mirror image the distribution server, and from N number of virtual robot arm
It respectively selects a virtual machine as intermediate node, namely N number of intermediate node has been determined, the corresponding virtual machine of each intermediate node
Group.Mirror image the distribution server logs in mirrored storage server by safety shell protocol, is carried out using mirror back-up of data tool
Mirror image transmission, image file is distributed on N number of intermediate node from mirrored storage server.Mirror image the distribution server passes through peace again
Full shell protocol logs in each intermediate node, carries out mirror image transmission using mirror back-up of data tool, by image file from each
Intermediate node is distributed to the intermediate node on the virtual machine organized.
The following are the device of the invention embodiments can refer to above-mentioned corresponding the details of wherein not detailed description
Embodiment of the method.
Shown in Figure 4, it illustrates the structural representations of the data delivery device provided in one embodiment of the invention
Figure.The present embodiment is applied to illustrate in the distribution server with the data delivery device.The data delivery device can wrap
It includes: receiving module 402, grouping module 404, selecting module 406 and distribution module 408.
The receiving module 402 is used to receive the triggering command for carrying out data distribution at least two target terminals.
The grouping module 404 is for being grouped at least two target terminals.
The selecting module 406, which is used to be grouped in obtained each target terminal group in grouping module 404, selects a target
Intermediate node of the terminal as the target terminal group.
The distribution module 408 is used to distribute by the intermediate node that selecting module 406 selects to corresponding target terminal group
Target data.
In conclusion data delivery device provided in an embodiment of the present invention, by being grouped and determining to target terminal
The intermediate node of every group of target terminal distributes target data to corresponding target terminal group by intermediate node；In passing through
Intermediate node distributes data, has shared the data traffic of storage server, therefore solve the flow pressure mistake of storage server
Greatly, the lower problem of data distribution efficiency；Achieve the effect that improve data distribution efficiency.
Shown in Figure 5, it illustrates the structures of the data delivery device provided in another embodiment of the present invention to show
It is intended to.The present embodiment is applied to illustrate in the distribution server with the data delivery device.The data delivery device can be with
It include: receiving module 502, grouping module 504, selecting module 506 and distribution module 508.
The receiving module 502 is used to receive the triggering command for carrying out data distribution at least two target terminals.
The grouping module 504 is for being grouped at least two target terminals.
The selecting module 506, which is used to be grouped in obtained each target terminal group in grouping module 504, selects a target
Intermediate node of the terminal as the target terminal group.
The distribution module 508 is used to distribute by the intermediate node that selecting module 506 selects to corresponding target terminal group
Target data.
In a kind of possible embodiment, which may include: the first determination unit 504a and grouped element
504b。
The first determination unit 504a is for determining that number of packet N, N are positive integer.
The number of packet N that grouped element 504b is used to be determined according to the first determination unit 504a is at least two targets end
End is grouped.
In a kind of possible embodiment, first determination unit 504a may include: the first determining subelement 504a1
Or second determine subelement 504a2.
This first determine subelement 504a1 be used for according to target terminal sum determine number of packet N, number of packet N with
The total correlation of target terminal.
The second determining subelement 504a2 is used to determine number of packet N, number of packet according to the size of data of target data
The size of data correlation of N and target data.
In a kind of possible embodiment, which may include: that third determines subelement
504a1A and the 4th determines subelement 504a1B.
The third determines subelement 504a1A for determining the sum M of target terminal.
4th determines that subelement 504a1B is used for according to formulaDetermine that packet count N, ceil are upward
Bracket function.
In a kind of possible embodiment, grouped element 504b may include: the first grouping subelement 504b1 or
Two grouping subelement 504b2.
First grouping subelement 504b1 is used at least two target terminals being divided into N group, belongs to the mesh in same group
Mark terminal is under the same network address section or the same gateway, is set in the same network address section or the same gateway
Target terminal under standby belongs to same group or different groups.
The second packet subelement 504b2 is used at least two target terminals being divided into N group, belongs to the mesh in same group
The transmission rate marked between terminal is greater than scheduled rate threshold value.
In a kind of possible embodiment, which may include: that the second determination unit 506a or third determine
Unit 506b.
The second determination unit 506a is used to obtain each target terminal in target terminal group for each target terminal group
The highest target terminal of transmission rate is determined as the middle node of the target terminal group by the transmission rate between storage server
Point.
The third determination unit 506b is used to obtain each target terminal in target terminal group for each target terminal group
Performance, the highest target terminal of performance is determined as to the intermediate node of the target terminal group.
In a kind of possible embodiment, which may include: the distribution of the first Dispatching Unit 508a and second
Unit 508b.
The first Dispatching Unit 508a is for target data to be distributed in each intermediate node from storage server.
The second Dispatching Unit 508b is used to for target data being distributed to from each intermediate node same with the intermediate node
In the target terminal of group.
In conclusion data delivery device provided in an embodiment of the present invention, by being grouped and determining to target terminal
The intermediate node of every group of target terminal distributes target data to corresponding target terminal group by intermediate node；In passing through
Intermediate node distributes data, has shared the data traffic of storage server, therefore solve the flow pressure mistake of storage server
Greatly, the lower problem of data distribution efficiency；Achieve the effect that improve data distribution efficiency.
Data delivery device provided in an embodiment of the present invention is belonged to same by the way that at least two target terminals are divided into N group
Target terminal in group is under the same network address section or the same gateway；Due to by the same network address section
Or the target terminal under the same gateway is assigned in identical group, therefore solves in same group that target terminal is mixed and disorderly,
So as to cause the lower problem of transmission rate；Achieve the effect that improve data distribution efficiency.
Data delivery device provided in an embodiment of the present invention, by obtaining each target terminal and storage in target terminal group
The highest target terminal of transmission rate is determined as the intermediate node of target terminal group by the transmission rate between server；Due to
Using the target terminal between storage server with maximum transmission rate as intermediate node, therefore solves intermediate node biography
Defeated performance is poor, so as to cause the lower problem of distribution efficiency；Achieve the effect that improve data distribution efficiency.
It should be understood that the data delivery device provided in above-described embodiment is when distributing data, only with above-mentioned each function
Can module division progress for example, in practical application, can according to need and by above-mentioned function distribution by different functions
Module is completed, i.e., the internal structure at data distribution end is divided into different functional modules, with complete it is described above whole or
Person's partial function.In addition, data delivery device provided by the above embodiment and data distributing method embodiment belong to same design,
Its specific implementation process is detailed in embodiment of the method, and which is not described herein again.
Referring to FIG. 6, it illustrates the structural schematic diagrams at the data distribution end provided in section Example of the present invention.It is described
Data distribution end 600 includes central processing unit (CPU) 601 including random access memory (RAM) 602 and read-only memory
(ROM) 603 system storage 604, and the system bus 605 of connection system storage 604 and central processing unit 601.
The data distribution end 600 further includes the basic input/output that information is transmitted between each device helped in computer
(I/O system) 606, and massive store for storage program area 613, application program 614 and other program modules 615 are set
Standby 607.
The basic input/output 606 includes display 608 for showing information and inputs letter for user
The input equipment 609 of such as mouse, keyboard etc of breath.Wherein the display 608 and input equipment 609 are all by being connected to
The input and output controller 610 of system bus 605 is connected to central processing unit 601.The basic input/output 606
Can also include input and output controller 610 with for receive and handle from keyboard, mouse or electronic touch pen etc. it is multiple its
The input of his equipment.Similarly, input and output controller 610 also provides output to display screen, printer or other kinds of defeated
Equipment out.
The mass-memory unit 607 is by being connected to the bulk memory controller (not shown) of system bus 605
It is connected to central processing unit 601.The mass-memory unit 607 and its associated computer-readable medium are data point
Originator 600 provides non-volatile memories.That is, the mass-memory unit 607 may include such as hard disk or CD-
The computer-readable medium (not shown) of ROM drive etc.
Without loss of generality, the computer-readable medium may include computer storage media and communication media.Computer
Storage medium includes information such as computer readable instructions, data structure, program module or other data for storage
The volatile and non-volatile of any method or technique realization, removable and irremovable medium.Computer storage medium includes
RAM, ROM, EPROM, EEPROM, flash memory or other solid-state storages its technologies, CD-ROM, DVD or other optical storages, tape
Box, tape, disk storage or other magnetic storage devices.Certainly, skilled person will appreciate that the computer storage medium
It is not limited to above-mentioned several.Above-mentioned system storage 604 and mass-memory unit 607 may be collectively referred to as memory.
According to various embodiments of the present invention, the data distribution end 600 can also be connected by networks such as internets
The remote computer operation being connected on network.Namely data distribution end 600 can be by being connected on the system bus 605
Network Interface Unit 611 is connected to network 612, in other words, Network Interface Unit 611 can be used also to be connected to other types
Network or remote computer system (not shown).
The memory further includes that one or more than one program, the one or more programs are stored in
In memory.The one or more programs have following function:
Receive the triggering command that data distribution is carried out at least two target terminals；
At least two target terminals are grouped；
Middle node of the target terminal as the target terminal group is selected in each target terminal group that grouping obtains
Point；
Distribute target data to corresponding target terminal group by intermediate node.
In a kind of possible embodiment, said one or multiple programs also have following function:
At least two target terminals are grouped, comprising:
Determine that number of packet N, N are positive integer；
At least two target terminals are grouped according to number of packet N.
In a kind of possible embodiment, said one or multiple programs also have following function:
Determine number of packet N, comprising:
Number of packet N is determined according to the sum of target terminal, and the sum of number of packet N and target terminal is positively correlated pass
System；
Or,
Number of packet N is determined according to the size of data of target data, and the size of data of number of packet N and target data is in just
Correlativity.
In a kind of possible embodiment, said one or multiple programs also have following function:
Number of packet is determined according to the sum of target terminal, comprising:
Determine the sum M of target terminal；
According to formulaDetermine that packet count N, ceil are the function that rounds up.
In a kind of possible embodiment, said one or multiple programs also have following function:
At least two target terminals are grouped according to number of packet N, comprising:
At least two target terminals are divided into N group, the target terminal belonged in same group is in the same network address
Under section or the same gateway, the target terminal under the same network address section or the same gateway belongs to same group
Other or different groups；
Or,
At least two target terminals are divided into N group, the transmission rate between target terminal belonged in same group is greater than
Scheduled rate threshold value.
In a kind of possible embodiment, said one or multiple programs also have following function:
Intermediate node of the target terminal as target terminal group is selected in each group target terminal group that grouping obtains,
Include:
For each target terminal group, the transmission in target terminal group between each target terminal and storage server is obtained
The highest target terminal of transmission rate is determined as the intermediate node of the target terminal group by rate；
Or,
For each target terminal group, the performance of each target terminal in target terminal group is obtained, by the highest mesh of performance
Mark terminal is determined as the intermediate node of the target terminal group.
In a kind of possible embodiment, said one or multiple programs also have following function:
Distribute target data to corresponding target terminal group by intermediate node, comprising:
Target data is distributed in each intermediate node from storage server；
Target data is distributed in the target terminal with same group of the intermediate node from each intermediate node.
The serial number of the above embodiments of the invention is only for description, does not represent the advantages or disadvantages of the embodiments.
Those of ordinary skill in the art will appreciate that realizing that all or part of the steps of above-described embodiment can pass through hardware
It completes, relevant hardware can also be instructed to complete by program, the program can store in a kind of computer-readable
In storage medium, storage medium mentioned above can be read-only memory, disk or CD etc..
The foregoing is merely presently preferred embodiments of the present invention, is not intended to limit the invention, it is all in spirit of the invention and
Within principle, any modification, equivalent replacement, improvement and so on be should all be included in the protection scope of the present invention.
Claims (7)
1. a kind of data distributing method, which is characterized in that the described method includes:
The distribution server receives the triggering command that data distribution is carried out at least two target virtual machines；
The distribution server determines number of packet N, the number of packet N and the mesh according to the sum of the target virtual machine
The total correlation for marking virtual machine, alternatively, the data for the image file that the distribution server is distributed as needed are big
Small determining number of packet N, the size of data correlation of the number of packet N and the image file, N is positive integer；
The distribution server according to the transmission rate between the number of packet N and the target virtual machine, to it is described extremely
Few two target virtual machines are grouped, and the transmission rate belonged between the target virtual machine in same group is greater than scheduled rate
Threshold value；
The distribution server selects a target virtual machine as the mesh in each destination virtual unit that grouping obtains
Mark the intermediate node of virtual robot arm；
The image file is distributed in each intermediate node by the distribution server from storage server；
The distribution server logs in each intermediate node by safety shell protocol, using Data Backup Tool by the mirror image
File is distributed in the target virtual machine with same group of the intermediate node from each intermediate node.
2. the method according to claim 1, wherein the distribution server is according to the total of the target virtual machine
Number determines number of packet N, comprising:
The distribution server determines the sum M of the target virtual machine；
The distribution server is according to formulaDetermine that the number of packet N, the ceil are the letter that rounds up
Number.
3. the method according to claim 1, wherein the distribution server is empty in each group target that grouping obtains
Select a target virtual machine as the intermediate node of the destination virtual unit in quasi- unit, comprising:
The distribution server for each destination virtual unit, obtain in the destination virtual unit each target virtual machine with
The highest target virtual machine of transmission rate is determined as the destination virtual unit by the transmission rate between the storage server
Intermediate node；
Or,
The distribution server obtains each target virtual machine in the destination virtual unit for each destination virtual unit
The highest target virtual machine of performance is determined as the intermediate node of the destination virtual unit by performance.
4. a kind of data delivery device, which is characterized in that be applied in the distribution server, described device includes:
Receiving module, for receiving the triggering command for carrying out data distribution at least two target virtual machines；
Grouping module, for being grouped at least two target virtual machine；
Selecting module, for selecting a target virtual machine in each destination virtual unit that the grouping module is grouped
Intermediate node as the destination virtual unit；
Distribution module, for image file to be distributed in each intermediate node from storage server；Pass through safety shell protocol
Each intermediate node is logged in, is distributed to the image file and the centre from each intermediate node using Data Backup Tool
In the target virtual machine that same group of node；
The grouping module includes:
First determination unit, for determining that number of packet N, N are positive integer；
Grouped element, for according to the transmission rate between the number of packet N and the target virtual machine, to it is described at least
Two target virtual machines are grouped, and the transmission rate belonged between the target virtual machine in same group is greater than scheduled rate threshold
Value；
Wherein, first determination unit, comprising:
First determine subelement, for according to the target virtual machine sum determine number of packet N, the number of packet N with
The total correlation of the target virtual machine；
Or,
Second determines subelement, for determining number of packet N, the number of packet N according to the size of data of the image file
With the size of data correlation of the image file.
5. device according to claim 4, which is characterized in that described first determines subelement, comprising:
Third determines subelement, for determining the sum M of the target virtual machine；
4th determines subelement, for according to formulaDetermine that the number of packet N, the ceil are to take upwards
Integral function.
6. device according to claim 4, which is characterized in that the selecting module, comprising:
Second determination unit, for obtaining each destination virtual in the destination virtual unit for each destination virtual unit
The highest target virtual machine of transmission rate is determined as the destination virtual by the transmission rate between machine and the storage server
The intermediate node of unit；
Or,
Third determination unit, for obtaining each destination virtual in the destination virtual unit for each destination virtual unit
The highest target virtual machine of performance is determined as the intermediate node of the destination virtual unit by the performance of machine.
7. a kind of computer readable storage medium, is stored thereon with program, which is characterized in that described program by processor execute with
Realize data distributing method as described in any one of claims 1-3.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201410648461.XA CN105656794B (en) | 2014-11-14 | 2014-11-14 | Data distributing method, device and computer readable storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201410648461.XA CN105656794B (en) | 2014-11-14 | 2014-11-14 | Data distributing method, device and computer readable storage medium |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN105656794A CN105656794A (en) | 2016-06-08 |
| CN105656794B true CN105656794B (en) | 2019-03-08 |
Family
ID=56480018
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201410648461.XA Active CN105656794B (en) | 2014-11-14 | 2014-11-14 | Data distributing method, device and computer readable storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN105656794B (en) |
Families Citing this family (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106997392B (en) * | 2017-04-10 | 2020-03-03 | 北京搜狐新媒体信息技术有限公司 | Processing method and device and reading method and device of Docker mirror image cache information |
| CN107888663A (en) * | 2017-10-26 | 2018-04-06 | 深圳市金立通信设备有限公司 | A kind of method of distribution of document, equipment and computer-readable medium |
| CN110086847B (en) * | 2019-03-12 | 2021-03-09 | 中国科学院计算技术研究所 | Data distribution method, medium and electronic device |
| CN111131062B (en) * | 2019-12-31 | 2023-09-05 | 深信服科技股份有限公司 | Grouping optimization method, terminal, device and storage medium |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1557085A (en) * | 2001-08-02 | 2004-12-22 | E-3�����������˾ | A terminal in a client-server network that acts as a relay server for distributing packets |
| CN1656749A (en) * | 2002-06-06 | 2005-08-17 | 国际商业机器公司 | Digital content distribution system, method, program, server, and client |
| CN101188815A (en) * | 2007-12-07 | 2008-05-28 | 深圳华为通信技术有限公司 | Transmission method, system, server and client for media stream data |
| CN104106062A (en) * | 2011-03-23 | 2014-10-15 | 邻客音公司 | Content sharing between multiple devices |
-
2014
- 2014-11-14 CN CN201410648461.XA patent/CN105656794B/en active Active
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1557085A (en) * | 2001-08-02 | 2004-12-22 | E-3�����������˾ | A terminal in a client-server network that acts as a relay server for distributing packets |
| CN1656749A (en) * | 2002-06-06 | 2005-08-17 | 国际商业机器公司 | Digital content distribution system, method, program, server, and client |
| CN101188815A (en) * | 2007-12-07 | 2008-05-28 | 深圳华为通信技术有限公司 | Transmission method, system, server and client for media stream data |
| CN104106062A (en) * | 2011-03-23 | 2014-10-15 | 邻客音公司 | Content sharing between multiple devices |
Also Published As
| Publication number | Publication date |
|---|---|
| CN105656794A (en) | 2016-06-08 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US12368682B2 (en) | Software load balancer to maximize utilization | |
| EP3989495B1 (en) | Burst traffic processing method, computer device and readable storage medium | |
| CN102611735B (en) | A kind of load-balancing method of application service and system | |
| JP2022501752A (en) | How to assign electronic bill identifiers, how to generate electronic bills, their devices and systems, as well as storage media and computer programs. | |
| CN103873505B (en) | Method, system and the device uploaded offline to cloud storage service device | |
| CN105264930B (en) | Sending node and its cache status reporting method | |
| CN110602156A (en) | Load balancing scheduling method and device | |
| CN109885410A (en) | Message sending method, device, computer equipment and storage medium | |
| CN105577801B (en) | A kind of business accelerating method and device | |
| CN106101232A (en) | Load-balancing method and device | |
| CN105656794B (en) | Data distributing method, device and computer readable storage medium | |
| CN106095572A (en) | The Dispatching System of a kind of big data process and method | |
| US11102322B2 (en) | Data processing method and apparatus, server, and controller | |
| US20150358402A1 (en) | Efficient and scalable pull-based load distribution | |
| CN110831039A (en) | Data transmission method and transmission server in multi-path concurrent system | |
| CN108933829A (en) | A kind of load-balancing method and device | |
| CN107404541A (en) | A kind of method and system of peer-to-peer network transmission neighbor node selection | |
| CN109150745A (en) | A kind of message processing method and device | |
| CN113268329A (en) | Request scheduling method, device and storage medium | |
| CN107659511B (en) | An overload control method, host and storage medium, and program product | |
| JP6888478B2 (en) | Sorting system | |
| CN103299298A (en) | Method and system for processing business | |
| CN111432357B (en) | Information processing method and system and computing equipment | |
| CN118041937A (en) | Data access method and device of storage device | |
| CN101277317A (en) | A data balance distribution method for a distributed processing system |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant | ||
| TR01 | Transfer of patent right | ||
| TR01 | Transfer of patent right |
Effective date of registration: 20190731 Address after: Shenzhen Futian District City, Guangdong province 518000 Zhenxing Road, SEG Science Park 2 East Room 403 Co-patentee after: Tencent cloud computing (Beijing) limited liability company Patentee after: Tencent Technology (Shenzhen) Co., Ltd. Address before: Shenzhen Futian District City, Guangdong province 518000 Zhenxing Road, SEG Science Park 2 East Room 403 Patentee before: Tencent Technology (Shenzhen) Co., Ltd. |