CN106790544A - Reduce the method and device of amount of communication data between Terminal Server Client and data center - Google Patents
Reduce the method and device of amount of communication data between Terminal Server Client and data center Download PDFInfo
- Publication number
- CN106790544A CN106790544A CN201611201243.7A CN201611201243A CN106790544A CN 106790544 A CN106790544 A CN 106790544A CN 201611201243 A CN201611201243 A CN 201611201243A CN 106790544 A CN106790544 A CN 106790544A
- Authority
- CN
- China
- Prior art keywords
- content
- data center
- terminal server
- request
- server client
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000004891 communication Methods 0.000 title claims abstract description 16
- 238000000034 method Methods 0.000 title claims abstract description 12
- 230000005540 biological transmission Effects 0.000 claims abstract description 7
- 230000004044 response Effects 0.000 description 2
- 206010033799 Paralysis Diseases 0.000 description 1
- 230000007547 defect Effects 0.000 description 1
- 238000010586 diagram Methods 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 230000008569 process Effects 0.000 description 1
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/50—Network services
- H04L67/54—Presence management, e.g. monitoring or registration for receipt of user log-on information, or the connection status of the users
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/01—Protocols
- H04L67/10—Protocols in which an application is distributed across nodes in the network
- H04L67/1097—Protocols in which an application is distributed across nodes in the network for distributed storage of data in networks, e.g. transport arrangements for network file system [NFS], storage area networks [SAN] or network attached storage [NAS]
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/50—Network services
- H04L67/535—Tracking the activity of the user
Landscapes
- Engineering & Computer Science (AREA)
- Computer Networks & Wireless Communication (AREA)
- Signal Processing (AREA)
- Computer Hardware Design (AREA)
- General Engineering & Computer Science (AREA)
- Information Transfer Between Computers (AREA)
- Computer And Data Communications (AREA)
Abstract
Description
技术领域technical field
本发明涉及分布式存储技术领域,特别是涉及一种减少远程客户端与数据中心间通信数据量的方法及装置。The invention relates to the technical field of distributed storage, in particular to a method and a device for reducing the amount of communication data between a remote client and a data center.
背景技术Background technique
随着异地办公的模式越来越多,形成了一个总部和多个分支机构的局面。为了提高办公效率,会在总部建立数据中心,多个分支机构共享这些数据。当分支机构中的远程客户端获取数据时,需要通过公用或者专用的网络连接到数据中心服务器,然后发出请求,数据中心服务器会把所需的数据传输到远程客户端。分支机构中的每个远程客户端获取相同的数据时,都需要重复这些过程,如果多个远程客户端同时获取相同的数据,数据中心服务器需要传输多份相同的数据。这样会造成分支机构和数据中心之间的网络带宽占用率很高,同时增加了数据中心服务器的数据处理压力,严重时会造成数据中心网络瘫痪,影响其他业务的正常进行。With more and more remote office models, a situation of one headquarters and multiple branches has formed. In order to improve office efficiency, a data center will be established at the headquarters, and multiple branches will share the data. When a remote client in a branch obtains data, it needs to connect to the data center server through a public or private network, and then send a request, and the data center server will transmit the required data to the remote client. When each remote client in the branch office obtains the same data, these processes need to be repeated. If multiple remote clients obtain the same data at the same time, the data center server needs to transmit multiple copies of the same data. This will cause a high network bandwidth occupancy rate between the branch office and the data center, and increase the data processing pressure of the data center server. In severe cases, the data center network will be paralyzed, affecting the normal operation of other businesses.
发明内容Contents of the invention
本发明目的是提供一种减少远程客户端与数据中心间通信数据量的方法及装置,解决了多个远程客户端获取相同的内容时,远程客户端和数据中心服务器之间的网络宽带占用率高的问题。The purpose of the present invention is to provide a method and device for reducing the amount of communication data between a remote client and a data center, which solves the problem of network broadband occupancy between the remote client and the data center server when multiple remote clients acquire the same content high question.
为了解决上述问题,本发明采用以下的技术方案:In order to solve the above problems, the present invention adopts the following technical solutions:
一种减少远程客户端与数据中心间通信数据量的方法,包括以下步骤:A method for reducing the amount of communication data between a remote client and a data center, comprising the steps of:
A.远程客户端向数据中心服务器发送内容请求;A. The remote client sends a content request to the data center server;
B.数据中心服务器根据请求的内容生成内容信息,并发送至远程客户端;B. The data center server generates content information according to the requested content and sends it to the remote client;
C.远程客户端根据内容信息判断请求的内容是否在本地存储设备中;如果是,则转步骤D;如果否,则转步骤E;C. The remote client judges whether the requested content is in the local storage device according to the content information; if yes, then go to step D; if not, then go to step E;
D.远程客户端从本地存储设备中读取请求的内容;D. The remote client reads the requested content from the local storage device;
E.数据中心服务器将请求的内容写入本地存储设备。E. The data center server writes the requested content to the local storage device.
优选地,所述内容信息包括利用哈希算法计算获得的匹配所请求内容的哈希值。Preferably, the content information includes a hash value that matches the requested content and is calculated using a hash algorithm.
优选地,所述本地存储设备包括服务器和/或客户端计算机。Preferably, the local storage device includes a server and/or a client computer.
本发明还提供一种减少远程客户端与数据中心间通信数据量的装置,包括:The present invention also provides a device for reducing the amount of communication data between the remote client and the data center, including:
内容请求发送模块,用于远程客户端向数据中心服务器发送内容请求;The content request sending module is used for the remote client to send the content request to the data center server;
内容信息生成模块,用于数据中心服务器根据请求的内容生成内容信息,并发送至远程客户端;The content information generation module is used for the data center server to generate content information according to the requested content and send it to the remote client;
判断模块,用于远程客户端根据内容信息判断请求的内容是否在本地存储设备中;A judging module, used for the remote client to judge whether the requested content is in the local storage device according to the content information;
请求内容写入模块,用于数据中心服务器将请求的内容写入本地存储设备;The request content writing module is used for the data center server to write the requested content into the local storage device;
请求内容读取模块,用于远程客户端从本地存储设备中读取请求的内容。The request content reading module is used for the remote client to read the requested content from the local storage device.
优选地,所述内容信息包括利用哈希算法计算获得的匹配所请求内容的哈希值。Preferably, the content information includes a hash value that matches the requested content and is calculated using a hash algorithm.
与现有技术相比,本发明具有以下优点:Compared with the prior art, the present invention has the following advantages:
1.本发明分支机构的远程客户端向数据中心服务器发送内容请求,数据中心服务器根据请求的内容生成内容信息,并发送至远程客户端,远程客户端根据内容信息判断请求的内容是否在本地存储设备中,进而对本地存储设备进行读写操作。本发明数据中心服务器将请求的内容写入到本地存储设备中,使远程客户端可以从所属分支机构访问内容,而不是向数据中心请求访问,从而减少数据重复传输,降低对专用网络的带宽占用率,优化带宽,提高数据传输效率,减少延时。1. The remote client of the branch of the present invention sends a content request to the data center server, the data center server generates content information according to the requested content, and sends it to the remote client, and the remote client judges whether the requested content is stored locally according to the content information device, and then perform read and write operations on the local storage device. The data center server of the present invention writes the requested content into the local storage device, so that the remote client can access the content from the affiliated branch instead of requesting access from the data center, thereby reducing repeated data transmission and bandwidth occupation of the dedicated network rate, optimize bandwidth, improve data transmission efficiency, and reduce delay.
2.本发明通过改善远程客户端向数据中心服务器获取内容的查询响应时间,提高用户的工作效率,减少远程客户端与数据中心服务器间的数据流量,提升网络性能。2. The present invention improves the user's work efficiency, reduces the data flow between the remote client and the data center server, and improves network performance by improving the query response time for the remote client to obtain content from the data center server.
附图说明Description of drawings
图1是本发明一种减少远程客户端与数据中心间通信数据量的装置的结构示意图;Fig. 1 is a schematic structural diagram of a device for reducing the amount of communication data between a remote client and a data center according to the present invention;
图2是本发明一种减少远程客户端与数据中心间通信数据量的方法的流程示意图。Fig. 2 is a schematic flowchart of a method for reducing the amount of communication data between a remote client and a data center according to the present invention.
具体实施方式detailed description
下面结合附图和实施例,对本发明的具体实施方式作进一步详细描述:Below in conjunction with accompanying drawing and embodiment, the specific embodiment of the present invention is described in further detail:
实施例一:本发明一种减少远程客户端与数据中心间通信数据量的装置如图1所示,包括内容请求发送模块11、内容信息生成模块12、判断模块13、请求内容写入模块14和请求内容读取模块15。其中内容请求发送模块11依次顺序与内容信息生成模块12、判断模块13和请求内容读取模块15连接,请求内容写入模块14与请求内容读取模块15并联。Embodiment 1: a device of the present invention that reduces the amount of communication data between a remote client and a data center is shown in FIG. And request content reading module 15. The content request sending module 11 is sequentially connected with the content information generating module 12 , the judging module 13 and the request content reading module 15 , and the request content writing module 14 is connected in parallel with the request content reading module 15 .
内容请求发送模块11用于远程客户端向数据中心服务器发送内容请求,数据中心服务器接收发来的内容请求;内容信息生成模块12用于数据中心服务器根据请求的内容生成内容信息,并发送至远程客户端;判断模块13用于远程客户端根据内容信息判断请求的内容是否在本地存储设备中;请求内容写入模块14用于数据中心服务器将请求的内容写入本地存储设备;请求内容读取模块15用于远程客户端从本地存储设备中读取请求的内容。The content request sending module 11 is used for the remote client to send a content request to the data center server, and the data center server receives the sent content request; the content information generation module 12 is used for the data center server to generate content information according to the requested content, and send it to the remote Client; judging module 13 is used for remote client to judge whether the content of request is in local storage device according to content information; Request content writing module 14 is used for data center server to write the content of request into local storage device; Request content read Module 15 is used for the remote client to read the requested content from the local storage device.
实施例二:本发明一种减少远程客户端与数据中心间通信数据量的方法如图2所示,包括以下步骤:Embodiment 2: A method of reducing the amount of communication data between a remote client and a data center in the present invention is shown in FIG. 2 , comprising the following steps:
步骤S201,分支机构中的一台或者多台远程客户端向数据中心服务器发送内容请求。In step S201, one or more remote clients in the branch office send a content request to the data center server.
步骤S202,数据中心服务器接收内容请求,根据请求的内容生成相应的内容信息,并发送至远程客户端。Step S202, the data center server receives the content request, generates corresponding content information according to the requested content, and sends it to the remote client.
内容信息包括使用全部原始内容利用哈希算法计算获得的匹配所请求内容的哈希值,并且哈希值与原始内容相比极小。本实例中哈希算法优选采用消息摘要算法第五版MD5(Message-Digest Algorithm 5)。The content information includes a hash value that matches the requested content and is calculated using a hash algorithm using all original content, and the hash value is extremely small compared with the original content. In this example, the hash algorithm preferably adopts the fifth edition of MD5 (Message-Digest Algorithm 5).
步骤S203,远程客户端根据内容信息判断请求的内容是否在本地存储设备中,如果是,则转步骤S205;如果否,则转步骤S204。Step S203, the remote client judges whether the requested content is in the local storage device according to the content information, if yes, go to step S205; if not, go to step S204.
步骤S204,数据中心服务器将请求的内容写入本地存储设备,所述本地存储设备包括分支机构的服务器和/或客户端计算机。Step S204, the data center server writes the requested content into a local storage device, and the local storage device includes a server and/or a client computer of a branch office.
步骤S205,远程客户端从本地存储设备中读取请求的内容。Step S205, the remote client reads the requested content from the local storage device.
本发明克服了同一分支机构中多个远程客户端获取相同的内容时,远程客户端和数据中心服务器之间的网络宽带占用率高的缺陷。为了优化远程客户端访问数据中心服务器内容时的带宽,远程客户端可以从所属分支机构的本地存储设备访问内容,而不用向数据中心请求访问,避免了远程客户端获取相同的内容时,远程客户端和数据中心服务器之间进行内容的重复传输,降低对专用网络的带宽占用率,优化带宽,提高数据传输效率和内容查询响应时间。The invention overcomes the defect that the network broadband occupancy rate between the remote clients and the data center server is high when multiple remote clients in the same branch obtain the same content. In order to optimize the bandwidth when the remote client accesses the content of the server in the data center, the remote client can access the content from the local storage device of the branch office without requesting access from the data center, which avoids the remote client getting the same content. Repeated transmission of content between the terminal and the data center server, reducing the bandwidth occupancy rate of the private network, optimizing bandwidth, improving data transmission efficiency and content query response time.
以上所示仅是本发明的优选实施方式,应当指出,对于本技术领域的普通技术人员来说,在不脱离本发明原理的前提下,还可以做出若干改进和润饰,这些改进和润饰也应视为本发明的保护范围。What is shown above is only a preferred embodiment of the present invention. It should be pointed out that for those of ordinary skill in the art, some improvements and modifications can also be made without departing from the principles of the present invention. It should be regarded as the protection scope of the present invention.
Claims (5)
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201611201243.7A CN106790544A (en) | 2016-12-22 | 2016-12-22 | Reduce the method and device of amount of communication data between Terminal Server Client and data center |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201611201243.7A CN106790544A (en) | 2016-12-22 | 2016-12-22 | Reduce the method and device of amount of communication data between Terminal Server Client and data center |
Publications (1)
Publication Number | Publication Date |
---|---|
CN106790544A true CN106790544A (en) | 2017-05-31 |
Family
ID=58899775
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CN201611201243.7A Pending CN106790544A (en) | 2016-12-22 | 2016-12-22 | Reduce the method and device of amount of communication data between Terminal Server Client and data center |
Country Status (1)
Country | Link |
---|---|
CN (1) | CN106790544A (en) |
Citations (7)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
WO2003038653A1 (en) * | 2001-11-01 | 2003-05-08 | Verisign, Inc. | Method and system for validating remote database |
CN101741731A (en) * | 2009-12-03 | 2010-06-16 | 中兴通讯股份有限公司 | Content metadata storing, inquiring method and managing system in content delivery network (CDN) |
CN102045403A (en) * | 2010-12-29 | 2011-05-04 | 成都市华为赛门铁克科技有限公司 | Method, device and system for processing data of distributed network |
CN102184177A (en) * | 2011-01-04 | 2011-09-14 | 北京开心人信息技术有限公司 | Method and system for previewing file |
CN102387201A (en) * | 2011-10-20 | 2012-03-21 | 华为技术有限公司 | Method, device and system for processing service data |
CN102555945A (en) * | 2010-12-30 | 2012-07-11 | 上海博泰悦臻电子设备制造有限公司 | Multi-mode switching method and system for vehicle-mounted terminal |
CN105162720A (en) * | 2015-10-22 | 2015-12-16 | 上海新储集成电路有限公司 | Data transmission reducing communication network and method |
-
2016
- 2016-12-22 CN CN201611201243.7A patent/CN106790544A/en active Pending
Patent Citations (7)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
WO2003038653A1 (en) * | 2001-11-01 | 2003-05-08 | Verisign, Inc. | Method and system for validating remote database |
CN101741731A (en) * | 2009-12-03 | 2010-06-16 | 中兴通讯股份有限公司 | Content metadata storing, inquiring method and managing system in content delivery network (CDN) |
CN102045403A (en) * | 2010-12-29 | 2011-05-04 | 成都市华为赛门铁克科技有限公司 | Method, device and system for processing data of distributed network |
CN102555945A (en) * | 2010-12-30 | 2012-07-11 | 上海博泰悦臻电子设备制造有限公司 | Multi-mode switching method and system for vehicle-mounted terminal |
CN102184177A (en) * | 2011-01-04 | 2011-09-14 | 北京开心人信息技术有限公司 | Method and system for previewing file |
CN102387201A (en) * | 2011-10-20 | 2012-03-21 | 华为技术有限公司 | Method, device and system for processing service data |
CN105162720A (en) * | 2015-10-22 | 2015-12-16 | 上海新储集成电路有限公司 | Data transmission reducing communication network and method |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US12099721B2 (en) | Methods to configure and access scalable object stores using KV-SSDs and hybrid backend storage tiers of KV-SSDs, NVMe-SSDs and other flash devices | |
WO2021036228A1 (en) | File upload method and apparatus, terminal, server, system, and storage medium | |
US10976932B2 (en) | Method for providing a client device access to a plurality of remote storage devices | |
CN104063344B (en) | A kind of method and network interface card for storing data | |
CN104040521B (en) | Biological characteristic cloud communication and data move | |
US20210158352A1 (en) | Methods and systems for recording data based on plurality of blockchain networks | |
WO2017067117A1 (en) | Data query method and device | |
US11050550B2 (en) | Methods and systems for reading data based on plurality of blockchain networks | |
US11500861B2 (en) | Methods and systems for recording data based on plurality of blockchain networks | |
CN105554143A (en) | High-availability cache server and data processing method and system thereof | |
CN108462885A (en) | A kind of video storage method, device and medium based on block chain | |
CN106446097A (en) | File reading method and system | |
CN114285838A (en) | A file uploading method, device, system, storage medium and electronic device | |
WO2016029744A1 (en) | Metadata recovery method and relevant device | |
CN108011857A (en) | Data dynamic encryption transmission configuration method and apparatus | |
CN115470156A (en) | RDMA-based memory use method, system, electronic device and storage medium | |
CN107636655A (en) | System and method for providing data as a service (DaaS) in real time | |
CN110851477A (en) | Stream data processing method, stream data processing device, computer equipment and storage medium | |
CN103118019B (en) | A kind of file network clone method based on duplicate removal | |
CN107395772B (en) | Management method and management system for repeated data | |
CN118555305A (en) | Message transmission method, device, equipment, storage medium and program product | |
CN111782614A (en) | Data access method, device, device and storage medium | |
CN106790544A (en) | Reduce the method and device of amount of communication data between Terminal Server Client and data center | |
CN108062277B (en) | Electronic credential data access method, device and system | |
US20210157787A1 (en) | Methods and systems for reading data based on plurality of blockchain networks |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
PB01 | Publication | ||
PB01 | Publication | ||
SE01 | Entry into force of request for substantive examination | ||
SE01 | Entry into force of request for substantive examination | ||
RJ01 | Rejection of invention patent application after publication |
Application publication date: 20170531 |
|
RJ01 | Rejection of invention patent application after publication |