+

CN106790544A - Reduce the method and device of amount of communication data between Terminal Server Client and data center - Google Patents

Reduce the method and device of amount of communication data between Terminal Server Client and data center Download PDF

Info

Publication number
CN106790544A
CN106790544A CN201611201243.7A CN201611201243A CN106790544A CN 106790544 A CN106790544 A CN 106790544A CN 201611201243 A CN201611201243 A CN 201611201243A CN 106790544 A CN106790544 A CN 106790544A
Authority
CN
China
Prior art keywords
content
data center
terminal server
request
server client
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN201611201243.7A
Other languages
Chinese (zh)
Inventor
臧琦
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Zhengzhou Yunhai Information Technology Co Ltd
Original Assignee
Zhengzhou Yunhai Information Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Zhengzhou Yunhai Information Technology Co Ltd filed Critical Zhengzhou Yunhai Information Technology Co Ltd
Priority to CN201611201243.7A priority Critical patent/CN106790544A/en
Publication of CN106790544A publication Critical patent/CN106790544A/en
Pending legal-status Critical Current

Links

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00Network arrangements or protocols for supporting network services or applications
    • H04L67/50Network services
    • H04L67/54Presence management, e.g. monitoring or registration for receipt of user log-on information, or the connection status of the users
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00Network arrangements or protocols for supporting network services or applications
    • H04L67/01Protocols
    • H04L67/10Protocols in which an application is distributed across nodes in the network
    • H04L67/1097Protocols in which an application is distributed across nodes in the network for distributed storage of data in networks, e.g. transport arrangements for network file system [NFS], storage area networks [SAN] or network attached storage [NAS]
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00Network arrangements or protocols for supporting network services or applications
    • H04L67/50Network services
    • H04L67/535Tracking the activity of the user

Landscapes

  • Engineering & Computer Science (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Signal Processing (AREA)
  • Computer Hardware Design (AREA)
  • General Engineering & Computer Science (AREA)
  • Information Transfer Between Computers (AREA)
  • Computer And Data Communications (AREA)

Abstract

The invention discloses a kind of method for reducing amount of communication data between Terminal Server Client and data center, Terminal Server Client first is asked to data center server transmission content;Secondly data center server generates content information according to the content of request, and sends to Terminal Server Client, and whether Terminal Server Client judges the content of request in local memory device according to content information;The content of last Terminal Server Client read requests from local memory device.The invention also discloses a kind of device for reducing amount of communication data between Terminal Server Client and data center server, including:Content requests sending module, content information generation module, judge module, request content writing module and request content read module.When the present invention solves multiple Terminal Server Clients and obtains identical content, network broadband occupancy between Terminal Server Client and data center server problem high.

Description

减少远程客户端与数据中心间通信数据量的方法及装置Method and device for reducing communication data volume between remote client and data center

技术领域technical field

本发明涉及分布式存储技术领域,特别是涉及一种减少远程客户端与数据中心间通信数据量的方法及装置。The invention relates to the technical field of distributed storage, in particular to a method and a device for reducing the amount of communication data between a remote client and a data center.

背景技术Background technique

随着异地办公的模式越来越多,形成了一个总部和多个分支机构的局面。为了提高办公效率,会在总部建立数据中心,多个分支机构共享这些数据。当分支机构中的远程客户端获取数据时,需要通过公用或者专用的网络连接到数据中心服务器,然后发出请求,数据中心服务器会把所需的数据传输到远程客户端。分支机构中的每个远程客户端获取相同的数据时,都需要重复这些过程,如果多个远程客户端同时获取相同的数据,数据中心服务器需要传输多份相同的数据。这样会造成分支机构和数据中心之间的网络带宽占用率很高,同时增加了数据中心服务器的数据处理压力,严重时会造成数据中心网络瘫痪,影响其他业务的正常进行。With more and more remote office models, a situation of one headquarters and multiple branches has formed. In order to improve office efficiency, a data center will be established at the headquarters, and multiple branches will share the data. When a remote client in a branch obtains data, it needs to connect to the data center server through a public or private network, and then send a request, and the data center server will transmit the required data to the remote client. When each remote client in the branch office obtains the same data, these processes need to be repeated. If multiple remote clients obtain the same data at the same time, the data center server needs to transmit multiple copies of the same data. This will cause a high network bandwidth occupancy rate between the branch office and the data center, and increase the data processing pressure of the data center server. In severe cases, the data center network will be paralyzed, affecting the normal operation of other businesses.

发明内容Contents of the invention

本发明目的是提供一种减少远程客户端与数据中心间通信数据量的方法及装置,解决了多个远程客户端获取相同的内容时,远程客户端和数据中心服务器之间的网络宽带占用率高的问题。The purpose of the present invention is to provide a method and device for reducing the amount of communication data between a remote client and a data center, which solves the problem of network broadband occupancy between the remote client and the data center server when multiple remote clients acquire the same content high question.

为了解决上述问题,本发明采用以下的技术方案:In order to solve the above problems, the present invention adopts the following technical solutions:

一种减少远程客户端与数据中心间通信数据量的方法,包括以下步骤:A method for reducing the amount of communication data between a remote client and a data center, comprising the steps of:

A.远程客户端向数据中心服务器发送内容请求;A. The remote client sends a content request to the data center server;

B.数据中心服务器根据请求的内容生成内容信息,并发送至远程客户端;B. The data center server generates content information according to the requested content and sends it to the remote client;

C.远程客户端根据内容信息判断请求的内容是否在本地存储设备中;如果是,则转步骤D;如果否,则转步骤E;C. The remote client judges whether the requested content is in the local storage device according to the content information; if yes, then go to step D; if not, then go to step E;

D.远程客户端从本地存储设备中读取请求的内容;D. The remote client reads the requested content from the local storage device;

E.数据中心服务器将请求的内容写入本地存储设备。E. The data center server writes the requested content to the local storage device.

优选地,所述内容信息包括利用哈希算法计算获得的匹配所请求内容的哈希值。Preferably, the content information includes a hash value that matches the requested content and is calculated using a hash algorithm.

优选地,所述本地存储设备包括服务器和/或客户端计算机。Preferably, the local storage device includes a server and/or a client computer.

本发明还提供一种减少远程客户端与数据中心间通信数据量的装置,包括:The present invention also provides a device for reducing the amount of communication data between the remote client and the data center, including:

内容请求发送模块,用于远程客户端向数据中心服务器发送内容请求;The content request sending module is used for the remote client to send the content request to the data center server;

内容信息生成模块,用于数据中心服务器根据请求的内容生成内容信息,并发送至远程客户端;The content information generation module is used for the data center server to generate content information according to the requested content and send it to the remote client;

判断模块,用于远程客户端根据内容信息判断请求的内容是否在本地存储设备中;A judging module, used for the remote client to judge whether the requested content is in the local storage device according to the content information;

请求内容写入模块,用于数据中心服务器将请求的内容写入本地存储设备;The request content writing module is used for the data center server to write the requested content into the local storage device;

请求内容读取模块,用于远程客户端从本地存储设备中读取请求的内容。The request content reading module is used for the remote client to read the requested content from the local storage device.

优选地,所述内容信息包括利用哈希算法计算获得的匹配所请求内容的哈希值。Preferably, the content information includes a hash value that matches the requested content and is calculated using a hash algorithm.

与现有技术相比,本发明具有以下优点:Compared with the prior art, the present invention has the following advantages:

1.本发明分支机构的远程客户端向数据中心服务器发送内容请求,数据中心服务器根据请求的内容生成内容信息,并发送至远程客户端,远程客户端根据内容信息判断请求的内容是否在本地存储设备中,进而对本地存储设备进行读写操作。本发明数据中心服务器将请求的内容写入到本地存储设备中,使远程客户端可以从所属分支机构访问内容,而不是向数据中心请求访问,从而减少数据重复传输,降低对专用网络的带宽占用率,优化带宽,提高数据传输效率,减少延时。1. The remote client of the branch of the present invention sends a content request to the data center server, the data center server generates content information according to the requested content, and sends it to the remote client, and the remote client judges whether the requested content is stored locally according to the content information device, and then perform read and write operations on the local storage device. The data center server of the present invention writes the requested content into the local storage device, so that the remote client can access the content from the affiliated branch instead of requesting access from the data center, thereby reducing repeated data transmission and bandwidth occupation of the dedicated network rate, optimize bandwidth, improve data transmission efficiency, and reduce delay.

2.本发明通过改善远程客户端向数据中心服务器获取内容的查询响应时间,提高用户的工作效率,减少远程客户端与数据中心服务器间的数据流量,提升网络性能。2. The present invention improves the user's work efficiency, reduces the data flow between the remote client and the data center server, and improves network performance by improving the query response time for the remote client to obtain content from the data center server.

附图说明Description of drawings

图1是本发明一种减少远程客户端与数据中心间通信数据量的装置的结构示意图;Fig. 1 is a schematic structural diagram of a device for reducing the amount of communication data between a remote client and a data center according to the present invention;

图2是本发明一种减少远程客户端与数据中心间通信数据量的方法的流程示意图。Fig. 2 is a schematic flowchart of a method for reducing the amount of communication data between a remote client and a data center according to the present invention.

具体实施方式detailed description

下面结合附图和实施例,对本发明的具体实施方式作进一步详细描述:Below in conjunction with accompanying drawing and embodiment, the specific embodiment of the present invention is described in further detail:

实施例一:本发明一种减少远程客户端与数据中心间通信数据量的装置如图1所示,包括内容请求发送模块11、内容信息生成模块12、判断模块13、请求内容写入模块14和请求内容读取模块15。其中内容请求发送模块11依次顺序与内容信息生成模块12、判断模块13和请求内容读取模块15连接,请求内容写入模块14与请求内容读取模块15并联。Embodiment 1: a device of the present invention that reduces the amount of communication data between a remote client and a data center is shown in FIG. And request content reading module 15. The content request sending module 11 is sequentially connected with the content information generating module 12 , the judging module 13 and the request content reading module 15 , and the request content writing module 14 is connected in parallel with the request content reading module 15 .

内容请求发送模块11用于远程客户端向数据中心服务器发送内容请求,数据中心服务器接收发来的内容请求;内容信息生成模块12用于数据中心服务器根据请求的内容生成内容信息,并发送至远程客户端;判断模块13用于远程客户端根据内容信息判断请求的内容是否在本地存储设备中;请求内容写入模块14用于数据中心服务器将请求的内容写入本地存储设备;请求内容读取模块15用于远程客户端从本地存储设备中读取请求的内容。The content request sending module 11 is used for the remote client to send a content request to the data center server, and the data center server receives the sent content request; the content information generation module 12 is used for the data center server to generate content information according to the requested content, and send it to the remote Client; judging module 13 is used for remote client to judge whether the content of request is in local storage device according to content information; Request content writing module 14 is used for data center server to write the content of request into local storage device; Request content read Module 15 is used for the remote client to read the requested content from the local storage device.

实施例二:本发明一种减少远程客户端与数据中心间通信数据量的方法如图2所示,包括以下步骤:Embodiment 2: A method of reducing the amount of communication data between a remote client and a data center in the present invention is shown in FIG. 2 , comprising the following steps:

步骤S201,分支机构中的一台或者多台远程客户端向数据中心服务器发送内容请求。In step S201, one or more remote clients in the branch office send a content request to the data center server.

步骤S202,数据中心服务器接收内容请求,根据请求的内容生成相应的内容信息,并发送至远程客户端。Step S202, the data center server receives the content request, generates corresponding content information according to the requested content, and sends it to the remote client.

内容信息包括使用全部原始内容利用哈希算法计算获得的匹配所请求内容的哈希值,并且哈希值与原始内容相比极小。本实例中哈希算法优选采用消息摘要算法第五版MD5(Message-Digest Algorithm 5)。The content information includes a hash value that matches the requested content and is calculated using a hash algorithm using all original content, and the hash value is extremely small compared with the original content. In this example, the hash algorithm preferably adopts the fifth edition of MD5 (Message-Digest Algorithm 5).

步骤S203,远程客户端根据内容信息判断请求的内容是否在本地存储设备中,如果是,则转步骤S205;如果否,则转步骤S204。Step S203, the remote client judges whether the requested content is in the local storage device according to the content information, if yes, go to step S205; if not, go to step S204.

步骤S204,数据中心服务器将请求的内容写入本地存储设备,所述本地存储设备包括分支机构的服务器和/或客户端计算机。Step S204, the data center server writes the requested content into a local storage device, and the local storage device includes a server and/or a client computer of a branch office.

步骤S205,远程客户端从本地存储设备中读取请求的内容。Step S205, the remote client reads the requested content from the local storage device.

本发明克服了同一分支机构中多个远程客户端获取相同的内容时,远程客户端和数据中心服务器之间的网络宽带占用率高的缺陷。为了优化远程客户端访问数据中心服务器内容时的带宽,远程客户端可以从所属分支机构的本地存储设备访问内容,而不用向数据中心请求访问,避免了远程客户端获取相同的内容时,远程客户端和数据中心服务器之间进行内容的重复传输,降低对专用网络的带宽占用率,优化带宽,提高数据传输效率和内容查询响应时间。The invention overcomes the defect that the network broadband occupancy rate between the remote clients and the data center server is high when multiple remote clients in the same branch obtain the same content. In order to optimize the bandwidth when the remote client accesses the content of the server in the data center, the remote client can access the content from the local storage device of the branch office without requesting access from the data center, which avoids the remote client getting the same content. Repeated transmission of content between the terminal and the data center server, reducing the bandwidth occupancy rate of the private network, optimizing bandwidth, improving data transmission efficiency and content query response time.

以上所示仅是本发明的优选实施方式,应当指出,对于本技术领域的普通技术人员来说,在不脱离本发明原理的前提下,还可以做出若干改进和润饰,这些改进和润饰也应视为本发明的保护范围。What is shown above is only a preferred embodiment of the present invention. It should be pointed out that for those of ordinary skill in the art, some improvements and modifications can also be made without departing from the principles of the present invention. It should be regarded as the protection scope of the present invention.

Claims (5)

1. a kind of method for reducing amount of communication data between Terminal Server Client and data center, it is characterised in that comprise the following steps:
A. Terminal Server Client is asked to data center server transmission content;
B. data center server generates content information according to the content of request, and sends to Terminal Server Client;
C. whether Terminal Server Client judges the content of request in local memory device according to content information;If it is, turning step Rapid D;If it is not, then going to step E;
D. the content of Terminal Server Client read requests from local memory device;
E. the content that data center server will be asked writes local memory device.
2. the method for reducing amount of communication data between Terminal Server Client and data center according to claim 1, its feature exists In the content information calculates the cryptographic Hash of the matching institute request content for obtaining using hash algorithm.
3. the method for reducing amount of communication data between Terminal Server Client and data center server according to claim 1, its It is characterised by, the local memory device includes server and/or client computer.
4. a kind of device for reducing amount of communication data between Terminal Server Client and data center, it is characterised in that including:
Content requests sending module, asks for Terminal Server Client to data center server transmission content;
Content information generation module, generates content information, and send to remote for data center server according to the content of request Journey client;
Whether judge module, judge the content of request in local memory device for Terminal Server Client according to content information;
Request content writing module, the content that will be asked for data center server writes local memory device;
Request content read module, for the content of Terminal Server Client read requests from local memory device.
5. the device for reducing amount of communication data between Terminal Server Client and data center according to claim 4, its feature exists In the content information calculates the cryptographic Hash of the matching institute request content for obtaining using hash algorithm.
CN201611201243.7A 2016-12-22 2016-12-22 Reduce the method and device of amount of communication data between Terminal Server Client and data center Pending CN106790544A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201611201243.7A CN106790544A (en) 2016-12-22 2016-12-22 Reduce the method and device of amount of communication data between Terminal Server Client and data center

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201611201243.7A CN106790544A (en) 2016-12-22 2016-12-22 Reduce the method and device of amount of communication data between Terminal Server Client and data center

Publications (1)

Publication Number Publication Date
CN106790544A true CN106790544A (en) 2017-05-31

Family

ID=58899775

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201611201243.7A Pending CN106790544A (en) 2016-12-22 2016-12-22 Reduce the method and device of amount of communication data between Terminal Server Client and data center

Country Status (1)

Country Link
CN (1) CN106790544A (en)

Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2003038653A1 (en) * 2001-11-01 2003-05-08 Verisign, Inc. Method and system for validating remote database
CN101741731A (en) * 2009-12-03 2010-06-16 中兴通讯股份有限公司 Content metadata storing, inquiring method and managing system in content delivery network (CDN)
CN102045403A (en) * 2010-12-29 2011-05-04 成都市华为赛门铁克科技有限公司 Method, device and system for processing data of distributed network
CN102184177A (en) * 2011-01-04 2011-09-14 北京开心人信息技术有限公司 Method and system for previewing file
CN102387201A (en) * 2011-10-20 2012-03-21 华为技术有限公司 Method, device and system for processing service data
CN102555945A (en) * 2010-12-30 2012-07-11 上海博泰悦臻电子设备制造有限公司 Multi-mode switching method and system for vehicle-mounted terminal
CN105162720A (en) * 2015-10-22 2015-12-16 上海新储集成电路有限公司 Data transmission reducing communication network and method

Patent Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2003038653A1 (en) * 2001-11-01 2003-05-08 Verisign, Inc. Method and system for validating remote database
CN101741731A (en) * 2009-12-03 2010-06-16 中兴通讯股份有限公司 Content metadata storing, inquiring method and managing system in content delivery network (CDN)
CN102045403A (en) * 2010-12-29 2011-05-04 成都市华为赛门铁克科技有限公司 Method, device and system for processing data of distributed network
CN102555945A (en) * 2010-12-30 2012-07-11 上海博泰悦臻电子设备制造有限公司 Multi-mode switching method and system for vehicle-mounted terminal
CN102184177A (en) * 2011-01-04 2011-09-14 北京开心人信息技术有限公司 Method and system for previewing file
CN102387201A (en) * 2011-10-20 2012-03-21 华为技术有限公司 Method, device and system for processing service data
CN105162720A (en) * 2015-10-22 2015-12-16 上海新储集成电路有限公司 Data transmission reducing communication network and method

Similar Documents

Publication Publication Date Title
US12099721B2 (en) Methods to configure and access scalable object stores using KV-SSDs and hybrid backend storage tiers of KV-SSDs, NVMe-SSDs and other flash devices
WO2021036228A1 (en) File upload method and apparatus, terminal, server, system, and storage medium
US10976932B2 (en) Method for providing a client device access to a plurality of remote storage devices
CN104063344B (en) A kind of method and network interface card for storing data
CN104040521B (en) Biological characteristic cloud communication and data move
US20210158352A1 (en) Methods and systems for recording data based on plurality of blockchain networks
WO2017067117A1 (en) Data query method and device
US11050550B2 (en) Methods and systems for reading data based on plurality of blockchain networks
US11500861B2 (en) Methods and systems for recording data based on plurality of blockchain networks
CN105554143A (en) High-availability cache server and data processing method and system thereof
CN108462885A (en) A kind of video storage method, device and medium based on block chain
CN106446097A (en) File reading method and system
CN114285838A (en) A file uploading method, device, system, storage medium and electronic device
WO2016029744A1 (en) Metadata recovery method and relevant device
CN108011857A (en) Data dynamic encryption transmission configuration method and apparatus
CN115470156A (en) RDMA-based memory use method, system, electronic device and storage medium
CN107636655A (en) System and method for providing data as a service (DaaS) in real time
CN110851477A (en) Stream data processing method, stream data processing device, computer equipment and storage medium
CN103118019B (en) A kind of file network clone method based on duplicate removal
CN107395772B (en) Management method and management system for repeated data
CN118555305A (en) Message transmission method, device, equipment, storage medium and program product
CN111782614A (en) Data access method, device, device and storage medium
CN106790544A (en) Reduce the method and device of amount of communication data between Terminal Server Client and data center
CN108062277B (en) Electronic credential data access method, device and system
US20210157787A1 (en) Methods and systems for reading data based on plurality of blockchain networks

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
RJ01 Rejection of invention patent application after publication

Application publication date: 20170531

RJ01 Rejection of invention patent application after publication
点击 这是indexloc提供的php浏览器服务,不要输入任何密码和下载