+

WO2002037799A3 - Load balancing method and system - Google Patents

Load balancing method and system Download PDF

Info

Publication number
WO2002037799A3
WO2002037799A3 PCT/US2001/047013 US0147013W WO0237799A3 WO 2002037799 A3 WO2002037799 A3 WO 2002037799A3 US 0147013 W US0147013 W US 0147013W WO 0237799 A3 WO0237799 A3 WO 0237799A3
Authority
WO
WIPO (PCT)
Prior art keywords
performance
servers
dispatcher
concurrently
control
Prior art date
Application number
PCT/US2001/047013
Other languages
French (fr)
Other versions
WO2002037799A2 (en
Inventor
Steve Goddard
Original Assignee
Univ Nebraska
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Priority claimed from US09/878,787 external-priority patent/US20030046394A1/en
Priority claimed from US09/965,526 external-priority patent/US20020055982A1/en
Application filed by Univ Nebraska filed Critical Univ Nebraska
Priority to EP01989983A priority Critical patent/EP1332600A2/en
Priority to AU2002228861A priority patent/AU2002228861A1/en
Publication of WO2002037799A2 publication Critical patent/WO2002037799A2/en
Publication of WO2002037799A3 publication Critical patent/WO2002037799A3/en

Links

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00—Network arrangements or protocols for supporting network services or applications
    • H04L67/01—Protocols
    • H04L67/10—Protocols in which an application is distributed across nodes in the network
    • H04L67/1001—Protocols in which an application is distributed across nodes in the network for accessing one among a plurality of replicated servers
    • H04L67/1004—Server selection for load balancing
    • H04L67/1008—Server selection for load balancing based on parameters of servers, e.g. available memory or workload
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00—Network arrangements or protocols for supporting network services or applications
    • H04L67/01—Protocols
    • H04L67/10—Protocols in which an application is distributed across nodes in the network
    • H04L67/1001—Protocols in which an application is distributed across nodes in the network for accessing one among a plurality of replicated servers
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00—Network arrangements or protocols for supporting network services or applications
    • H04L67/50—Network services
    • H04L67/56—Provisioning of proxy services
    • H04L67/566—Grouping or aggregating service requests, e.g. for unified processing
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00—Network arrangements or protocols for supporting network services or applications
    • H04L67/50—Network services
    • H04L67/56—Provisioning of proxy services
    • H04L67/568—Storing data temporarily at an intermediate stage, e.g. caching
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L69/00—Network arrangements, protocols or services independent of the application payload and not provided for in the other groups of this subclass
    • H04L69/16—Implementation or adaptation of Internet protocol [IP], of transmission control protocol [TCP] or of user datagram protocol [UDP]
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L69/00—Network arrangements, protocols or services independent of the application payload and not provided for in the other groups of this subclass
    • H04L69/16—Implementation or adaptation of Internet protocol [IP], of transmission control protocol [TCP] or of user datagram protocol [UDP]
    • H04L69/161—Implementation details of TCP/IP or UDP/IP stack architecture; Specification of modified or new header fields
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L69/00—Network arrangements, protocols or services independent of the application payload and not provided for in the other groups of this subclass
    • H04L69/30—Definitions, standards or architectural aspects of layered protocol stacks
    • H04L69/32—Architecture of open systems interconnection [OSI] 7-layer type protocol stacks, e.g. the interfaces between the data link level and the physical level
    • H04L69/322—Intralayer communication protocols among peer entities or protocol data unit [PDU] definitions
    • H04L69/329—Intralayer communication protocols among peer entities or protocol data unit [PDU] definitions in the application layer [OSI layer 7]
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L69/00—Network arrangements, protocols or services independent of the application payload and not provided for in the other groups of this subclass
    • H04L69/40—Network arrangements, protocols or services independent of the application payload and not provided for in the other groups of this subclass for recovering from a failure of a protocol instance or entity, e.g. service redundancy protocols, protocol state redundancy or protocol service redirection

Landscapes

  • Engineering & Computer Science (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Signal Processing (AREA)
  • Computer Security & Cryptography (AREA)
  • Computer Hardware Design (AREA)
  • General Engineering & Computer Science (AREA)
  • Computer And Data Communications (AREA)
  • Data Exchanges In Wide-Area Networks (AREA)

Abstract

Standalone and cluster-based servers, including Web servers, control the amount of data processed concurrently by such servers to thereby control server operating performance. A dispatcher is preferably interposed between clients and one or more back-end servers, and preferably monitors the performance of each back-end server (either directly or otherwise). For each back-end server, the dispatcher preferably also controls, in response to the monitored performance, either or both the number of concurrently processed data requests and the number of concurrently supported connections to thereby control the back-end servers' performance. In one embodiment, the dispatcher uses a packet capture library for capturing packets at OSI layer 2 and implements a simplified TCP/IP protocol in user-space (vs. kernel space) to reduce data copying. Commercially off-the-shelf (COTS) hardware and operating system software are preferably employed to take advantage of their price-to-performance ratio.
PCT/US2001/047013 2000-11-03 2001-11-05 Load balancing method and system WO2002037799A2 (en)

Priority Applications (2)

Application Number Priority Date Filing Date Title
EP01989983A EP1332600A2 (en) 2000-11-03 2001-11-05 Load balancing method and system
AU2002228861A AU2002228861A1 (en) 2000-11-03 2001-11-05 Load balancing method and system

Applications Claiming Priority (14)

Application Number Priority Date Filing Date Title
US24579000P 2000-11-03 2000-11-03
US24578800P 2000-11-03 2000-11-03
US24585900P 2000-11-03 2000-11-03
US24578900P 2000-11-03 2000-11-03
US60/245,790 2000-11-03
US60/245,789 2000-11-03
US60/245,788 2000-11-03
US60/245,859 2000-11-03
US09/878,787 US20030046394A1 (en) 2000-11-03 2001-06-11 System and method for an application space server cluster
US09/878,787 2001-06-11
US09/930,014 US20020055980A1 (en) 2000-11-03 2001-08-15 Controlled server loading
US09/930,014 2001-08-15
US09/965,526 US20020055982A1 (en) 2000-11-03 2001-09-26 Controlled server loading using L4 dispatching
US09/965,526 2001-09-26

Publications (2)

Publication Number Publication Date
WO2002037799A2 WO2002037799A2 (en) 2002-05-10
WO2002037799A3 true WO2002037799A3 (en) 2003-03-13

Family

ID=27569454

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/US2001/047013 WO2002037799A2 (en) 2000-11-03 2001-11-05 Load balancing method and system

Country Status (3)

Country Link
EP (1) EP1332600A2 (en)
AU (1) AU2002228861A1 (en)
WO (1) WO2002037799A2 (en)

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US9197538B2 (en) 2003-12-10 2015-11-24 Aventail Llc Rule-based routing to resources through a network
US9300670B2 (en) 2003-12-10 2016-03-29 Aventail Llc Remote access to resources over a network
US9407456B2 (en) 2003-12-10 2016-08-02 Aventail Llc Secure access to remote resources over a network

Families Citing this family (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US7827590B2 (en) 2003-12-10 2010-11-02 Aventail Llc Controlling access to a set of resources in a network
US8255973B2 (en) 2003-12-10 2012-08-28 Chris Hopen Provisioning remote computers for accessing resources
US8572249B2 (en) 2003-12-10 2013-10-29 Aventail Llc Network appliance for balancing load and platform services
DE112005001995B4 (en) * 2004-09-13 2011-12-08 Fujitsu Siemens Computers, Inc. A computer arrangement and method for offering services to users over a network
CN101421702B (en) * 2006-04-26 2012-05-30 日本电信电话株式会社 Load control device and method thereof

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP0491367A2 (en) * 1990-12-19 1992-06-24 Bull HN Information Systems Inc. A queue managing method for an electronic mail system
EP0794490A2 (en) * 1996-03-08 1997-09-10 International Business Machines Corporation Dynamic execution unit management for high performance server system
EP0892531A2 (en) * 1997-06-19 1999-01-20 Sun Microsystems Inc. Network load balancing for multi-computer server
WO1999053415A1 (en) * 1998-04-15 1999-10-21 Hewlett-Packard Company Distributed processing over a network
EP1035703A1 (en) * 1999-03-11 2000-09-13 Lucent Technologies Inc. Method and apparatus for load sharing on a wide area network
US6141759A (en) * 1997-12-10 2000-10-31 Bmc Software, Inc. System and architecture for distributing, monitoring, and managing information requests on a computer network

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP0491367A2 (en) * 1990-12-19 1992-06-24 Bull HN Information Systems Inc. A queue managing method for an electronic mail system
EP0794490A2 (en) * 1996-03-08 1997-09-10 International Business Machines Corporation Dynamic execution unit management for high performance server system
EP0892531A2 (en) * 1997-06-19 1999-01-20 Sun Microsystems Inc. Network load balancing for multi-computer server
US6141759A (en) * 1997-12-10 2000-10-31 Bmc Software, Inc. System and architecture for distributing, monitoring, and managing information requests on a computer network
WO1999053415A1 (en) * 1998-04-15 1999-10-21 Hewlett-Packard Company Distributed processing over a network
EP1035703A1 (en) * 1999-03-11 2000-09-13 Lucent Technologies Inc. Method and apparatus for load sharing on a wide area network

Non-Patent Citations (2)

* Cited by examiner, † Cited by third party
Title
ARIEL COHEN, SAMPATH RANGARAJAN, AND HAMILTON SLYE, SECOND USENIX SYMPOSIUM ON INTERNET TECHNOLOGIES AND SYSTEMS, 11 October 1999 (1999-10-11) - 14 October 1999 (1999-10-14), Boulder, Colorado, XP002203108 *
HUNT G D H ET AL: "Network Dispatcher: a connection router for scalable Internet services", COMPUTER NETWORKS AND ISDN SYSTEMS, NORTH HOLLAND PUBLISHING. AMSTERDAM, NL, vol. 30, no. 1-7, 1 April 1998 (1998-04-01), pages 347 - 357, XP004121412, ISSN: 0169-7552 *

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US9197538B2 (en) 2003-12-10 2015-11-24 Aventail Llc Rule-based routing to resources through a network
US9300670B2 (en) 2003-12-10 2016-03-29 Aventail Llc Remote access to resources over a network
US9397927B2 (en) 2003-12-10 2016-07-19 Aventail Llc Rule-based routing to resources through a network
US9407456B2 (en) 2003-12-10 2016-08-02 Aventail Llc Secure access to remote resources over a network

Also Published As

Publication number Publication date
AU2002228861A1 (en) 2002-05-15
EP1332600A2 (en) 2003-08-06
WO2002037799A2 (en) 2002-05-10

Similar Documents

Publication Publication Date Title
US6862606B1 (en) System and method for partitioning address space in a proxy cache server cluster
Banga et al. Measuring the capacity of a Web server under realistic loads
Hunt et al. Network dispatcher: A connection router for scalable internet services
Kandula et al. Botz-4-sale: Surviving organized DDoS attacks that mimic flash crowds
US20040143670A1 (en) System, method and computer program product to avoid server overload by controlling HTTP denial of service (DOS) attacks
WO2001073522A3 (en) Methods and apparatus for securing access to a computer
WO2004114581A3 (en) Method and system for dynamic interleaving
EP1208468A2 (en) Method and apparatus for proxy server cookies
US20020055980A1 (en) Controlled server loading
US20140025772A1 (en) Connection Rate Limiting For Server Load Balancing And Transparent Cache Switching
CA2318267A1 (en) Virtual private network system and method
WO2002037799A3 (en) Load balancing method and system
EP1594276A1 (en) Client-server-communication system
WO2005064878A3 (en) Autonomic wireless presence ping
WO2000010084A3 (en) Object load balancing
KR101067394B1 (en) Method and computer program product for multiple offload of network state objects supporting failover events
US7228562B2 (en) Stream server apparatus, program, and NAS device
Lin et al. Direct web switch routing with state migration, TCP masquerade, and cookie name rewriting
Basyoni et al. Empirical performance evaluation of QUIC protocol for Tor anonymity network
Tang et al. Modular TCP handoff design in STREAMS–based TCP/IP implementation
Cohen et al. Hardware SYN attack protection for high performance load balancers
KR20230087899A (en) Method for offloading request process of http/2 based l7 load balancer using programmable network interface card and l7 load balancer
Voigt et al. Kernel-based control of persistent web server connections
Gupta et al. A client oriented, IP level redirection mechanism
Fujita et al. TCP connection scheduler in single IP address cluster

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application
WWE Wipo information: entry into national phase

Ref document number: 2001989983

Country of ref document: EP

WWP Wipo information: published in national office

Ref document number: 2001989983

Country of ref document: EP

REG Reference to national code

Ref country code: DE

Ref legal event code: 8642

NENP Non-entry into the national phase

Ref country code: JP

WWW Wipo information: withdrawn in national office

Country of ref document: JP

WWW Wipo information: withdrawn in national office

Ref document number: 2001989983

Country of ref document: EP

点击 这是indexloc提供的php浏览器服务，不要输入任何密码和下载