Skip to main content
SpringerLink
Log in

Measuring the capacity of a Web server under realistic loads

  • Published:
World Wide Web Aims and scope Submit manuscript

Abstract

The World Wide Web and its related applications place substantial performance demands on network servers. The ability to measure the effect of these demands is important for tuning and optimizing the various software components that make up a Web server. To measure these effects, it is necessary to generate realistic HTTP client requests in a test‐bed environment. Unfortunately, the state‐of‐the‐art approach for benchmarking Web servers is unable to generate client request rates that exceed the capacity of the server being tested, even for short periods of time. Moreover, it fails to model important characteristics of the wide area networks on which most servers are deployed (e.g., delay and packet loss). This paper examines pitfalls that one encounters when measuring Web server capacity using a synthetic workload. We propose and evaluate a new method for Web traffic generation that can generate bursty traffic, with peak loads that exceed the capacity of the server. Our method also models the delay and loss characteristics of WANs. We use the proposed method to measure the performance of widely used Web servers. The results show that actual server performance can be significantly lower than indicated by standard benchmarks under conditions of overload and in the presence of wide area network delays and packet losses.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Similar content being viewed by others

References

  • ACME (1998), "ACME Laboratories, thttpd," http://www.acme.com/software/thttpd/.

  • Almeida, J., V. Almeida, and D. Yates (1996), "Measuring the Behavior of a World-Wide Web Server," Technical Report TR-96-025, Boston University, Department of Computer Science, Boston, MA.

    Google Scholar 

  • Almeida, J. and P. Cao (1998), "Measuring Proxy Performance with the Wisconsin Proxy Benchmark," Presented at the 3rd Web Caching Workshop, Manchester, England.

    Google Scholar 

  • Apache (1998), "Apache HTTP Server Project," http://www.apache.org/.

  • Arlitt, M.F. and C.L. Williamson (1996), "Web Server Workload Characterization: The Search for Invariants," In Proceedings of the ACM SIGMETRICS '96 Conference, Philadelphia, PA, pp. 126–137.

  • Bach, M.J. (1986), The Design of the UNIX Operating System, Prentice-Hall, Englewood Cliffs, NJ.

  • Banga, G. (1998), "The Design and Implementation of a New Network Subsystem Architecture for Server Systems," Master's thesis, Rice University, Houston, TX.

    Google Scholar 

  • Banga, G., F. Douglis, and M. Rabinovich (1997), "Optimistic Deltas for WWW Latency Reduction," In Proceedings of the 1997 USENIX Annual Technical Conference, Anaheim, CA, pp. 289–303.

  • Banga, G., P. Druschel, and J.C. Mogul (1998), "Better Operating System Features for Faster Network Servers," In Proceedings of the Workshop on Internet Server Performance, Madison, WI, pp. 69–79.

  • Banga, G., P. Druschel, and J.C. Mogul (1999), "Resource Containers: A New Facility for Resource Management in Server Systems," In Proceedings of the 3rd Symposium on Operating Systems Design and Implementation, New Orleans, LA, pp. 45–58.

  • Banga, G. and J.C. Mogul (1998), "Scalable Kernel Performance for Internet Servers Under Realistic Loads," In Proceedings of the 1998 USENIX Annual Technical Conference, New Orleans, LA, pp. 1–12.

  • Bestavros, A., R. Carter, M. Crovella, C. Cunha, A. Heddaya, and S. Mirdad (1995), "Application-Level Document Caching in the Internet," Technical Report TR-95-002, Boston University, Department of Computer Science, Boston, MA.

    Google Scholar 

  • Braun, H. and K. Claffy (1994), "Web Traffic Characterization: An Assessment of the Impact of Caching Documents from NCSA's Web Server," In Proceedings of the Second International WWW Conference, Chicago, IL, pp. 1007–1027.

  • Chankhunthod, A., P.B. Danzig, C. Neerdaels, M.F. Schwartz, and K.J. Worrell (1996), "A Hierarchical Internet Object Cache," In Proceedings of the 1996 USENIX Annual Technical Conference, San Diego, CA, pp. 153–163.

  • Compaq (1998), "Compaq Computer Corporation, Digital UNIX Tuning Parameters for Web Servers," http://www.digital.com/info/internet/document/ ias/tuning.html.

  • Crovella, M. and A. Bestavros (1996), "Self-Similarity in World Wide Web Traffic: Evidence and Possible Causes," In Proceedings of the ACM SIGMETRICS '96 Conference, Philadelphia, PA, pp. 160–169.

  • Cunha, C., A. Bestavros, and M. Crovella (1995), "Characteristics of WWW Client-Based Traces," Technical Report TR-95-010, Boston University, Department of Computer Science, Boston, MA.

    Google Scholar 

  • Custer, H. (1993), Inside Windows NT, Microsoft Press, Redmond, WA.

    Google Scholar 

  • Druschel, P. and G. Banga (1996), "Lazy Receiver Processing (LRP): A Network Subsystem Architecture for Server Systems," In Proceedings of the 2nd Symposium on Operating Systems Design and Implementation, Seattle, WA, pp. 261–276.

  • Fielding, R., J. Gettys, J.C. Mogul, H. Frystyk, and T. Berners-Lee (1997), "Hypertext Transfer Protocol - HTTP/1.1," RFC 2068.

  • Fox, A., S.D. Gribble, Y. Chawathe, E.A. Brewer, and P. Gauthier (1997), "Cluster-Based Scalable Network Services," In Proceedings of the Sixteenth ACM Symposium on Operating System Principles, San Malo, France, pp. 78–91.

  • Hu, J.C., S. Mungee, and D.C. Schmidt (1998), "Techniques for Developing and Measuring High-Performance Web Servers Over ATM Networks," In Proceedings of the IEEE Infocom Conference, San Francisco, CA.

  • Hu, J.C., I. Pyrali, and D.C. Schmidt (1997a), "Measuring the Impact of Event Dispatching and Concurrency Models on Web Server Performance Over High-Speed Networks," In Proceedings of the 2nd Global Internet Conference, Phoenix, AZ.

  • Hu, Y., A. Nanda, and Q. Yang (1997b), "Measurement, Analysis, and Performance Improvement of the Apache Web Server," Technical Report TR 1097-0001, University of Rhode Island, ECE Dept.

  • Kaashoek, M.F., D.R. Engler, G.R. Ganger, H. Briceno, R. Hunt, D. Mazieres, T. Pinckney, R. Grimm, J. Janotti, and K. Mackenzie (1997), "Application Performance and Flexibility on Exokernel Systems," In Proceedings of the Sixteenth ACM Symposium on Operating System Principles, Saint-Malo, France, pp. 52–65.

  • Kaashoek, M.F., D.R. Engler, G.R. Ganger, and D.A. Wallach (1996), "Server Operating Systems," In Proceedings of the 1996 ACM SIGOPS European Workshop, Connemara, Ireland, pp. 141–148.

  • Kwan, T.T., R.E. McGrath, and D.A. Reed (1995), "User Access Patterns to NCSA's World-Wide Web Server," Technical Report UIUCDCS-R-95-1934, Dept. of Computer Science, Univ. IL.

  • Maltzahn, C., K.J. Richardson, and D. Grunwald (1997), "Performance Issues of Enterprise Level Web Proxies," In Proceedings of the ACM SIGMETRICS '97 Conference, Seattle, WA, pp. 13–23.

  • McGrath, R.E. (1995), "Performance of Several HTTP Demons on an HP 735 Workstation," http://www.nc-sa.uiuc.edu/InformationServers/ Performance/V1.4/report.html.

  • McKusick, M.K., K. Bostic, M.J. Karels, and J.S. Quarterman (1996), The Design and Implementation of the 4.4BSD Operating System, Addison-Wesley, Reading, MA.

    Google Scholar 

  • Mecklermedia (1996), "Mecklermedia Corporation, WebServer Compare," http://webcompare.iworld.com/.

  • Mindcraft (1998), "Mindcraft Inc., WebStone," http://www.mindcraft.com/webstone/.

  • Mogul, J.C. (1993), "Observing TCP Dynamics in Real Networks," In Proceedings of the ACM SIGCOMM '92 Conference, pp. 281–292.

  • Mogul, J.C. (1995a), "Network Behavior of a Busy Web Server and its Clients," Technical Report WRL 95/5, DEC Western Research Laboratory, Palo Alto, CA.

    Google Scholar 

  • Mogul, J.C. (1995b), "Operating System Support for Busy Internet Servers," In Proceedings of the Fifth Workshop on Hot Topics in Operating Systems, Orcas Island, WA.

  • Mogul, J.C., F. Douglis, A. Feldmann, and B. Krishnamurthy (1997), "Potential Benefits of Delta Encoding and Data Compression for HTTP," In Proceedings of the ACM SIGCOMM '97 Conference, Cannes, France, pp. 181–194.

  • Mogul, J.C. and K.K. Ramakrishnan (1997), "Eliminating Receive Livelock in an Interrupt-Driven Kernel," ACM Transactions on Computer Systems 15, 3, 217–252.

    Article  Google Scholar 

  • Mosberger, D. and T. Jin (1998), "httperf - A Tool for Measuring Web Server Performance," In Proceedings of the Workshop on Internet Server Performance, Madison, WI, pp. 59–68.

  • Nielsen, H., J. Gettys, A. Baird-Smith, E. Prud'hommeaux, H.W. Lie, and C. Lilley (1997), "Network Performance Effects of HTTP/1.1, CSS1, and PNG," In Proceedings of the ACM SIGCOMM '97 Conference, Cannes, France, pp. 155–166.

  • Padmanabhan, V.N. and J.C. Mogul (1994), "Improving HTTP Latency," In Proceedings of the Second International WWW Conference, Chicago, IL, pp. 995–1005.

  • Pai, V.S., P. Druschel, and W. Zwaenepoel (1999), "IO-Lite: A Unified I/O Buffering and Caching System," In Proceedings of the 3rd Symposium on Operating Systems Design and Implementation, New Orleans, LA, pp. 15–28.

  • Postel, J.B. (1981), "Transmission Control Protocol," RFC 793.

  • Ramakrishnan, K.K. (1992), "Scheduling Issues for Interfacing to High Speed Networks," In Proceedings of the IEEE Global Telecommunications Conference, Orlando, FL, pp. 622–626.

  • Schechte, S.E. and J. Sutaria (1996), "A Study of the Effects of Context Switching and Caching on HTTP Server Performance," http://www.eecs.harvard.edu/_stuart/Tarantula/ FirstPaper.html.

  • Seltzer, M. and J. Gwertzman (1995), "The Case for Geographical Pushcaching," In Proceedings of the 1995 Workshop on Hot Topics in Operating Systems, Orcas Island, WA, pp. 51–55.

  • Shenker, S., L. Zhang, and D. Clark (1990), "Some Observations on the Dynamics of a Congestion Control Algorithm," ACM Computer Communication Review 20, 4, 30–39.

    Article  Google Scholar 

  • Spasojevic, M., M. Bowman, and A. Spector (1994), "Using a Wide-Area File System Within the World-Wide Web," In Proceedings of the Second International WWW Conference, Chicago, IL.

  • SPEC (1996), "The Standard Performance Evaluation Corporation, SPECWeb96," http://www.specbench.-org/osg/web96/.

  • Stevens, W. (1996), TCP/IP Illustrated Volume 3, Addison-Wesley, Reading, MA.

    Google Scholar 

  • Web66 (1996), "Web66 GStone Testing Laboratory Preliminary Report," http://web66.coled.umn.edu/gstone/.

  • Williams, S., M. Abrams, C.R. Standridge, G. Abdulla, and E.A. Fox (1996), "Removal Policies in Network Caches for World-Wide Web Documents," In Proceedings of the ACM SIGCOMM '96 Conference, Palo Alto, CA, pp. 293–305.

  • Wright, G. and W. Stevens (1995), TCP/IP Illustrated Volume 2, Addison-Wesley, Reading, MA.

    Google Scholar 

  • Yates, D., V. Almeida, and J. Almeida (1997), "On the Interaction Between an Operating System and Web Server," Technical Report TR-97-012, Boston University, Department of Computer Science, Boston, MA.

    Google Scholar 

  • Zeus (1998), "Zeus," http://www.zeus.co.uk/.

Download references

Author information

Authors and Affiliations

  1. Department of Computer Science, Rice University, Houston, TX, 77005, USA

    Gaurav Banga & Peter Druschel

Authors
  1. Gaurav Banga
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Peter Druschel
    View author publications

    You can also search for this author in PubMed Google Scholar

Rights and permissions

Reprints and permissions

About this article

Cite this article

Banga, G., Druschel, P. Measuring the capacity of a Web server under realistic loads. World Wide Web 2, 69–83 (1999). https://doi.org/10.1023/A:1019292504731

Download citation

  • Issue Date:

  • DOI: https://doi.org/10.1023/A:1019292504731

Keywords

Search

Navigation