Proxy-Benchmarks

KO | EN

gitlite — search

#javascript #python #react #ai #typescript #machine-learning #rust #macos #windows #awesome #vue #openai #mcp #open-source

Proxy-Benchmarks

(★ 314)

Benchmarks for several proxies

File Explorer

Download Latest Version (.zip)

- caddy.tf
- caddy_setup.sh
- Caddyfile
- client_setup.sh
- run_tests.sh
- docker_setup.sh
- envoy.tf
- envoy.yaml
- envoy_setup.sh
- haproxy.cfg
- haproxy.tf
- haproxy_setup.sh
- average_response_time.png
- latency.png
- requests_per_second.png
- nginx.conf
- nginx.tf
- nginx_setup.sh
- dynamic_conf.toml
- traefik.tf
- traefik.toml
- traefik_setup.sh
- docker-compose.yml
- webserver_setup.sh
.gitignore
main.tf
README.md
variables.tf

// repository documentation

Was this content helpful?

★ 0 (0 ratings)

# Benchmarks

Tests performance of various proxies/load balancers. Based on the blog post https://www.loggly.com/blog/benchmarking-5-popular-load-balancers-nginx-haproxy-envoy-traefik-and-alb/.

We test the following proxies:

* Caddy
* Envoy
* HAProxy
* NGINX
* Traefik

**IMPORTANT! Be sure to SSH into the client VM and run the test against the proxy_server VM from there. Running the test from within the AWS VPC will reduce Internet latency.**

Defaults to the AWS "US-East-2 (Ohio)" region.

NOTE: The AWS plugin for Terraform can be finicky. The deployment may or may not work the first time. In that case, 
use `terraform taint aws_instance.proxy_server` for example to try it again.

## Setup

Perform these steps:

1. In the [AWS Console](https://console.aws.amazon.com), create a new SSH keypair (default name is "benchmarks"):
    * Go to __EC2 > Key Pairs > Create Key Pair__.
    * Name it "benchmarks".
    * Save the .pem file to this project's directory.
    * Update the file's permissions with `chmod 400 ./benchmarks.pem`
2. Run:
```
terraform init
terraform apply -auto-approve -var 'aws_access_key=<YOUR_ACCESS_KEY>' -var 'aws_secret_key=<YOUR_SECRET_KEY>'
```
3. Log into the *client* server with `ssh -i ./benchmarks.pem ubuntu@<IP_ADDRESS>` and run the tests:

```
/tmp/run_tests.sh | tee results.txt
```

Performance tests use https://github.com/rakyll/hey.

To tear down the servers:

```
terraform destroy -force -var 'aws_access_key=<YOUR_ACCESS_KEY>' -var 'aws_secret_key=<YOUR_SECRET_KEY>'
```

## Results using Hey

![alt text](https://raw.githubusercontent.com/NickMRamirez/Proxy-Benchmarks/master/images/requests_per_second.png "Requests per second")

![alt text](https://raw.githubusercontent.com/NickMRamirez/Proxy-Benchmarks/master/images/average_response_time.png "Average response time")

![alt text](https://raw.githubusercontent.com/NickMRamirez/Proxy-Benchmarks/master/images/latency.png "Latency")

*Graphs created using https://www.rapidtables.com/tools/bar-graph.html*

### Caddy (2.6.4)

```
Summary:
  Total:        5.5605 secs
  Slowest:      0.1183 secs
  Fastest:      0.0003 secs
  Average:      0.0136 secs
  Requests/sec: 17983.9983
  
  Total data:   23000000 bytes
  Size/request: 230 bytes

Response time histogram:
  0.000 [1]     |
  0.012 [50511] |■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■
  0.024 [39038] |■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■
  0.036 [8895]  |■■■■■■■
  0.048 [928]   |■
  0.059 [185]   |
  0.071 [206]   |
  0.083 [93]    |
  0.095 [95]    |
  0.107 [19]    |
  0.118 [29]    |

Latency distribution:
  10% in 0.0045 secs
  25% in 0.0075 secs
  50% in 0.0120 secs
  75% in 0.0180 secs
  90% in 0.0242 secs
  95% in 0.0283 secs
  99% in 0.0396 secs

Details (average, fastest, slowest):
  DNS+dialup:   0.0000 secs, 0.0003 secs, 0.1183 secs
  DNS-lookup:   0.0000 secs, 0.0000 secs, 0.0000 secs
  req write:    0.0000 secs, 0.0000 secs, 0.0079 secs
  resp wait:    0.0136 secs, 0.0003 secs, 0.1159 secs
  resp read:    0.0000 secs, 0.0000 secs, 0.0055 secs