Bottleneck on connection accept rates

Dridi Boukelmoune dridi at varni.sh
Thu May 4 00:38:06 CEST 2017


> I believe I've ruled out the acceptor_sleep scenario (no debug messages that would accompany it are logged), but I'm going to try and disable it explicitly and see if that helps.  I'm also going to try using the accept-filter feature, although I'm not sure how supported it is.  And maybe try reducing timeout_linger.
>
> My goal is to have 1-2K simultaneous connections with an establish rate of 1-2K/second.  Cache miss rate will be 100% so there will be lots of backend connection management going on. Is this a realistic goal?

Not sure about the bottleneck but the 2000 workers will become one if
you reach 2K concurrent connections.

> thread_pool_add_delay      0.000 [seconds] (default)
> thread_pool_destroy_delay  1.000 [seconds] (default)
> thread_pool_fail_delay     0.200 [seconds] (default)
> thread_pool_max            1000 [threads]
> thread_pool_min            1000 [threads]
> thread_pool_reserve        0 [threads] (default)
> thread_pool_stack          48k [bytes] (default)
> thread_pool_timeout        300.000 [seconds] (default)
> thread_pools               2 [pools] (default)

Bump thread_pool_max back to 5000 (the default value) to get enough
room to handle the traffic you are expecting.

> MAIN.uptime               7546         1.00 Child process uptime
> MAIN.sess_conn          277145        36.73 Sessions accepted
> MAIN.sess_drop               0         0.00 Sessions dropped
> MAIN.sess_fail               0         0.00 Session accept failures

No failures, and no session dropped, looking good.

> MAIN.thread_queue_len           234          .   Length of session queue

And here you are running out of workers apparently.

Dridi



More information about the varnish-misc mailing list