System can't take more than 5k req /sec

[Jason Price]

Please expound.

(in our use case, our backends are all 'local' within the AWS regions, with
less than 1 millisecond RTT (sometimes way less).)

Our frontend systems are ELBs with similar response times.

That's a rough approximation of 'LAN' usage, unless I'm missing something.

--Jason


On Thu, May 15, 2014 at 9:30 AM, Per Buer <perbu at varnish-software.com>wrote:

> Those are probably fine on a LAN for benchmarking but they will not work
> on the internet.
>
> Per.
>
>
> On Tue, May 13, 2014 at 3:31 PM, Jason Price <japrice at gmail.com> wrote:
>
>> Private message requesting TCP tuning.  For the record, these are
>> draft numbers and very tightly tied to our use case, so they should
>> not be copied blindly.
>>
>> somaxconn is 512
>> txqueuelen is 5000
>> netdev_max_backlog is 5000
>> tcp_max_syn_backlog is 4096
>> enable tcp_tw_recycle
>> enable tcp_tw_reuse
>>
>>
>>
>>
>> On Tue, May 13, 2014 at 6:45 AM, Γιάννης Καραγιαννίδης
>> <gkaragiannidis at dolnet.gr> wrote:
>> > Could you please give us some more information about your
>> > TCP tuning?
>> > Regards
>> > Yiannis
>> >
>> > -----Original Message-----
>> > From: varnish-misc-bounces+gkaragiannidis=dolnet.gr at varnish-cache.org[mailto:
>> varnish-misc-bounces+gkaragiannidis=dolnet.gr at varnish-cache.org] On
>> Behalf Of Jason Price
>> > Sent: Tuesday, May 13, 2014 12:33 AM
>> > To: Norberto Meijome
>> > Cc: varnish-misc at varnish-cache.org
>> > Subject: Re: System can't take more than 5k req /sec
>> >
>> > So, through some TCP tuning we've been able to get to 20k/s.  Though I
>> needed to get up to 8k threads per pool.
>> >
>> > Many docs say 'Don't go more than 4k threads'.  Can someone explain
>> that?  Anyone have experience with 8-10k threads?
>> >
>> > --Jason
>> >
>> > On Tue, Apr 29, 2014 at 10:41 PM, Jason Price <japrice at gmail.com>
>> wrote:
>> >> On Tuesday, April 29, 2014, Norberto Meijome <numard at gmail.com> wrote:
>> >>>
>> >>> Have you ruled out AWS limits? Putting varnish aside for a minute,
>> >>> can you handle 5k/sec TCP conns with something like nginx +static
>> files.?
>> >>
>> >> This is an excellent question.  I'll see what kind of answer I'll get
>> to it.
>> >>
>> >> -Jason
>> >
>> > _______________________________________________
>> > varnish-misc mailing list
>> > varnish-misc at varnish-cache.org
>> > https://www.varnish-cache.org/lists/mailman/listinfo/varnish-misc
>>
>> _______________________________________________
>> varnish-misc mailing list
>> varnish-misc at varnish-cache.org
>> https://www.varnish-cache.org/lists/mailman/listinfo/varnish-misc
>>
>
>
>
> --
>  <http://www.varnish-software.com/> *Per Buer*
> CTO | Varnish Software
> Phone: +47 958 39 117 | Skype: per.buer
> We Make Websites Fly!
>
> Winner of the Red Herring Top 100 Global Award 2013
>
>
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <https://www.varnish-cache.org/lists/pipermail/varnish-misc/attachments/20140515/efa6f8d9/attachment.html>