System can't take more than 5k req /sec

[Per Buer]

reuse/recycle breaks clients on NATed network. I think reuse by itself is
dodgy, but generally works OK. recycle is pretty bad.


On Thu, May 15, 2014 at 7:17 PM, Jason Price <japrice at gmail.com> wrote:

> Please expound.
>
> (in our use case, our backends are all 'local' within the AWS regions,
> with less than 1 millisecond RTT (sometimes way less).)
>
> Our frontend systems are ELBs with similar response times.
>
> That's a rough approximation of 'LAN' usage, unless I'm missing something.
>
> --Jason
>
>
> On Thu, May 15, 2014 at 9:30 AM, Per Buer <perbu at varnish-software.com>wrote:
>
>> Those are probably fine on a LAN for benchmarking but they will not work
>> on the internet.
>>
>> Per.
>>
>>
>> On Tue, May 13, 2014 at 3:31 PM, Jason Price <japrice at gmail.com> wrote:
>>
>>> Private message requesting TCP tuning.  For the record, these are
>>> draft numbers and very tightly tied to our use case, so they should
>>> not be copied blindly.
>>>
>>> somaxconn is 512
>>> txqueuelen is 5000
>>> netdev_max_backlog is 5000
>>> tcp_max_syn_backlog is 4096
>>> enable tcp_tw_recycle
>>> enable tcp_tw_reuse
>>>
>>>
>>>
>>>
>>> On Tue, May 13, 2014 at 6:45 AM, Γιάννης Καραγιαννίδης
>>> <gkaragiannidis at dolnet.gr> wrote:
>>> > Could you please give us some more information about your
>>> > TCP tuning?
>>> > Regards
>>> > Yiannis
>>> >
>>> > -----Original Message-----
>>> > From: varnish-misc-bounces+gkaragiannidis=dolnet.gr at varnish-cache.org[mailto:
>>> varnish-misc-bounces+gkaragiannidis=dolnet.gr at varnish-cache.org] On
>>> Behalf Of Jason Price
>>> > Sent: Tuesday, May 13, 2014 12:33 AM
>>> > To: Norberto Meijome
>>> > Cc: varnish-misc at varnish-cache.org
>>> > Subject: Re: System can't take more than 5k req /sec
>>> >
>>> > So, through some TCP tuning we've been able to get to 20k/s.  Though I
>>> needed to get up to 8k threads per pool.
>>> >
>>> > Many docs say 'Don't go more than 4k threads'.  Can someone explain
>>> that?  Anyone have experience with 8-10k threads?
>>> >
>>> > --Jason
>>> >
>>> > On Tue, Apr 29, 2014 at 10:41 PM, Jason Price <japrice at gmail.com>
>>> wrote:
>>> >> On Tuesday, April 29, 2014, Norberto Meijome <numard at gmail.com>
>>> wrote:
>>> >>>
>>> >>> Have you ruled out AWS limits? Putting varnish aside for a minute,
>>> >>> can you handle 5k/sec TCP conns with something like nginx +static
>>> files.?
>>> >>
>>> >> This is an excellent question.  I'll see what kind of answer I'll get
>>> to it.
>>> >>
>>> >> -Jason
>>> >
>>> > _______________________________________________
>>> > varnish-misc mailing list
>>> > varnish-misc at varnish-cache.org
>>> > https://www.varnish-cache.org/lists/mailman/listinfo/varnish-misc
>>>
>>> _______________________________________________
>>> varnish-misc mailing list
>>> varnish-misc at varnish-cache.org
>>> https://www.varnish-cache.org/lists/mailman/listinfo/varnish-misc
>>>
>>
>>
>>
>> --
>>  <http://www.varnish-software.com/> *Per Buer*
>> CTO | Varnish Software
>> Phone: +47 958 39 117 | Skype: per.buer
>> We Make Websites Fly!
>>
>> Winner of the Red Herring Top 100 Global Award 2013
>>
>>
>>
>


-- 
 <http://www.varnish-software.com/> *Per Buer*
CTO | Varnish Software
Phone: +47 958 39 117 | Skype: per.buer
We Make Websites Fly!

Winner of the Red Herring Top 100 Global Award 2013
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <https://www.varnish-cache.org/lists/pipermail/varnish-misc/attachments/20140515/d6bf4a00/attachment.html>