Oppss, forgot to include the list.<br><br><div class="gmail_quote">---------- Forwarded message ----------<br>From: <b class="gmail_sendername">thebog</b> <span dir="ltr"><<a href="mailto:thebog@gmail.com">thebog@gmail.com</a>></span><br>
Date: Fri, Oct 22, 2010 at 1:38 AM<br>Subject: Re: infrastructure setup using ESI<br>To: "Gresens, August" <<a href="mailto:AGresens@scholastic.com">AGresens@scholastic.com</a>><br><br><br>Hi,<div><br></div>
<div>I'll try and give some advice in general terms. You are asking if this rope is long enuff, and that question has no good answer :)</div><div><br></div><div>Varnish is "most often" used close to the client (in front or behind loadbalancer). A main reason is that it handles alot of webtraffic good and cheap. This is where it's written to shine. But it shines in other layers as well. depending on what you are trying to do:</div>
<div><br></div><div>How many documents do you have?</div><div>Is your backend good?</div><div>How much traffic is backend seeing?</div><div>Does backend scale good/cheap?</div><div>What's your budget?</div><div>What hardware do you have/plan on getting?</div>
<div><br></div><div>Varnish works good in front of crappy backend, because it's easy/flexible (configurationwise) to reduce/shape traffic to backend.</div><div>If your hot dataset is huge, you will need much RAM, and there the budget kicks in. Some people dream of 64 GB RAM, some buy it by default, and for some 64 GB is such a little part of the dataset that it really does not help much. While others have a dataset where 4 GB RAM is more than enuff, so it's cheap to do it. For some it does not matter in if there are separate cached copy's, because it's free, so why not. For some it does. Hard to answer :) So are the secondary requests to the backend.</div>
<div><br></div><div>With Varnish you can manipulate HTTP headers that otherwise does not make sense because you have a backend you can not tweak to get what you want (Or this is more expensive than using Varnish). Some use Varnish in front of many different backend systems, some use it in front of crappy closed source backends. Many find VCL (Varnish configuration laguage) to be really good and easy (some don't bother ever to learn it because they don't need it), I can't think of many scenarios where you can't get VCL to do what ever you'd like with HTTP and to some extent most of the HTTP traffic.</div>
<div><br></div><div>So I would use Varnish where I have much traffic, where I need to reduce traffic, and where I would like to shape traffic if I had to. It's a tool, when you learn how to use it, you know when it makes sense to use it. And it can be used many places in the stack.</div>
<div><br></div><div>I would also not install anything other than a 64 bit OS. And focus on getting the right amount of RAM. As much as possible is always a good start :)</div><div><br></div><div>Hope this answered some of your questions :) Sorry for the rant.</div>
<div><br></div><div>YS</div><div>Anders Berg</div><div><br></div><div><div class="gmail_quote"><div><div></div><div class="h5">On Thu, Oct 21, 2010 at 11:14 PM, Gresens, August <span dir="ltr"><<a href="mailto:AGresens@scholastic.com" target="_blank">AGresens@scholastic.com</a>></span> wrote:<br>
</div></div><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div><div></div><div class="h5">
<div lang="EN-US" link="blue" vlink="purple">
<div>
<p class="MsoNormal"><font size="2" face="Arial"><span style="font-size:10.0pt;font-family:Arial">Hello</span></font></p>
<p class="MsoNormal"><font size="2" face="Arial"><span style="font-size:10.0pt;font-family:Arial"> </span></font></p>
<p class="MsoNormal"><font size="2" face="Arial"><span style="font-size:10.0pt;font-family:Arial">Varnish is a key part of a new set of apps we are building -
the ESI feature in particular is something we want to take advantage of
extensively.</span></font></p>
<p class="MsoNormal"><font size="2" face="Arial"><span style="font-size:10.0pt;font-family:Arial"> </span></font></p>
<p class="MsoNormal"><font size="2" face="Arial"><span style="font-size:10.0pt;font-family:Arial">Where does Varnish typically reside in the network
architecture? I would imagine in a scenario in which we would be using ESI, we
would want Varnish in front of the application load balancers. In this way, Varnish
would be the primary page assembler. We would likely run an HA setup for fault
tolerance.</span></font></p>
<p class="MsoNormal"><font size="2" face="Arial"><span style="font-size:10.0pt;font-family:Arial"> </span></font></p>
<p class="MsoNormal"><font size="2" face="Arial"><span style="font-size:10.0pt;font-family:Arial">We were also considering if Varnish could be used much
farther downstream – in between the load balancer and the application. We
thought is might provide for more fault tolerance, but it seems the disadvantage
would be that there would be a separate cached copy in each redundant varnish
instance, and with ESI secondary requests would be made back out to the same
web server potentially, setting up a feed back loop that could cause problems.</span></font></p>
<p class="MsoNormal"><font size="2" face="Arial"><span style="font-size:10.0pt;font-family:Arial"> </span></font></p>
<p class="MsoNormal"><font size="2" face="Arial"><span style="font-size:10.0pt;font-family:Arial">Thanks for your responses in advance.</span></font></p>
<p class="MsoNormal"><font size="2" face="Arial"><span style="font-size:10.0pt;font-family:Arial"> </span></font></p>
<p class="MsoNormal"><font size="2" face="Arial"><span style="font-size:10.0pt;font-family:Arial">August</span></font></p>
<p class="MsoNormal"><font size="2" face="Arial"><span style="font-size:10.0pt;font-family:Arial"> </span></font></p>
<p class="MsoNormal"><font size="2" face="Arial"><span style="font-size:10.0pt;font-family:Arial"> </span></font></p>
<p class="MsoNormal"><font size="1" face="Tahoma"><span style="font-size:8.0pt;font-family:Tahoma">August Gresens<br>
<font color="black"><span style="color:black">Director of Technology, eScholastic</span></font></span></font><font color="black"><span style="color:black"></span></font></p>
<p class="MsoNormal"><font size="1" color="black" face="Tahoma"><span style="font-size:8.0pt;font-family:Tahoma;color:black">Scholastic Inc.<br>
557 Broadway, NY, NY 10012</span></font><font color="black"><span style="color:black"></span></font></p>
<p class="MsoNormal"><font size="1" color="black" face="Tahoma"><span style="font-size:8.0pt;font-family:Tahoma;color:black">Email :: <a href="mailto:agresens@scholastic.com" target="_blank"><font color="black"><span style="color:black">agresens@scholastic.com</span></font></a><br>
Phone :: 917 363 3662</span></font><font color="black"><span style="color:black"></span></font></p>
<p class="MsoNormal"><font size="3" face="Times New Roman"><span style="font-size:12.0pt"> </span></font></p>
</div>
</div>
<pre><img>
</pre><br></div></div><div class="im">_______________________________________________<br>
varnish-misc mailing list<br>
<a href="mailto:varnish-misc@varnish-cache.org" target="_blank">varnish-misc@varnish-cache.org</a><br>
<a href="http://lists.varnish-cache.org/mailman/listinfo/varnish-misc" target="_blank">http://lists.varnish-cache.org/mailman/listinfo/varnish-misc</a><br></div></blockquote></div><br></div>
</div><br>