<html xmlns:v="urn:schemas-microsoft-com:vml" xmlns:o="urn:schemas-microsoft-com:office:office" xmlns:w="urn:schemas-microsoft-com:office:word" xmlns="http://www.w3.org/TR/REC-html40">
<head>
<META HTTP-EQUIV="Content-Type" CONTENT="text/html; charset=us-ascii">
<meta name=Generator content="Microsoft Word 11 (filtered medium)">
<!--[if !mso]>
<style>
v\:* {behavior:url(#default#VML);}
o\:* {behavior:url(#default#VML);}
w\:* {behavior:url(#default#VML);}
.shape {behavior:url(#default#VML);}
</style>
<![endif]-->
<style>
<!--
/* Font Definitions */
@font-face
{font-family:Tahoma;
panose-1:2 11 6 4 3 5 4 4 2 4;}
/* Style Definitions */
p.MsoNormal, li.MsoNormal, div.MsoNormal
{margin:0in;
margin-bottom:.0001pt;
font-size:12.0pt;
font-family:"Times New Roman";}
a:link, span.MsoHyperlink
{color:blue;
text-decoration:underline;}
a:visited, span.MsoHyperlinkFollowed
{color:blue;
text-decoration:underline;}
span.EmailStyle17
{mso-style-type:personal-reply;
font-family:Arial;
color:navy;}
@page Section1
{size:8.5in 11.0in;
margin:1.0in 1.25in 1.0in 1.25in;}
div.Section1
{page:Section1;}
-->
</style>
</head>
<body lang=EN-US link=blue vlink=blue>
<div class=Section1>
<p class=MsoNormal><font size=2 color=navy face=Arial><span style='font-size:
10.0pt;font-family:Arial;color:navy'>We were able to resolve this. Our Varnish
instance is pointing a load balanced pool of backend servers (a vip on a
hardware load balancer), so to Varnish there is only one backend. We had a
situation in which certain images were returning 500 errors from the backend.
Because saint mode was enabled, it invalidated the backend (the only back end)
after a certain number of failures within a particular window. We disabled
saint mode and this fixed this issue. Best, August<o:p></o:p></span></font></p>
<p class=MsoNormal><font size=2 color=navy face=Arial><span style='font-size:
10.0pt;font-family:Arial;color:navy'><o:p> </o:p></span></font></p>
<div>
<div class=MsoNormal align=center style='text-align:center'><font size=3
face="Times New Roman"><span style='font-size:12.0pt'>
<hr size=2 width="100%" align=center tabindex=-1>
</span></font></div>
<p class=MsoNormal><b><font size=2 face=Tahoma><span style='font-size:10.0pt;
font-family:Tahoma;font-weight:bold'>From:</span></font></b><font size=2
face=Tahoma><span style='font-size:10.0pt;font-family:Tahoma'> Lei Wang
[mailto:leiwang@rhapsody.com] <br>
<b><span style='font-weight:bold'>Sent:</span></b> Friday, November 04, 2011
3:40 PM<br>
<b><span style='font-weight:bold'>To:</span></b> Rob S<br>
<b><span style='font-weight:bold'>Cc:</span></b> Gresens, August;
varnish-misc@varnish-cache.org<br>
<b><span style='font-weight:bold'>Subject:</span></b> Re: Intermittent 503's
from Varnish</span></font><o:p></o:p></p>
</div>
<p class=MsoNormal><font size=3 face="Times New Roman"><span style='font-size:
12.0pt'><o:p> </o:p></span></font></p>
<p class=MsoNormal><font size=3 face="Times New Roman"><span style='font-size:
12.0pt'>I had the same problem. Please help!<br>
<br>
/usr/sbin/varnishd -P /var/run/varnish80.pid -a :80 -f
/etc/varnish/varnish80.vcl -T <a href="http://127.0.0.1:6082">127.0.0.1:6082</a>
-t 120 -w 1,1000,120 -u varnish -g varnish -i varnish81 -S /etc/varnish/secret
-p thread_pool_add_delay 2 -p thread_pools 1 -p thread_pool_min 800 -p
thread_pool_max 2000 -p session_linger 50 -p sess_workspace 4096 -n varnish80
-s malloc,6.5G<br>
<br>
configuration related to this problem:<br>
backend eadrm {<br>
.host = "<a href="http://drm-ea.xxxxxxxx.com">drm-ea.xxxxxxxx.com</a>";<br>
.port = "80";<br>
.connect_timeout = 40s;<br>
.first_byte_timeout = 80s;<br>
.between_bytes_timeout = 40s;<br>
}<br>
<br>
} elsif (req.http.host ~ "drm-ea") {<br>
unset beresp.http.set-cookie;<br>
set beresp.ttl = 86400s;<br>
log "Adjusting EA-DRM TTL to 86400 seconds";<br>
<br>
Thanks,<br>
<br>
Lei<o:p></o:p></span></font></p>
<div>
<p class=MsoNormal><font size=3 face="Times New Roman"><span style='font-size:
12.0pt'>On Fri, Nov 4, 2011 at 11:52 AM, Rob S <<a
href="mailto:rtshilston@gmail.com">rtshilston@gmail.com</a>> wrote:<o:p></o:p></span></font></p>
<p class=MsoNormal><font size=3 face="Times New Roman"><span style='font-size:
12.0pt'>Can you send the varnishlog for one of these failing requests? Is<br>
this a POST or a GET request? Are you using default VCL, or can you<br>
send the VCL you are using?<br>
<br>
Rob<o:p></o:p></span></font></p>
<div>
<div>
<p class=MsoNormal><font size=3 face="Times New Roman"><span style='font-size:
12.0pt'>On Fri, Nov 4, 2011 at 6:44 PM, Gresens, August <<a
href="mailto:AGresens@scholastic.com">AGresens@scholastic.com</a>> wrote:<br>
> Hello<br>
><br>
><br>
><br>
> We’re having a very nasty production issue. We’re getting intermittent 503<br>
> from Varnish in front of a healthy backend.<br>
><br>
><br>
><br>
> This seems to happen on cache-miss, but we’re not seeing requests make it
to<br>
> the backend. Varnish immediately returns the 503. After the first 503, the<br>
> page can usually be loaded by requesting it a few more times. This seems
to<br>
> indicate that there is some condition within Varnish that prevents it from<br>
> hitting the backend that clears up quickly.<br>
><br>
><br>
><br>
> Has anyone seen this issue before? Is there anything we can try?<br>
><br>
><br>
><br>
> This is our startup config:<br>
><br>
><br>
><br>
> DAEMON_OPTS="-a :80 \<br>
><br>
> -T localhost:6082 \<br>
><br>
> -f /etc/varnish/default.vcl \<br>
><br>
> -S /etc/varnish/secret \<br>
><br>
> -s file,/var/lib/varnish/$INSTANCE/varnish_storage.bin,1G \<br>
><br>
> -p http_headers=128 \<br>
><br>
> -p sess_workspace=262144 \<br>
><br>
> -p connect_timeout=60 \<br>
><br>
> -p max_restarts=6 \<br>
><br>
> -p log_hashstring=on \<br>
><br>
> -p cli_timeout=60 \<br>
><br>
> -t 0"<br>
><br>
><br>
><br>
> We are on version 2.0.5<br>
><br>
><br>
><br>
> Thanks,<br>
><br>
><br>
><br>
> August<br>
><br>
><br>
><br>
><br>
><o:p></o:p></span></font></p>
</div>
</div>
<p class=MsoNormal><font size=3 face="Times New Roman"><span style='font-size:
12.0pt'>> _______________________________________________<br>
> varnish-misc mailing list<br>
> <a href="mailto:varnish-misc@varnish-cache.org">varnish-misc@varnish-cache.org</a><br>
> <a href="https://www.varnish-cache.org/lists/mailman/listinfo/varnish-misc"
target="_blank">https://www.varnish-cache.org/lists/mailman/listinfo/varnish-misc</a><br>
><br>
<br>
_______________________________________________<br>
varnish-misc mailing list<br>
<a href="mailto:varnish-misc@varnish-cache.org">varnish-misc@varnish-cache.org</a><br>
<a href="https://www.varnish-cache.org/lists/mailman/listinfo/varnish-misc"
target="_blank">https://www.varnish-cache.org/lists/mailman/listinfo/varnish-misc</a><o:p></o:p></span></font></p>
</div>
<p class=MsoNormal><font size=3 face="Times New Roman"><span style='font-size:
12.0pt'><o:p> </o:p></span></font></p>
</div>
</body>
</html>