Are you specifically not caching 500 responses in your config file? Something like:<div><br></div><div>if(beresp.status == 500)</div><div>{</div><div> return (hit_for_pass);</div><div>}<br><br>If you're not doing that, then you *are* caching 500 responses.<br>
<br><div class="gmail_quote">On Sun, May 13, 2012 at 5:20 PM, <span dir="ltr"><<a href="mailto:Nicholas_Maesepp@scee.net" target="_blank">Nicholas_Maesepp@scee.net</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">
<font face="sans-serif">Nothing special about my config file apart
from the hashing of objects, I do have the following already in my vcl_fetch:</font>
<br>
<br><font face="sans-serif">set beresp.grace = 3m;</font>
<br><font face="sans-serif">if (beresp.status == 500) {</font>
<br><font face="sans-serif"> set beresp.saintmode =
5s;</font>
<br><font face="sans-serif"> }</font>
<br>
<br><font face="sans-serif">======</font>
<br><font face="sans-serif">vcl_recv {</font>
<br><font face="sans-serif">set req.grace = 40s;</font>
<br><font face="sans-serif">if (req.request != "GET" &&
req.request != "HEAD") {</font>
<br><font face="sans-serif"> /*
We only deal with GET and HEAD by default */</font>
<br><font face="sans-serif"> return
(pass);</font>
<br><font face="sans-serif"> }</font>
<br><font face="sans-serif">if (req.http.Accept-Encoding &&
req.url ~ "\.(png|gif|jpg|swf|mov|flv)$") {</font>
<br><font face="sans-serif"> remove req.http.Accept-Encoding;</font>
<br><font face="sans-serif"> }</font>
<br><font face="sans-serif">return (lookup);</font>
<br>
<br><font face="sans-serif">I'm not convinced that I'm caching 500
responses on all these objects, I do wonder if its because I remove accept-encoding
on those objects, those are the ones that end up with 500's. But also maybe
my saintmode and grace numbers are too low if the back-end is infact serving
500's. But at least it's an avenue to explore and get some evidence to
prove or disprove it. Will also try using hit for pass instead and see
if that gives me more resilience.</font>
<br>
<br>
<br><font face="sans-serif">Cheers</font>
<br>
<br><font face="sans-serif">Nick</font>
<br>
<br>
<br>
<br>
<br><font size="1" color="#5f5f5f" face="sans-serif">From:
</font><font size="1" face="sans-serif">Hugues Alary <<a href="mailto:hugues.alary@gmail.com" target="_blank">hugues.alary@gmail.com</a>></font>
<br><font size="1" color="#5f5f5f" face="sans-serif">To:
</font><font size="1" face="sans-serif">Andreas Plesner Jacobsen
<<a href="mailto:apj@mutt.dk" target="_blank">apj@mutt.dk</a>></font>
<br><font size="1" color="#5f5f5f" face="sans-serif">Cc:
</font><font size="1" face="sans-serif"><a href="mailto:varnish-misc@varnish-cache.org" target="_blank">varnish-misc@varnish-cache.org</a></font>
<br><font size="1" color="#5f5f5f" face="sans-serif">Date:
</font><font size="1" face="sans-serif">05/12/2012 03:29 AM</font>
<br><div class="im"><font size="1" color="#5f5f5f" face="sans-serif">Subject:
</font><font size="1" face="sans-serif">Re: Varnish
500's now not 302's</font>
<br><font size="1" color="#5f5f5f" face="sans-serif">Sent by:
</font><font size="1" face="sans-serif"><a href="mailto:varnish-misc-bounces@varnish-cache.org" target="_blank">varnish-misc-bounces@varnish-cache.org</a></font>
<br>
<hr noshade>
<br>
<br>
<br></div><div class="im"><font size="3">At this point, sending your configuration file would maybe
be a good idea.</font>
</div><p></p><div class="im"><font size="3">On May 11, 2012 1:41 AM, "Andreas Plesner Jacobsen"
<</font><a href="mailto:apj@mutt.dk" target="_blank"><font size="3" color="blue"><u>apj@mutt.dk</u></font></a><font size="3">>
wrote:</font>
<br><font size="3">On Fri, May 11, 2012 at 09:30:52AM +1100, </font><a href="mailto:Nicholas_Maesepp@scee.net" target="_blank"><font size="3" color="blue"><u>Nicholas_Maesepp@scee.net</u></font></a><font size="3">
wrote:<br>
<br>
> I guess technically I realize this is from the cache, my question
is more<br>
> along the lines of what could be causing my objects in the cache to
become<br>
> stop being delivered as is and having a 500 error returned. Is my
cache<br>
> being corrupted in some way when varnish starts to max out the malloc'ed<br>
> RAM? Seems like a bug to me but can't pinpoint exactly what causes
it,<br>
> just that it happens after X amount of time to any of my instances.<br>
<br>
Then you misunderstood me. The 500 is a cached object that your backend
served<br>
at the time. You can avoid caching such objects by inspecting the HTTP
response<br>
in vcl_fetch and setting TTL and/or using hit for pass and/or saint mode.<br>
<br>
It's almost certainly not a bug.<br>
<br>
--<br>
Andreas<br>
<br>
</font>
<br><font color="blue" face="sans-serif"><u><br>
</u></font><a></a>
</div><div class="im"><p><font face="sans-serif"><b><br>
Sony Computer Entertainment Australia Pty Ltd</b><br>
Level 1, 63-73 Ann Street Surry Hills NSW 2010<br>
P.O. Box 5023 Darlinghurst NSW 2010<br>
ph: <a href="tel:%2B61%20%280%292%209324%209500" value="+61293249500" target="_blank">+61 (0)2 9324 9500</a> fax: <a href="tel:%2B61%20%280%292%209324%209558" value="+61293249558" target="_blank">+61 (0)2 9324 9558</a></font>
</p><p><a href="http://au.playstation.com/" target="_blank"><font color="blue" face="sans-serif"><u>http://au.playstation.com</u></font></a><font color="blue" face="sans-serif"><u><br>
</u></font><a href="http://www.facebook.com/PlaystationAU" target="_blank"><font color="blue" face="sans-serif"><u>http://www.facebook.com/PlayStationAU</u></font></a>
</p><p><font face="sans-serif"><br>
<b><br>
THE WORLD IS IN PLAY.</b><br>
PlayStationŽVita has arrived.<br>
</font><a href="http://www.psvita.com/" target="_blank"><font face="sans-serif">http://www.psvita.com</font></a><font face="sans-serif">
<br>
<br>
</font><font color="blue" face="sans-serif"><u><br>
</u></font><a href="http://au.playstation.com/psvita" target="_blank"><img width="414" height="152" alt="PSMOVE"></a><font face="Arial"><br>
<br>
**********************************************************************<br>
This email and any files transmitted with it are confidential and intended
solely for the use of the individual or entity to whom they are addressed.
If you have received this email in error please notify <a href="mailto:postmaster@scee.net" target="_blank">postmaster@scee.net</a><br>
This footnote also confirms that this email message has been checked for
all known viruses.<br>
Sony Computer Entertainment Australia Pty. Limited<br>
Registered Office: Level 1, 63-73 Ann Street, Surry Hills, NSW 2010 Australia<br>
Registered in Australia: 077 583 183<br>
**********************************************************************<br>
</font><font color="#008000" face="Arial"><b><i><br>
Please consider the environment before printing this e-mail</i></b></font></p><p></p><p></p></div><p></p><br>_______________________________________________<br>
varnish-misc mailing list<br>
<a href="mailto:varnish-misc@varnish-cache.org">varnish-misc@varnish-cache.org</a><br>
<a href="https://www.varnish-cache.org/lists/mailman/listinfo/varnish-misc" target="_blank">https://www.varnish-cache.org/lists/mailman/listinfo/varnish-misc</a><br></blockquote></div><br><br clear="all"><div><br></div>-- <br>
Hugues ALARY<br>
</div>