<html>
<head>
<meta http-equiv="Content-Type" content="text/html; charset=iso-8859-1">
</head>
<body bgcolor="#FFFFFF">
Hi,
<div><br>
</div>
<div>For this kind of setup, you can cut your storage in half and use two stevedores: one for small files and other for large ones. Use vcl to decide in which stevedore you store objects.</div>
<div><br>
</div>
<div>You'll avoid nuking too many small objects for a single large one. </div>
<div><br>
</div>
<div>Regards, </div>
<div>Thierry </div>
<br>
<br>
-------- Message d'origine --------<br>
De : John Salmon <John.Salmon@DEShawResearch.com> <br>
Date : 06/04/2016 20:09 (GMT+01:00) <br>
À : Dridi Boukelmoune <dridi@varni.sh> <br>
Cc : varnish-misc <varnish-misc@varnish-cache.org>, "Moraes, Mark" <Mark.Moraes@deshawresearch.com>
<br>
Objet : Re: Varnish returns truncated content <br>
<br>
<div>On 04/06/2016 11:54 AM, Dridi Boukelmoune wrote:<br>
<blockquote type="cite">
<blockquote type="cite">
<pre>Is this a Varnish bug? Any advice on how to diagnose this further would be
greatly
appreciated.
</pre>
</blockquote>
<pre>
Hi John,
This is not a bug, but probably due to streaming being enabled by
default. Basically the request goes through the VCL successfully, the
curl client gets the headers and then the body is streamed while at
the same time inserted into storage.
But then you get this error:
</pre>
<blockquote type="cite">
<pre>- FetchError Could not get storage
</pre>
</blockquote>
<pre>
You can see lots of ExpKill records, which mean that you most likely
hit the nuke_limit (see man varnishd). It means that Varnish stopped
making space for the new object because for that it had to remove too
many objects from the cache. It may happen more frequently when a
storage is mixing large and small objects.</pre>
</blockquote>
Yes. I definitely have a mix of small O(100) byte objects<br>
and large (up to 8MB) objects. How should I set nuke_limit?<br>
80000 would more-or-less guarantee that space can be found<br>
for a large object by nuking small ones. Are there negative<br>
consequences to setting it so high? Are there other parameters<br>
I should tune instead/first?<br>
<br>
Thanks,<br>
John Salmon<br>
<blockquote type="cite">
<pre>
Best Regards,
Dridi
</pre>
</blockquote>
<br>
<div class="moz-signature">-- <br>
<b>.</b></div>
</div>
</body>
</html>