<p dir="ltr">That can't, hurt.</p>
<div class="gmail_extra"><br><div class="gmail_quote">On Sep 15, 2016 03:31, "sujith pv" <<a href="mailto:sujithnss@gmail.com">sujithnss@gmail.com</a>> wrote:<br type="attribution"><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><p dir="ltr">No..I'm planning to try that next. So during that time also so do we need to cap transient storage ??</p>
<div class="gmail_extra"><br><div class="gmail_quote">On 15-Sep-2016 01:18, "Guillaume Quintard" <<a href="mailto:guillaume@varnish-software.com" target="_blank">guillaume@varnish-software.<wbr>com</a>> wrote:<br type="attribution"><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><p dir="ltr">Have you tried the packages from your distribution? </p>
<div class="gmail_extra"><br><div class="gmail_quote">On Sep 14, 2016 20:09, "sujith pv" <<a href="mailto:sujithnss@gmail.com" target="_blank">sujithnss@gmail.com</a>> wrote:<br type="attribution"><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><p dir="ltr">After the full load of requests..g_space became minimal and g_bytes became like 8 Gb..I had assigned malloc as 8 gb<br>
</p>
<div class="gmail_extra"><br><div class="gmail_quote">On 14-Sep-2016 22:42, "Guillaume Quintard" <<a href="mailto:guillaume@varnish-software.com" target="_blank">guillaume@varnish-software.co<wbr>m</a>> wrote:<br type="attribution"><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><p dir="ltr">What about the other g_space/g_bytes?</p>
<div class="gmail_extra"><br><div class="gmail_quote">On Sep 14, 2016 18:33, "sujith pv" <<a href="mailto:sujithnss@gmail.com" target="_blank">sujithnss@gmail.com</a>> wrote:<br type="attribution"><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div dir="ltr">It was showing as 0 for Transient_g_bytes and 1Gb for g_space as I mentioned in my mail.</div><div class="gmail_extra"><br><div class="gmail_quote">On Wed, Sep 14, 2016 at 7:45 PM, Guillaume Quintard <span dir="ltr"><<a href="mailto:guillaume@varnish-software.com" target="_blank">guillaume@varnish-software.co<wbr>m</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div dir="ltr">please keep using the mailing list, some other people may have ideas.<div><br></div><div>what's the output of "varnishstat -1 | grep g_bytes" ?</div></div><div class="gmail_extra"><span><font color="#888888"><br clear="all"><div><div data-smartmail="gmail_signature"><div dir="ltr"><div>-- <br></div>Guillaume Quintard<br></div></div></div></font></span><div><div>
<br><div class="gmail_quote">On Wed, Sep 14, 2016 at 3:50 PM, sujith pv <span dir="ltr"><<a href="mailto:sujithnss@gmail.com" target="_blank">sujithnss@gmail.com</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div dir="ltr">Hi Guillaume<div><br></div><div>I have tried capping Transient and I could see the respective values under SMA.transient.g_bytes/g_space. But still on load I didnt see this g_bytes being used and was showing 0 only. </div><span><div><br></div><div>Best Regards</div><div>Sujith P V</div></span></div><div><div><div class="gmail_extra"><br><div class="gmail_quote">On Tue, Sep 6, 2016 at 7:39 PM, Guillaume Quintard <span dir="ltr"><<a href="mailto:guillaume@varnish-software.com" target="_blank">guillaume@varnish-software.co<wbr>m</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div dir="ltr">Maybe, not sure. Unless you have a **good** reason to do so, use the packages.</div><div class="gmail_extra"><span><font color="#888888"><br clear="all"><div><div data-smartmail="gmail_signature"><div dir="ltr"><div>-- <br></div>Guillaume Quintard<br></div></div></div></font></span><div><div>
<br><div class="gmail_quote">On Tue, Sep 6, 2016 at 3:19 PM, sujith pv <span dir="ltr"><<a href="mailto:sujithnss@gmail.com" target="_blank">sujithnss@gmail.com</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div dir="ltr">Thanks Guillaume. Actually in my end Varnish was compiled here and installed (I was not part of that initially :-)). Will this have any impact compared to as you have mentioned like try from a packaged version.</div><div><div><div class="gmail_extra"><br><div class="gmail_quote">On Tue, Sep 6, 2016 at 6:46 PM, Guillaume Quintard <span dir="ltr"><<a href="mailto:guillaume@varnish-software.com" target="_blank">guillaume@varnish-software.co<wbr>m</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div dir="ltr">It's just a question of storage, shortlive objects got into transient storage instead of the one(s) you defined in the command line. But it's still a cache storage, based on malloc, that is by default unlimited in size.<div><br></div><div>The rationale is that for object with such short ttl+grace+keep, a simple malloc is good enough.</div></div><div class="gmail_extra"><span><font color="#888888"><br clear="all"><div><div data-smartmail="gmail_signature"><div dir="ltr"><div>-- <br></div>Guillaume Quintard<br></div></div></div></font></span><div><div>
<br><div class="gmail_quote">On Tue, Sep 6, 2016 at 3:04 PM, sujith pv <span dir="ltr"><<a href="mailto:sujithnss@gmail.com" target="_blank">sujithnss@gmail.com</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div dir="ltr">Actually I'm confused around the short lived objects. Is these objects are something like cached objects or who is creating these objects.</div><div><div><div class="gmail_extra"><br><div class="gmail_quote">On Tue, Sep 6, 2016 at 1:57 PM, Guillaume Quintard <span dir="ltr"><<a href="mailto:guillaume@varnish-software.com" target="_blank">guillaume@varnish-software.co<wbr>m</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div dir="ltr">Sorry, I didn't get your question.</div><div class="gmail_extra"><span><font color="#888888"><br clear="all"><div><div data-smartmail="gmail_signature"><div dir="ltr"><div>-- <br></div>Guillaume Quintard<br></div></div></div></font></span><div><div>
<br><div class="gmail_quote">On Tue, Sep 6, 2016 at 8:31 AM, sujith pv <span dir="ltr"><<a href="mailto:sujithnss@gmail.com" target="_blank">sujithnss@gmail.com</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div dir="ltr">Thanks Guillaume. May be Im asking a very basic question , but still how this short lived objects are created and I'm not giving any settings for the same as well.</div><div><div><div class="gmail_extra"><br><div class="gmail_quote">On Tue, Sep 6, 2016 at 11:54 AM, Guillaume Quintard <span dir="ltr"><<a href="mailto:guillaume@varnish-software.com" target="_blank">guillaume@varnish-software.co<wbr>m</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><p dir="ltr"><a href="https://www.varnish-cache.org/docs/4.1/reference/varnishd.html#shortlived" target="_blank">https://www.varnish-cache.org/<wbr>docs/4.1/reference/varnishd.ht<wbr>ml#shortlived</a></p><div><div>
<div class="gmail_extra"><br><div class="gmail_quote">On Sep 6, 2016 08:07, "sujith pv" <<a href="mailto:sujithnss@gmail.com" target="_blank">sujithnss@gmail.com</a>> wrote:<br type="attribution"><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div dir="ltr">Thanks <span style="color:rgb(85,85,85);font-size:12.8px;white-space:nowrap;background-color:rgb(245,245,245)">Guillaume. I will try the transient settings first and verify the same. Also could you please elaborate on the short lived objects.</span><div><span style="color:rgb(85,85,85);font-size:12.8px;white-space:nowrap;background-color:rgb(245,245,245)"><br></span></div><div><span style="color:rgb(85,85,85);font-size:12.8px;white-space:nowrap;background-color:rgb(245,245,245)">Best Regards</span></div><div><span style="color:rgb(85,85,85);font-size:12.8px;white-space:nowrap;background-color:rgb(245,245,245)">Sujith P V</span></div></div><div class="gmail_extra"><br><div class="gmail_quote">On Fri, Sep 2, 2016 at 11:24 AM, Guillaume Quintard <span dir="ltr"><<a href="mailto:guillaume@varnish-software.com" target="_blank">guillaume@varnish-software.co<wbr>m</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div dir="ltr">Hi Viktor,<div><br></div><div>Have a look here <a href="https://www.varnish-cache.org/docs/trunk/users-guide/storage-backends.html#transient-storage" target="_blank">https://www.varnish-cache<wbr>.org/docs/trunk/users-guide/st<wbr>orage-backends.html#transient-<wbr>storage</a></div><div><br></div><div>Sujith, please try to use a packaged version from your distribution.</div></div><div class="gmail_extra"><span><font color="#888888"><br clear="all"><div><div data-smartmail="gmail_signature"><div dir="ltr"><div>-- <br></div>Guillaume Quintard<br></div></div></div></font></span><div><div>
<br><div class="gmail_quote">On Fri, Sep 2, 2016 at 1:18 AM, Viktor Villafuerte <span dir="ltr"><<a href="mailto:viktor.villafuerte@optusnet.com.au" target="_blank">viktor.villafuerte@optusnet.c<wbr>om.au</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">Hi Guillaume,<br>
<span><br>
On Thu 01 Sep 2016 09:53:22, Guillaume Quintard wrote:<br>
> Is that virtual or real memory?<br>
> Try to cap your Transient storage to 1GB, you may be overloaded with short<br>
> lived objects.<br>
<br>
</span>Could you elaborate on this bit more? I've got very similar problem<br>
here. Eg: Total memory 384g<br>
<br>
VIRT: 487g<br>
RES: 311g<br>
<br>
free says: 46g free<br>
<br>
but SWAP is 91.3% used :(<br>
<br>
<br>
How can this be?<br>
<br>
<br>
thanks<br>
<br>
v<br>
<span><br>
<br>
><br>
> On Sep 1, 2016 9:40 AM, "sujith pv" <<a href="mailto:sujithnss@gmail.com" target="_blank">sujithnss@gmail.com</a>> wrote:<br>
><br>
> > Hi All<br>
> ><br>
> > I had already mailed this query long back but this time putting in a<br>
> > different manner.<br>
> ><br>
> ><br>
</span>> > - We are using Varnish 4.0 in our end. We have a machine with memory<br>
<span>> > of 16G with 8G being malloc for Varnish. We have a TTL for 2 hrs as well.<br>
</span>> > - During our peak traffic, when we see the total memory of the machine<br>
<span>> > reaching 90% and like varnishd process is taking some 89% .<br>
</span>> > - So I'm just confused even though we had allocated just 8G malloc<br>
<div><div>> > which is like 50% of the total memory, how the process is eating up 89% of<br>
> > memory and the memory is not releasing even after TTL.<br>
> ><br>
> ><br>
> > Any help please...<br>
> ><br>
> > Best Regards<br>
> > Sujith P V<br>
> ><br>
> > ______________________________<wbr>_________________<br>
> > varnish-misc mailing list<br>
> > <a href="mailto:varnish-misc@varnish-cache.org" target="_blank">varnish-misc@varnish-cache.org</a><br>
> > <a href="https://www.varnish-cache.org/lists/mailman/listinfo/varnish-misc" rel="noreferrer" target="_blank">https://www.varnish-cache.org/<wbr>lists/mailman/listinfo/varnish<wbr>-misc</a><br>
> ><br>
<br>
> ______________________________<wbr>_________________<br>
> varnish-misc mailing list<br>
> <a href="mailto:varnish-misc@varnish-cache.org" target="_blank">varnish-misc@varnish-cache.org</a><br>
> <a href="https://www.varnish-cache.org/lists/mailman/listinfo/varnish-misc" rel="noreferrer" target="_blank">https://www.varnish-cache.org/<wbr>lists/mailman/listinfo/varnish<wbr>-misc</a><br>
<br>
<br>
</div></div><span><font color="#888888">--<br>
Regards<br>
<br>
Viktor Villafuerte<br>
Optus Internet Engineering<br>
t: <a href="tel:%2B61%202%2080825265" value="+61280825265" target="_blank">+61 2 80825265</a><br>
</font></span></blockquote></div><br></div></div></div>
</blockquote></div><br></div>
</blockquote></div></div>
</div></div></blockquote></div><br></div>
</div></div></blockquote></div><br></div></div></div>
</blockquote></div><br></div>
</div></div></blockquote></div><br></div></div></div>
</blockquote></div><br></div>
</div></div></blockquote></div><br></div></div></div>
</blockquote></div><br></div>
</div></div></blockquote></div><br></div></div></div>
</blockquote></div><br></div>
</blockquote></div></div>
</blockquote></div></div>
</blockquote></div></div>
</blockquote></div></div>
</blockquote></div></div>