Varnish memory consumption grows infinitely

[G.Bertels at circit.de]

Sorry, i mean Varnish 6.0.6



Von: varnish-misc <varnish-misc-bounces+g.bertels=circit.de at varnish-cache.org> im Auftrag von "Bertels, Günter" <G.Bertels at circit.de>
Datum: Freitag, 19. März 2021 um 10:05
An: "varnish-misc at varnish-cache.org" <varnish-misc at varnish-cache.org>
Betreff: Varnish memory consumption grows infinitely

Hello,
we are using Varnish 6.0.9 with Red Hat Enterprise Linux 8.3 and I notice that the Varnish consumes more memory than allocated to it.

The Varnish is started with the following parameters:

ExecStart=/usr/sbin/varnish\
-P /var/run/varnish.pid \
-f /etc/varnish/default.vcl \
-a :6081 -T 127.0.0.1:6082 \
-S /etc/varnish/secret \
-s Transient=malloc,8G \
-s malloc,48G \
-p http_req_hdr_len=16k \
-p timeout_idle=10 \
-p workspace_client=256k \
-p workspace_backend=256k

The virtual memory and RAM consumption keeps growing and I have to restart the process every few days.
My search on the internet shows some results that a few also have the problem, but no solution.
It looks like RedHat does not use jemalloc (https://bugzilla.redhat.com/show_bug.cgi?id=1656034)

ldd /usr/sbin/varnishd
linux-vdso.so.1 (0x00007ffe365ea000)
libpcre.so.1 => /lib64/libpcre.so.1 (0x00007ff6869f2000)
libdl.so.2 => /lib64/libdl.so.2 (0x00007ff6867ee000)
librt.so.1 => /lib64/librt.so.1 (0x00007ff6865e6000)
libm.so.6 => /lib64/libm.so.6 (0x00007ff686264000)
libpthread.so.0 => /lib64/libpthread.so.0 (0x00007ff686044000)
libc.so.6 => /lib64/libc.so.6 (0x00007ff685c81000)
/lib64/ld-linux-x86-64.so.2 (0x00007ff686f99000)


I am at a loss as to how to proceed. Because restarting the Varnish every few days can't be the solution and I hope there is a way to solve the problem.

Regards
Günter

________________________________

circ IT GmbH & Co KG • 40549 Düsseldorf
Sitz Düsseldorf • Amtsgericht Düsseldorf HRA 19974
Persönlich haftender Gesellschafter: circ IT Verwaltungs-GmbH (AG Düsseldorf HRB 58609)
Geschäftsführer: Michael Staade


________________________________

circ IT GmbH & Co KG • 40549 Düsseldorf
Sitz Düsseldorf • Amtsgericht Düsseldorf HRA 19974
Persönlich haftender Gesellschafter: circ IT Verwaltungs-GmbH (AG Düsseldorf HRB 58609)
Geschäftsführer: Michael Staade
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <https://www.varnish-cache.org/lists/pipermail/varnish-misc/attachments/20210319/f58e6473/attachment.html>