Varnish 4 Performance Issues

Junaid Mukhtar junaid.mukhtar at gmail.com
Wed Sep 26 08:31:33 UTC 2018


I totally agree about that.

what we have figured out is that during the steady periods of performance
tests it run absolutely fine; but as soon as we spike up the traffic
(double the normal peak) performance degrades dramatically.


--------
Regards,
Junaid


On Tue, Sep 25, 2018 at 5:17 PM Guillaume Quintard <
guillaume at varnish-software.com> wrote:

> without the vcl (and/or logs, but I'm assuming those are even more
> confidential), that's a tough cookie to debug
> --
> Guillaume Quintard
>
>
> On Mon, Sep 24, 2018 at 10:35 AM Junaid Mukhtar <junaid.mukhtar at gmail.com>
> wrote:
>
>> Hi
>>
>> Apologies but I am not allowed to share the VCL. If there's any other
>> thing like stats etc that might be helpful then do let me know
>>
>> --------
>> Regards,
>> Junaid
>>
>>
>> On Fri, Sep 21, 2018 at 4:15 PM Guillaume Quintard <
>> guillaume at varnish-software.com> wrote:
>>
>>> would you be able to share your vcl?
>>> --
>>> Guillaume Quintard
>>>
>>>
>>> On Fri, Sep 21, 2018 at 4:54 PM Junaid Mukhtar <junaid.mukhtar at gmail.com>
>>> wrote:
>>>
>>>> Any help guys; this is really getting to us.....
>>>>
>>>> --------
>>>> Regards,
>>>> Junaid
>>>>
>>>>
>>>> On Thu, Sep 20, 2018 at 3:57 PM Junaid Mukhtar <
>>>> junaid.mukhtar at gmail.com> wrote:
>>>>
>>>>>
>>>>> This is what we get in varnishhist
>>>>>
>>>>> 280_
>>>>>
>>>>>
>>>>>
>>>>>                                      |
>>>>> 230_                                 |
>>>>>                                      |
>>>>>                                      |
>>>>>                                      |
>>>>>                                      |
>>>>> 180_                                 |
>>>>>                                     ||
>>>>>                                     ||
>>>>>                                     |||
>>>>>                                     |||
>>>>> 130_                                |||
>>>>>                                     |||
>>>>>                                    ||||||
>>>>>                                    ||||||
>>>>>                                    ||||||
>>>>> 80_                                ||||||
>>>>>
>>>>> ||||||                                                               #
>>>>>
>>>>> ||||||                                                               ###
>>>>>
>>>>> |||||||                                                             # ###
>>>>>
>>>>> |||||||||                                                           ##### #
>>>>> 30_
>>>>> |||||||||                                                           ########
>>>>>
>>>>> |||||||||
>>>>> #########
>>>>>
>>>>> ||||||||||
>>>>> ###########
>>>>>
>>>>> ||||||||||||                                                ## #
>>>>> #############       #
>>>>>
>>>>> +---------------------+---------------------+---------------------+---------------------+---------------------+---------------------+---------------------+---------------------+---------------------
>>>>> |1e-6                 |1e-5                 |1e-4
>>>>> |1e-3                 |1e-2                 |1e-1
>>>>> |1e0                  |1e1                  |1e2
>>>>> --------
>>>>> Regards,
>>>>> Junaid
>>>>>
>>>>>
>>>>> On Thu, Sep 20, 2018 at 3:54 PM Junaid Mukhtar <
>>>>> junaid.mukhtar at gmail.com> wrote:
>>>>>
>>>>>> Below is the output; all of them are default except i was trying to
>>>>>> up the threads_pool to 4 but didn't feel any imporvement in performance
>>>>>> degradation
>>>>>>
>>>>>> accept_filter              off [bool] (default)
>>>>>> acceptor_sleep_decay       0.9 (default)
>>>>>> acceptor_sleep_incr        0.000 [seconds] (default)
>>>>>> acceptor_sleep_max         0.050 [seconds] (default)
>>>>>> auto_restart               on [bool] (default)
>>>>>> backend_idle_timeout       60.000 [seconds] (default)
>>>>>> ban_dups                   on [bool] (default)
>>>>>> ban_lurker_age             60.000 [seconds] (default)
>>>>>> ban_lurker_batch           1000 (default)
>>>>>> ban_lurker_sleep           0.010 [seconds] (default)
>>>>>> between_bytes_timeout      60.000 [seconds] (default)
>>>>>> cc_command                 "exec gcc -std=gnu99  -O2 -g
>>>>>> -Wp,-D_FORTIFY_SOURCE=0 -Wall -Werror -pthread -fpic -shared -Wl,-x -o %o
>>>>>> %s" (default)
>>>>>> cli_buffer                 8k [bytes] (default)
>>>>>> cli_limit                  48k [bytes] (default)
>>>>>> cli_timeout                60.000 [seconds] (default)
>>>>>> clock_skew                 10 [seconds] (default)
>>>>>> clock_step                 1.000 [seconds] (default)
>>>>>> connect_timeout            3.500 [seconds] (default)
>>>>>> critbit_cooloff            180.000 [seconds] (default)
>>>>>> debug                      none (default)
>>>>>> default_grace              10.000 [seconds] (default)
>>>>>> default_keep               0.000 [seconds] (default)
>>>>>> default_ttl                120.000 [seconds] (default)
>>>>>> feature                    none (default)
>>>>>> fetch_chunksize            16k [bytes] (default)
>>>>>> fetch_maxchunksize         0.25G [bytes] (default)
>>>>>> first_byte_timeout         60.000 [seconds] (default)
>>>>>> gzip_buffer                32k [bytes] (default)
>>>>>> gzip_level                 6 (default)
>>>>>> gzip_memlevel              8 (default)
>>>>>> http_gzip_support          on [bool] (default)
>>>>>> http_max_hdr               64 [header lines] (default)
>>>>>> http_range_support         on [bool] (default)
>>>>>> http_req_hdr_len           8k [bytes] (default)
>>>>>> http_req_size              32k [bytes] (default)
>>>>>> http_resp_hdr_len          8k [bytes] (default)
>>>>>> http_resp_size             32k [bytes] (default)
>>>>>> idle_send_timeout          60.000 [seconds] (default)
>>>>>> listen_depth               1024 [connections] (default)
>>>>>> lru_interval               2.000 [seconds] (default)
>>>>>> max_esi_depth              5 [levels] (default)
>>>>>> max_restarts               4 [restarts] (default)
>>>>>> max_retries                4 [retries] (default)
>>>>>> nuke_limit                 50 [allocations] (default)
>>>>>> pcre_match_limit           10000 (default)
>>>>>> pcre_match_limit_recursion 20 (default)
>>>>>> ping_interval              3 [seconds] (default)
>>>>>> pipe_timeout               60.000 [seconds] (default)
>>>>>> pool_req                   10,100,10 (default)
>>>>>> pool_sess                  10,100,10 (default)
>>>>>> pool_vbo                   10,100,10 (default)
>>>>>> prefer_ipv6                off [bool] (default)
>>>>>> rush_exponent              3 [requests per request] (default)
>>>>>> send_timeout               600.000 [seconds] (default)
>>>>>> session_max                100000 [sessions] (default)
>>>>>> shm_reclen                 255b [bytes] (default)
>>>>>> shortlived                 10.000 [seconds] (default)
>>>>>> sigsegv_handler            on [bool] (default)
>>>>>> syslog_cli_traffic         on [bool] (default)
>>>>>> tcp_fastopen               off [bool] (default)
>>>>>> tcp_keepalive_intvl        75.000 [seconds] (default)
>>>>>> tcp_keepalive_probes       9 [probes] (default)
>>>>>> tcp_keepalive_time         7200.000 [seconds] (default)
>>>>>> thread_pool_add_delay      0.000 [seconds] (default)
>>>>>> thread_pool_destroy_delay  1.000 [seconds] (default)
>>>>>> thread_pool_fail_delay     0.200 [seconds] (default)
>>>>>> thread_pool_max            5000 [threads] (default)
>>>>>> thread_pool_min            100 [threads] (default)
>>>>>> thread_pool_reserve        0 [threads] (default)
>>>>>> thread_pool_stack          48k [bytes] (default)
>>>>>> thread_pool_timeout        300.000 [seconds] (default)
>>>>>> thread_pools               2 [pools] (default)
>>>>>> thread_queue_limit         20 (default)
>>>>>> thread_stats_rate          10 [requests] (default)
>>>>>> timeout_idle               5.000 [seconds] (default)
>>>>>> timeout_linger             0.050 [seconds] (default)
>>>>>> vcc_allow_inline_c         off [bool] (default)
>>>>>> vcc_err_unref              on [bool] (default)
>>>>>> vcc_unsafe_path            on [bool] (default)
>>>>>> vcl_cooldown               600.000 [seconds] (default)
>>>>>> vcl_dir                    /etc/varnish (default)
>>>>>> vmod_dir                   /usr/lib64/varnish/vmods (default)
>>>>>> vsl_buffer                 4k [bytes] (default)
>>>>>> vsl_mask                   -VCL_trace,-WorkThread,-Hash,-VfpAcct
>>>>>> (default)
>>>>>> vsl_reclen                 255b [bytes] (default)
>>>>>> vsl_space                  80M [bytes] (default)
>>>>>> vsm_free_cooldown          60.000 [seconds] (default)
>>>>>> vsm_space                  1M [bytes] (default)
>>>>>> workspace_backend          64k [bytes] (default)
>>>>>> workspace_client           64k [bytes] (default)
>>>>>> workspace_session          0.50k [bytes] (default)
>>>>>> workspace_thread           2k [bytes] (default)
>>>>>>
>>>>>>
>>>>>> --------
>>>>>> Regards,
>>>>>> Junaid
>>>>>>
>>>>>>
>>>>>> On Thu, Sep 20, 2018 at 3:37 PM Dridi Boukelmoune <dridi at varni.sh>
>>>>>> wrote:
>>>>>>
>>>>>>> On Thu, Sep 20, 2018 at 4:14 PM Junaid Mukhtar <
>>>>>>> junaid.mukhtar at gmail.com> wrote:
>>>>>>> >
>>>>>>> > Hi
>>>>>>> >
>>>>>>> > we are in middle of upgrading from varnish 3.0.7 to varnish
>>>>>>> 4.1.10; but unfortunately all of the response times in the performance test
>>>>>>> are indicating an increase of at least 100%
>>>>>>> >
>>>>>>> > We have analyzed the logs and everything but can't get around
>>>>>>> this; the issue is not only for the non-cached pages but it's also
>>>>>>> impacting the cached pages. We are also struggling to analyze it further as
>>>>>>> well, any guidenace as to what we can do in terms of putting debug logging
>>>>>>> in would be helpful.
>>>>>>> >
>>>>>>> > One of the areas we are considering is to output response times,
>>>>>>> but it's proving difficult for me. Any suggestions
>>>>>>>
>>>>>>> Hello,
>>>>>>>
>>>>>>> What is the output of `varnishadm param.show` ?
>>>>>>>
>>>>>>> Dridi
>>>>>>>
>>>>>> _______________________________________________
>>>> varnish-misc mailing list
>>>> varnish-misc at varnish-cache.org
>>>> https://www.varnish-cache.org/lists/mailman/listinfo/varnish-misc
>>>>
>>>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <https://www.varnish-cache.org/lists/pipermail/varnish-misc/attachments/20180926/8956edbc/attachment-0001.html>


More information about the varnish-misc mailing list