<div dir="ltr"><div dir="ltr"><div class="gmail_default" style="font-family:verdana,sans-serif;font-size:small">Interestingly we are seeing a lot of time in WaitingList before going to VCL Fetch<br></div><div class="gmail_default" style="font-family:verdana,sans-serif;font-size:small"><br></div><div class="gmail_default" style="font-family:verdana,sans-serif;font-size:small">- VCL_return hash<br>- VCL_call HASH<br>- VCL_return lookup<br>- Timestamp Waitinglist: 1537973412.501378 2.410131 2.409963<br>- VCL_call MISS<br>- VCL_return fetch<br>- Link bereq 22354816 fetch<br>- Timestamp Fetch: 1537973412.505995 2.414748 0.004617<br><br clear="all"></div><div><div dir="ltr" class="gmail_signature"><font size="2"><span style="font-family:verdana,sans-serif"><br>--------<br>Regards,</span><br style="font-family:verdana,sans-serif"><span style="font-family:verdana,sans-serif">Junaid</span></font><br></div></div><br></div></div><br><div class="gmail_quote"><div dir="ltr">On Wed, Sep 26, 2018 at 9:31 AM Junaid Mukhtar <<a href="mailto:junaid.mukhtar@gmail.com">junaid.mukhtar@gmail.com</a>> wrote:<br></div><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div dir="ltr"><div class="gmail_default" style="font-family:verdana,sans-serif;font-size:small">I totally agree about that. <br></div><div class="gmail_default" style="font-family:verdana,sans-serif;font-size:small"><br></div><div class="gmail_default" style="font-family:verdana,sans-serif;font-size:small">what we have figured out is that during the steady periods of performance tests it run absolutely fine; but as soon as we spike up the traffic (double the normal peak) performance degrades dramatically. <br></div><br><div><div dir="ltr" class="m_-5183516178050472104gmail_signature" data-smartmail="gmail_signature"><font size="2"><span style="font-family:verdana,sans-serif"><br>--------<br>Regards,</span><br style="font-family:verdana,sans-serif"><span style="font-family:verdana,sans-serif">Junaid</span></font><br></div></div><br></div><br><div class="gmail_quote"><div dir="ltr">On Tue, Sep 25, 2018 at 5:17 PM Guillaume Quintard <<a href="mailto:guillaume@varnish-software.com" target="_blank">guillaume@varnish-software.com</a>> wrote:<br></div><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div dir="ltr">without the vcl (and/or logs, but I'm assuming those are even more confidential), that's a tough cookie to debug<br clear="all"><div><div dir="ltr" class="m_-5183516178050472104m_5047070713852652681gmail_signature" data-smartmail="gmail_signature"><div dir="ltr"><div>-- <br></div>Guillaume Quintard<br></div></div></div><br></div><br><div class="gmail_quote"><div dir="ltr">On Mon, Sep 24, 2018 at 10:35 AM Junaid Mukhtar <<a href="mailto:junaid.mukhtar@gmail.com" target="_blank">junaid.mukhtar@gmail.com</a>> wrote:<br></div><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div dir="ltr"><div class="gmail_default" style="font-family:verdana,sans-serif;font-size:small">Hi <br></div><div class="gmail_default" style="font-family:verdana,sans-serif;font-size:small"><br></div><div class="gmail_default" style="font-family:verdana,sans-serif;font-size:small">Apologies but I am not allowed to share the VCL. If there's any other thing like stats etc that might be helpful then do let me know<br></div><div><div dir="ltr" class="m_-5183516178050472104m_5047070713852652681m_2112992832945753989gmail_signature" data-smartmail="gmail_signature"><font size="2"><span style="font-family:verdana,sans-serif"><br>--------<br>Regards,</span><br style="font-family:verdana,sans-serif"><span style="font-family:verdana,sans-serif">Junaid</span></font><br></div></div><br></div><br><div class="gmail_quote"><div dir="ltr">On Fri, Sep 21, 2018 at 4:15 PM Guillaume Quintard <<a href="mailto:guillaume@varnish-software.com" target="_blank">guillaume@varnish-software.com</a>> wrote:<br></div><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div dir="ltr">would you be able to share your vcl?<br clear="all"><div><div dir="ltr" class="m_-5183516178050472104m_5047070713852652681m_2112992832945753989m_7555200581029681930gmail_signature" data-smartmail="gmail_signature"><div dir="ltr"><div>-- <br></div>Guillaume Quintard<br></div></div></div><br></div><br><div class="gmail_quote"><div dir="ltr">On Fri, Sep 21, 2018 at 4:54 PM Junaid Mukhtar <<a href="mailto:junaid.mukhtar@gmail.com" target="_blank">junaid.mukhtar@gmail.com</a>> wrote:<br></div><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div dir="ltr"><div class="gmail_default" style="font-family:verdana,sans-serif;font-size:small">Any help guys; this is really getting to us..... <br></div><div><div dir="ltr" class="m_-5183516178050472104m_5047070713852652681m_2112992832945753989m_7555200581029681930m_-4850563681973212229gmail_signature" data-smartmail="gmail_signature"><font size="2"><span style="font-family:verdana,sans-serif"><br>--------<br>Regards,</span><br style="font-family:verdana,sans-serif"><span style="font-family:verdana,sans-serif">Junaid</span></font><br></div></div><br></div><br><div class="gmail_quote"><div dir="ltr">On Thu, Sep 20, 2018 at 3:57 PM Junaid Mukhtar <<a href="mailto:junaid.mukhtar@gmail.com" target="_blank">junaid.mukhtar@gmail.com</a>> wrote:<br></div><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div dir="ltr"><div dir="ltr"><div dir="ltr"><div dir="ltr"><div dir="ltr" class="m_-5183516178050472104m_5047070713852652681m_2112992832945753989m_7555200581029681930m_-4850563681973212229m_-5887073979918696485gmail_signature"><br><font size="2"><span style="font-family:verdana,sans-serif"></span></font></div><div class="m_-5183516178050472104m_5047070713852652681m_2112992832945753989m_7555200581029681930m_-4850563681973212229m_-5887073979918696485gmail_signature"><font size="2"><span style="font-family:verdana,sans-serif"><span class="gmail_default" style="font-family:verdana,sans-serif;font-size:small">This is what we get in varnishhist</span></span></font></div><div class="m_-5183516178050472104m_5047070713852652681m_2112992832945753989m_7555200581029681930m_-4850563681973212229m_-5887073979918696485gmail_signature"><font size="2"><span style="font-family:verdana,sans-serif"><span class="gmail_default" style="font-family:verdana,sans-serif;font-size:small"><br></span></span></font></div><div class="m_-5183516178050472104m_5047070713852652681m_2112992832945753989m_7555200581029681930m_-4850563681973212229m_-5887073979918696485gmail_signature"><font size="2"><span style="font-family:verdana,sans-serif"><span class="gmail_default" style="font-family:verdana,sans-serif;font-size:small"></span>280_<br></span></font></div><div dir="ltr" class="m_-5183516178050472104m_5047070713852652681m_2112992832945753989m_7555200581029681930m_-4850563681973212229m_-5887073979918696485gmail_signature"><font size="2"><span style="font-family:verdana,sans-serif"><br><br><br> |<br>230_ |<br> |<br> |<br> |<br> |<br>180_ |<br> ||<br> ||<br> |||<br> |||<br>130_ |||<br> |||<br> ||||||<br> ||||||<br> ||||||<br>80_ ||||||<br> |||||| #<br> |||||| ###<br> ||||||| # ###<br> ||||||||| ##### #<br>30_ ||||||||| ########<br> ||||||||| #########<br> |||||||||| ###########<br> |||||||||||| ## # ############# #<br>+---------------------+---------------------+---------------------+---------------------+---------------------+---------------------+---------------------+---------------------+---------------------<br>|1e-6 |1e-5 |1e-4 |1e-3 |1e-2 |1e-1 |1e0 |1e1 |1e2<br></span></font></div><div dir="ltr" class="m_-5183516178050472104m_5047070713852652681m_2112992832945753989m_7555200581029681930m_-4850563681973212229m_-5887073979918696485gmail_signature"><font size="2"><span style="font-family:verdana,sans-serif">--------<br>Regards,</span><br style="font-family:verdana,sans-serif"><span style="font-family:verdana,sans-serif">Junaid</span></font><br></div><br></div></div></div></div><br><div class="gmail_quote"><div dir="ltr">On Thu, Sep 20, 2018 at 3:54 PM Junaid Mukhtar <<a href="mailto:junaid.mukhtar@gmail.com" target="_blank">junaid.mukhtar@gmail.com</a>> wrote:<br></div><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div dir="ltr"><div dir="ltr"><div class="gmail_default" style="font-family:verdana,sans-serif;font-size:small">Below is the output; all of them are default except i was trying to up the threads_pool to 4 but didn't feel any imporvement in performance degradation<br></div><div class="gmail_default" style="font-family:verdana,sans-serif;font-size:small"><br></div><div class="gmail_default" style="font-family:verdana,sans-serif;font-size:small">accept_filter off [bool] (default)<br>acceptor_sleep_decay 0.9 (default)<br>acceptor_sleep_incr 0.000 [seconds] (default)<br>acceptor_sleep_max 0.050 [seconds] (default)<br>auto_restart on [bool] (default)<br>backend_idle_timeout 60.000 [seconds] (default)<br>ban_dups on [bool] (default)<br>ban_lurker_age 60.000 [seconds] (default)<br>ban_lurker_batch 1000 (default)<br>ban_lurker_sleep 0.010 [seconds] (default)<br>between_bytes_timeout 60.000 [seconds] (default)<br>cc_command "exec gcc -std=gnu99 -O2 -g -Wp,-D_FORTIFY_SOURCE=0 -Wall -Werror -pthread -fpic -shared -Wl,-x -o %o %s" (default)<br>cli_buffer 8k [bytes] (default)<br>cli_limit 48k [bytes] (default)<br>cli_timeout 60.000 [seconds] (default)<br>clock_skew 10 [seconds] (default)<br>clock_step 1.000 [seconds] (default)<br>connect_timeout 3.500 [seconds] (default)<br>critbit_cooloff 180.000 [seconds] (default)<br>debug none (default)<br>default_grace 10.000 [seconds] (default)<br>default_keep 0.000 [seconds] (default)<br>default_ttl 120.000 [seconds] (default)<br>feature none (default)<br>fetch_chunksize 16k [bytes] (default)<br>fetch_maxchunksize 0.25G [bytes] (default)<br>first_byte_timeout 60.000 [seconds] (default)<br>gzip_buffer 32k [bytes] (default)<br>gzip_level 6 (default)<br>gzip_memlevel 8 (default)<br>http_gzip_support on [bool] (default)<br>http_max_hdr 64 [header lines] (default)<br>http_range_support on [bool] (default)<br>http_req_hdr_len 8k [bytes] (default)<br>http_req_size 32k [bytes] (default)<br>http_resp_hdr_len 8k [bytes] (default)<br>http_resp_size 32k [bytes] (default)<br>idle_send_timeout 60.000 [seconds] (default)<br>listen_depth 1024 [connections] (default)<br>lru_interval 2.000 [seconds] (default)<br>max_esi_depth 5 [levels] (default)<br>max_restarts 4 [restarts] (default)<br>max_retries 4 [retries] (default)<br>nuke_limit 50 [allocations] (default)<br>pcre_match_limit 10000 (default)<br>pcre_match_limit_recursion 20 (default)<br>ping_interval 3 [seconds] (default)<br>pipe_timeout 60.000 [seconds] (default)<br>pool_req 10,100,10 (default)<br>pool_sess 10,100,10 (default)<br>pool_vbo 10,100,10 (default)<br>prefer_ipv6 off [bool] (default)<br>rush_exponent 3 [requests per request] (default)<br>send_timeout 600.000 [seconds] (default)<br>session_max 100000 [sessions] (default)<br>shm_reclen 255b [bytes] (default)<br>shortlived 10.000 [seconds] (default)<br>sigsegv_handler on [bool] (default)<br>syslog_cli_traffic on [bool] (default)<br>tcp_fastopen off [bool] (default)<br>tcp_keepalive_intvl 75.000 [seconds] (default)<br>tcp_keepalive_probes 9 [probes] (default)<br>tcp_keepalive_time 7200.000 [seconds] (default)<br>thread_pool_add_delay 0.000 [seconds] (default)<br>thread_pool_destroy_delay 1.000 [seconds] (default)<br>thread_pool_fail_delay 0.200 [seconds] (default)<br>thread_pool_max 5000 [threads] (default)<br>thread_pool_min 100 [threads] (default)<br>thread_pool_reserve 0 [threads] (default)<br>thread_pool_stack 48k [bytes] (default)<br>thread_pool_timeout 300.000 [seconds] (default)<br>thread_pools 2 [pools] (default)<br>thread_queue_limit 20 (default)<br>thread_stats_rate 10 [requests] (default)<br>timeout_idle 5.000 [seconds] (default)<br>timeout_linger 0.050 [seconds] (default)<br>vcc_allow_inline_c off [bool] (default)<br>vcc_err_unref on [bool] (default)<br>vcc_unsafe_path on [bool] (default)<br>vcl_cooldown 600.000 [seconds] (default)<br>vcl_dir /etc/varnish (default)<br>vmod_dir /usr/lib64/varnish/vmods (default)<br>vsl_buffer 4k [bytes] (default)<br>vsl_mask -VCL_trace,-WorkThread,-Hash,-VfpAcct (default)<br>vsl_reclen 255b [bytes] (default)<br>vsl_space 80M [bytes] (default)<br>vsm_free_cooldown 60.000 [seconds] (default)<br>vsm_space 1M [bytes] (default)<br>workspace_backend 64k [bytes] (default)<br>workspace_client 64k [bytes] (default)<br>workspace_session 0.50k [bytes] (default)<br>workspace_thread 2k [bytes] (default)<br><br clear="all"></div><div><div dir="ltr" class="m_-5183516178050472104m_5047070713852652681m_2112992832945753989m_7555200581029681930m_-4850563681973212229m_-5887073979918696485m_-5301226210362817593gmail_signature"><font size="2"><span style="font-family:verdana,sans-serif"><br>--------<br>Regards,</span><br style="font-family:verdana,sans-serif"><span style="font-family:verdana,sans-serif">Junaid</span></font><br></div></div><br></div></div><br><div class="gmail_quote"><div dir="ltr">On Thu, Sep 20, 2018 at 3:37 PM Dridi Boukelmoune <dridi@varni.sh> wrote:<br></div><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">On Thu, Sep 20, 2018 at 4:14 PM Junaid Mukhtar <<a href="mailto:junaid.mukhtar@gmail.com" target="_blank">junaid.mukhtar@gmail.com</a>> wrote:<br>
><br>
> Hi<br>
><br>
> we are in middle of upgrading from varnish 3.0.7 to varnish 4.1.10; but unfortunately all of the response times in the performance test are indicating an increase of at least 100%<br>
><br>
> We have analyzed the logs and everything but can't get around this; the issue is not only for the non-cached pages but it's also impacting the cached pages. We are also struggling to analyze it further as well, any guidenace as to what we can do in terms of putting debug logging in would be helpful.<br>
><br>
> One of the areas we are considering is to output response times, but it's proving difficult for me. Any suggestions<br>
<br>
Hello,<br>
<br>
What is the output of `varnishadm param.show` ?<br>
<br>
Dridi<br>
</blockquote></div>
</blockquote></div>
</blockquote></div>
_______________________________________________<br>
varnish-misc mailing list<br>
<a href="mailto:varnish-misc@varnish-cache.org" target="_blank">varnish-misc@varnish-cache.org</a><br>
<a href="https://www.varnish-cache.org/lists/mailman/listinfo/varnish-misc" rel="noreferrer" target="_blank">https://www.varnish-cache.org/lists/mailman/listinfo/varnish-misc</a><br>
</blockquote></div>
</blockquote></div>
</blockquote></div>
</blockquote></div>
</blockquote></div>