Swapping & High Load

Sean Allen sean at monkeysnatchbanana.com
Wed Mar 20 14:39:41 CET 2013


Sorry that last one for the varnish that is doing quite well. Apologies, it
has been a long night of working out performance issue as we scale a new
system.

Here is the correct varnishstat...

client_conn             436982         9.87 Client connections accepted
client_drop                  0         0.00 Connection dropped, no sess/wrk
client_req            10472769       236.62 Client requests received
cache_hit              3132035        70.77 Cache hits
cache_hitpass                0         0.00 Cache hits for pass
cache_miss             7335111       165.73 Cache misses
backend_conn              5874         0.13 Backend conn. success
backend_unhealthy            0         0.00 Backend conn. not attempted
backend_busy                 0         0.00 Backend conn. too many
backend_fail                26         0.00 Backend conn. failures
backend_reuse          7320973       165.41 Backend conn. reuses
backend_toolate           5853         0.13 Backend conn. was closed
backend_recycle        7326845       165.54 Backend conn. recycles
backend_retry                0         0.00 Backend conn. retry
fetch_head                   0         0.00 Fetch head
fetch_length           7288254       164.67 Fetch with Length
fetch_chunked            38586         0.87 Fetch chunked
fetch_eof                    0         0.00 Fetch EOF
fetch_bad                    0         0.00 Fetch had bad headers
fetch_close                  0         0.00 Fetch wanted close
fetch_oldhttp                0         0.00 Fetch pre HTTP/1.1 closed
fetch_zero                   0         0.00 Fetch zero len
fetch_failed                 0         0.00 Fetch failed
fetch_1xx                    0         0.00 Fetch no body (1xx)
fetch_204                    0         0.00 Fetch no body (204)
fetch_304                    0         0.00 Fetch no body (304)
n_sess_mem                 431          .   N struct sess_mem
n_sess                      27          .   N struct sess
n_object                570373          .   N struct object
n_vampireobject              0          .   N unresurrected objects
n_objectcore            570558          .   N struct objectcore
n_objecthead            580322          .   N struct objecthead
n_waitinglist             9800          .   N struct waitinglist
n_vbc                       21          .   N struct vbc
n_wrk                     1000          .   N worker threads
n_wrk_create              1000         0.02 N worker threads created
n_wrk_failed                 0         0.00 N worker threads not created
n_wrk_max                    0         0.00 N worker threads limited
n_wrk_lqueue                 0         0.00 work request queue length
n_wrk_queued                28         0.00 N queued work requests
n_wrk_drop                   0         0.00 N dropped work requests
n_backend                    4          .   N backends
n_expired                12029          .   N expired objects
n_lru_nuked            6738821          .   N LRU nuked objects
n_lru_moved             493769          .   N LRU moved objects
losthdr                      0         0.00 HTTP header overflows
n_objsendfile                0         0.00 Objects sent with sendfile
n_objwrite            10619899       239.95 Objects sent with write
n_objoverflow                0         0.00 Objects overflowing workspace
s_sess                  436982         9.87 Total Sessions
s_req                 10472769       236.62 Total Requests
s_pipe                       0         0.00 Total pipe
s_pass                    5623         0.13 Total pass
s_fetch                7326840       165.54 Total fetch
s_hdrbytes          3022382411     68288.54 Total header bytes
s_bodybytes        86894699524   1963322.70 Total body bytes
sess_closed             322071         7.28 Session Closed
sess_pipeline                0         0.00 Session Pipeline
sess_readahead               0         0.00 Session Read Ahead
sess_linger           10450028       236.11 Session Linger
sess_herd              1123126        25.38 Session herd
shm_records          599992632     13556.40 SHM records
shm_writes            27652580       624.79 SHM writes
shm_flushes                 90         0.00 SHM flushes due to overflow
shm_cont                  5414         0.12 SHM MTX contention
shm_cycles                 210         0.00 SHM cycles through buffer
sms_nreq                 22387         0.51 SMS allocator requests
sms_nobj                     0          .   SMS outstanding allocations
sms_nbytes                   0          .   SMS outstanding bytes
sms_balloc             8824313          .   SMS bytes allocated
sms_bfree              8824313          .   SMS bytes freed
backend_req            7326847       165.54 Backend requests made
n_vcl                        1         0.00 N vcl total
n_vcl_avail                  1         0.00 N vcl available
n_vcl_discard                0         0.00 N vcl discarded
n_ban                     4323          .   N total active bans
n_ban_gone                3013          .   N total gone bans
n_ban_add                 4424         0.10 N new bans added
n_ban_retire               101         0.00 N old bans deleted
n_ban_obj_test          555491        12.55 N objects tested
n_ban_re_test         24192370       546.61 N regexps tested against
n_ban_dups                2857         0.06 N duplicate bans removed
hcb_nolock            10467161       236.50 HCB Lookups without lock
hcb_lock               7325552       165.52 HCB Lookups with lock
hcb_insert             7325552       165.52 HCB Inserts
esi_errors                   0         0.00 ESI parse errors (unlock)
esi_warnings                 0         0.00 ESI parse warnings (unlock)
accept_fail                  0         0.00 Accept failures
client_drop_late             0         0.00 Connection dropped late
uptime                   44259         1.00 Client uptime
dir_dns_lookups              0         0.00 DNS director lookups
dir_dns_failed               0         0.00 DNS director failed lookups
dir_dns_hit                  0         0.00 DNS director cached lookups hit
dir_dns_cache_full           0         0.00 DNS director full dnscache
vmods                        0          .   Loaded VMODs
n_gzip                       0         0.00 Gzip operations
n_gunzip                     0         0.00 Gunzip operations
LCK.sms.creat                1         0.00 Created locks
LCK.sms.destroy              0         0.00 Destroyed locks
LCK.sms.locks            67161         1.52 Lock Operations
LCK.sms.colls                0         0.00 Collisions
LCK.smp.creat                0         0.00 Created locks
LCK.smp.destroy              0         0.00 Destroyed locks
LCK.smp.locks                0         0.00 Lock Operations
LCK.smp.colls                0         0.00 Collisions
LCK.sma.creat                2         0.00 Created locks
LCK.sma.destroy              0         0.00 Destroyed locks
LCK.sma.locks         35695962       806.52 Lock Operations
LCK.sma.colls                0         0.00 Collisions
LCK.smf.creat                0         0.00 Created locks
LCK.smf.destroy              0         0.00 Destroyed locks
LCK.smf.locks                0         0.00 Lock Operations
LCK.smf.colls                0         0.00 Collisions
LCK.hsl.creat                0         0.00 Created locks
LCK.hsl.destroy              0         0.00 Destroyed locks
LCK.hsl.locks                0         0.00 Lock Operations
LCK.hsl.colls                0         0.00 Collisions
LCK.hcb.creat                1         0.00 Created locks
LCK.hcb.destroy              0         0.00 Destroyed locks
LCK.hcb.locks         14080978       318.15 Lock Operations
LCK.hcb.colls                0         0.00 Collisions
LCK.hcl.creat                0         0.00 Created locks
LCK.hcl.destroy              0         0.00 Destroyed locks
LCK.hcl.locks                0         0.00 Lock Operations
LCK.hcl.colls                0         0.00 Collisions
LCK.vcl.creat                1         0.00 Created locks
LCK.vcl.destroy              0         0.00 Destroyed locks
LCK.vcl.locks            20318         0.46 Lock Operations
LCK.vcl.colls                0         0.00 Collisions
LCK.stat.creat               1         0.00 Created locks
LCK.stat.destroy             0         0.00 Destroyed locks
LCK.stat.locks          437385         9.88 Lock Operations
LCK.stat.colls               0         0.00 Collisions
LCK.sessmem.creat            1         0.00 Created locks
LCK.sessmem.destroy            0         0.00 Destroyed locks
LCK.sessmem.locks         439310         9.93 Lock Operations
LCK.sessmem.colls              0         0.00 Collisions
LCK.wstat.creat                1         0.00 Created locks
LCK.wstat.destroy              0         0.00 Destroyed locks
LCK.wstat.locks           659867        14.91 Lock Operations
LCK.wstat.colls                0         0.00 Collisions
LCK.herder.creat               1         0.00 Created locks
LCK.herder.destroy             0         0.00 Destroyed locks
LCK.herder.locks               1         0.00 Lock Operations
LCK.herder.colls               0         0.00 Collisions
LCK.wq.creat                   2         0.00 Created locks
LCK.wq.destroy                 0         0.00 Destroyed locks
LCK.wq.locks             3000715        67.80 Lock Operations
LCK.wq.colls                   0         0.00 Collisions
LCK.objhdr.creat         7325735       165.52 Created locks
LCK.objhdr.destroy       6745408       152.41 Destroyed locks
LCK.objhdr.locks        55415086      1252.06 Lock Operations
LCK.objhdr.colls               0         0.00 Collisions
LCK.exp.creat                  1         0.00 Created locks
LCK.exp.destroy                0         0.00 Destroyed locks
LCK.exp.locks           14134819       319.37 Lock Operations
LCK.exp.colls                  0         0.00 Collisions
LCK.lru.creat                  2         0.00 Created locks
LCK.lru.destroy                0         0.00 Destroyed locks
LCK.lru.locks           14079161       318.11 Lock Operations
LCK.lru.colls                  0         0.00 Collisions
LCK.cli.creat                  1         0.00 Created locks
LCK.cli.destroy                0         0.00 Destroyed locks
LCK.cli.locks              14720         0.33 Lock Operations
LCK.cli.colls                  0         0.00 Collisions
LCK.ban.creat                  1         0.00 Created locks
LCK.ban.destroy                0         0.00 Destroyed locks
LCK.ban.locks           14633724       330.64 Lock Operations
LCK.ban.colls                  0         0.00 Collisions
LCK.vbp.creat                  1         0.00 Created locks
LCK.vbp.destroy                0         0.00 Destroyed locks
LCK.vbp.locks              35291         0.80 Lock Operations
LCK.vbp.colls                  0         0.00 Collisions
LCK.vbe.creat                  1         0.00 Created locks
LCK.vbe.destroy                0         0.00 Destroyed locks
LCK.vbe.locks              11779         0.27 Lock Operations
LCK.vbe.colls                  0         0.00 Collisions
LCK.backend.creat              4         0.00 Created locks
LCK.backend.destroy            0         0.00 Destroyed locks
LCK.backend.locks       14671350       331.49 Lock Operations
LCK.backend.colls              0         0.00 Collisions
SMA.s0.c_req            22055417       498.33 Allocator requests
SMA.s0.c_fail       226907034699   5126799.85 Allocator failures
SMA.s0.c_bytes       62481788970   1411730.70 Bytes allocated
SMA.s0.c_freed       56039342774   1266168.30 Bytes freed
SMA.s0.g_alloc           1143047          .   Allocations outstanding
SMA.s0.g_bytes        6442446196          .   Bytes outstanding
SMA.s0.g_space              4748          .   Bytes available
SMA.Transient.c_req        12052         0.27 Allocator requests
SMA.Transient.c_fail           0         0.00 Allocator failures
SMA.Transient.c_bytes    186420941      4212.05 Bytes allocated
SMA.Transient.c_freed    186420941      4212.05 Bytes freed
SMA.Transient.g_alloc            0          .   Allocations outstanding
SMA.Transient.g_bytes            0          .   Bytes outstanding
SMA.Transient.g_space            0          .   Bytes available
VBE.jobseeker_1(192.168.0.17,,8080).vcls            1          .   VCL
references
VBE.jobseeker_1(192.168.0.17,,8080).happy18446744073709551615          .
Happy health probes
VBE.jobseeker_2(192.168.0.18,,8080).vcls            1          .   VCL
references
VBE.jobseeker_2(192.168.0.18,,8080).happy18446744073709551615          .
Happy health probes
VBE.jobseeker_3(192.168.0.19,,8080).vcls            1          .   VCL
references
VBE.jobseeker_3(192.168.0.19,,8080).happy18446744073709551615          .
Happy health probes
VBE.jobseeker_4(192.168.1.160,,8080).vcls           1          .   VCL
references
VBE.jobseeker_4(192.168.1.160,,8080).happy 18446744073709551615          .
  Happy health probes
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <https://www.varnish-cache.org/lists/pipermail/varnish-misc/attachments/20130320/a548df4b/attachment-0001.html>


More information about the varnish-misc mailing list