[Varnish] #1344: Varnish Panic Messages: http_SetH(), Tcheck() in version 2.1.5
Varnish
varnish-bugs at varnish-cache.org
Fri Sep 13 19:36:14 CEST 2013
#1344: Varnish Panic Messages: http_SetH(), Tcheck() in version 2.1.5
----------------------+--------------------
Reporter: zkisling | Type: defect
Status: new | Priority: normal
Milestone: | Component: build
Version: 2.1.5 | Severity: normal
Keywords: |
----------------------+--------------------
Our Varnish expert recently left our organization and we are seeking some
advice on Varnish restarts involving Panic messages found on Varnish
version 2.1.5. We have 3 Varnish servers across our stack all running the
same version. We have discovered Varnish restarts that occur about 10
times an hour due to Panic messages. These panic messages are:
Panic message: Assert error in Tcheck(), cache.h line 747:
Panic message: Assert error in http_SetH(), cache_http.c line 656:
After research we see that these errors have been fixed in Varnish 3.*.*
With our current setup we are looking for options to fix this without
upgrading to Varnish 3.*.*.
varnishstat -1 output:
{{{
client_conn 420639 180.92 Client connections accepted
client_drop 0 0.00 Connection dropped, no sess/wrk
client_req 420638 180.92 Client requests received
cache_hit 636898 273.93 Cache hits
cache_hitpass 654 0.28 Cache hits for pass
cache_miss 61884 26.62 Cache misses
backend_conn 85515 36.78 Backend conn. success
backend_unhealthy 0 0.00 Backend conn. not attempted
backend_busy 0 0.00 Backend conn. too many
backend_fail 0 0.00 Backend conn. failures
backend_reuse 61913 26.63 Backend conn. reuses
backend_toolate 0 0.00 Backend conn. was closed
backend_recycle 61914 26.63 Backend conn. recycles
backend_unused 0 0.00 Backend conn. unused
fetch_head 36 0.02 Fetch head
fetch_length 94274 40.55 Fetch with Length
fetch_chunked 49693 21.37 Fetch chunked
fetch_eof 0 0.00 Fetch EOF
fetch_bad 0 0.00 Fetch had bad headers
fetch_close 3174 1.37 Fetch wanted close
fetch_oldhttp 0 0.00 Fetch pre HTTP/1.1 closed
fetch_zero 0 0.00 Fetch zero len
fetch_failed 0 0.00 Fetch failed
n_sess_mem 103 . N struct sess_mem
n_sess 18446744073709551614 . N struct sess
n_object 60059 . N struct object
n_vampireobject 0 . N unresurrected objects
n_objectcore 60149 . N struct objectcore
n_objecthead 59108 . N struct objecthead
n_smf 0 . N struct smf
n_smf_frag 0 . N small free smf
n_smf_large 0 . N large free smf
n_vbe_conn 2 . N struct vbe_conn
n_wrk 1200 . N worker threads
n_wrk_create 1200 0.52 N worker threads created
n_wrk_failed 0 0.00 N worker threads not created
n_wrk_max 71261 30.65 N worker threads limited
n_wrk_queue 0 0.00 N queued work requests
n_wrk_overflow 141 0.06 N overflowed work requests
n_wrk_drop 0 0.00 N dropped work requests
n_backend 14 . N backends
n_expired 1813 . N expired objects
n_lru_nuked 0 . N LRU nuked objects
n_lru_saved 0 . N LRU saved objects
n_lru_moved 180990 . N LRU moved objects
n_deathrow 0 . N objects on deathrow
losthdr 0 0.00 HTTP header overflows
n_objsendfile 0 0.00 Objects sent with sendfile
n_objwrite 607488 261.29 Objects sent with write
n_objoverflow 0 0.00 Objects overflowing workspace
s_sess 420639 180.92 Total Sessions
s_req 420639 180.92 Total Requests
s_pipe 232 0.10 Total pipe
s_pass 85306 36.69 Total pass
s_fetch 147178 63.30 Total fetch
s_hdrbytes 161409628 69423.50 Total header bytes
s_bodybytes 21518168795 9255126.36 Total body bytes
sess_closed 420639 180.92 Session Closed
sess_pipeline 0 0.00 Session Pipeline
sess_readahead 0 0.00 Session Read Ahead
sess_linger 0 0.00 Session Linger
sess_herd 0 0.00 Session herd
shm_records 29693679 12771.47 SHM records
shm_writes 2373635 1020.92 SHM writes
shm_flushes 0 0.00 SHM flushes due to overflow
shm_cont 4607 1.98 SHM MTX contention
shm_cycles 13 0.01 SHM cycles through buffer
sm_nreq 0 0.00 allocator requests
sm_nobj 0 . outstanding allocations
sm_balloc 0 . bytes allocated
sm_bfree 0 . bytes free
sma_nreq 227407 97.81 SMA allocator requests
sma_nobj 140508 . SMA outstanding allocations
sma_nbytes 6450545316 . SMA outstanding bytes
sma_balloc 9858678676 . SMA bytes allocated
sma_bfree 3408133360 . SMA bytes free
sms_nreq 1048 0.45 SMS allocator requests
sms_nobj 0 . SMS outstanding allocations
sms_nbytes 0 . SMS outstanding bytes
sms_balloc 9542 . SMS bytes allocated
sms_bfree 9542 . SMS bytes freed
backend_req 147196 63.31 Backend requests made
n_vcl 11 0.00 N vcl total
n_vcl_avail 11 0.00 N vcl available
n_vcl_discard 0 0.00 N vcl discarded
n_purge 877 . N total active purges
n_purge_add 1122 0.48 N new purges added
n_purge_retire 245 0.11 N old purges deleted
n_purge_obj_test 160768 69.15 N objects tested
n_purge_re_test 3407768 1465.71 N regexps tested against
n_purge_dups 973 0.42 N duplicate purges removed
hcb_nolock 699433 300.83 HCB Lookups without lock
hcb_lock 59334 25.52 HCB Lookups with lock
hcb_insert 59333 25.52 HCB Inserts
esi_parse 23278 10.01 Objects ESI parsed (unlock)
esi_errors 0 0.00 ESI parse errors (unlock)
accept_fail 0 0.00 Accept failures
client_drop_late 0 0.00 Connection dropped late
uptime 2325 1.00 Client uptime
backend_retry 6 0.00 Backend conn. retry
dir_dns_lookups 0 0.00 DNS director lookups
dir_dns_failed 0 0.00 DNS director failed lookups
dir_dns_hit 0 0.00 DNS director cached lookups hit
dir_dns_cache_full 0 0.00 DNS director full dnscache
fetch_1xx 0 0.00 Fetch no body (1xx)
fetch_204 0 0.00 Fetch no body (204)
fetch_304 0 0.00 Fetch no body (304)
}}}
And log output:
{{{
Panic message: Assert error in http_SetH(), cache_http.c line 656:
Condition((fm) != 0) not true. thread = (cache-worker) ident =
Linux,2.6.18-308.24.1.el5,x86_64,-smalloc,-hcritbit,epoll...
Panic message: Assert error in Tcheck(), cache.h line 747:
Condition((t.b) != 0) not true. thread = (cache-worker) ident =
Linux,2.6.18-308.24.1.el5,x86_64,-smalloc,-hcritbit,epoll...
}}}
--
Ticket URL: <https://www.varnish-cache.org/trac/ticket/1344>
Varnish <https://varnish-cache.org/>
The Varnish HTTP Accelerator
More information about the varnish-bugs
mailing list