[Varnish] #1670: assert: default_oc_getobj(), storage/stevedore.c line 68

[Varnish]

#1670: assert: default_oc_getobj(), storage/stevedore.c line 68
----------------------+---------------------
 Reporter:  lkarsten  |      Owner:
     Type:  defect    |     Status:  new
 Priority:  normal    |  Milestone:
Component:  varnishd  |    Version:  unknown
 Severity:  normal    |   Keywords:
----------------------+---------------------
 Posting this on behalf of mattrobenolt. Originally reported on IRC.

 {{{
 Last panic at: Sun, 01 Feb 2015 03:40:29 GMT
 Assert error in default_oc_getobj(), storage/stevedore.c line 68:
   Condition(((o))->magic == (0x32851d42)) not true.
 thread = (cache-worker)
 version = varnish-4.0.3-rc2 revision 1b96340
 ident = Linux,3.13.0-43-generic,x86_64,-smalloc,-smalloc,-hcritbit,epoll
 Backtrace:
   0x433d8a: /usr/sbin/varnishd() [0x433d8a]
   0x45853f: /usr/sbin/varnishd() [0x45853f]
   0x41ef24: /usr/sbin/varnishd(EXP_NukeOne+0x194) [0x41ef24]
   0x459148: /usr/sbin/varnishd(STV_alloc+0xe8) [0x459148]
   0x422b0e: /usr/sbin/varnishd(VFP_GetStorage+0x7e) [0x422b0e]
   0x420941: /usr/sbin/varnishd() [0x420941]
   0x436ca1: /usr/sbin/varnishd(Pool_Work_Thread+0x381) [0x436ca1]
   0x449c58: /usr/sbin/varnishd() [0x449c58]
   0x7fbb6d59be9a: /lib/x86_64-linux-gnu/libpthread.so.0(+0x7e9a)
 [0x7fbb6d59be9a]
   0x7fbb6d2c92ed: /lib/x86_64-linux-gnu/libc.so.6(clone+0x6d)
 [0x7fbb6d2c92ed]
   busyobj = 0x7fb5403bd020 {
     ws = 0x7fb5403bd0e0 {
       id = "bo",
       {s,f,r,e} = {0x7fb5403bf008,+2184,(nil),+57368},
     },
 [.. cut ..]
 }}}

 backtrace is redacted by me, I'll add the full panic dump when/if I get
 permission to make it public.

 According to the report, this happened after running for 90 minutes on
 live traffic with ~10kreq/s.

 Martin spent Monday looking at this, but did not find anything conclusive.

-- 
Ticket URL: <https://www.varnish-cache.org/trac/ticket/1670>
Varnish <https://varnish-cache.org/>
The Varnish HTTP Accelerator