[Varnish] #310: WS_Reserve panic + error

[Varnish]

#310: WS_Reserve panic + error
----------------------+-----------------------------------------------------
 Reporter:  sky       |        Owner:  phk                
     Type:  defect    |       Status:  reopened           
 Priority:  normal    |    Milestone:  Varnish 2.1 release
Component:  varnishd  |      Version:  2.1.4              
 Severity:  normal    |   Resolution:                     
 Keywords:            |  
----------------------+-----------------------------------------------------
Changes (by kristian):

  * priority:  lowest => normal
  * status:  closed => reopened
  * version:  trunk => 2.1.4
  * resolution:  invalid =>


Old description:

> Sep  3 00:20:20 varnish2 varnishd[25355]: Child (25376) died signal=6
> Sep  3 00:20:20 varnish2 varnishd[25355]: Child (25376) Panic message:
> Assert error in WS_Reserve(), cache_ws.c line 156:   Condition(ws->r ==
> NULL) not true.  thread = (cache-worker)sp = 0x14a64fc8 {   fd = 1507, id
> = 1507, xid = 684175780,   client = 72.81.232.3:1299,   step = 0x8,
> handling = 0x0,   err_code = 301, err_reason = (null),   ws = 0x14a65038
> {      id = "sess",     {s,f,r,e} = {0x14a65760,,+947,(nil),+32768},   },
> worker = 0x2aaee1db0c10 {     },     vcl = {       srcname = {
> "/home/artur/wikia-beta.vcl",         "Default",       },     },   obj =
> 0x2aabad2f3000 {     refcnt = 3, xid = 676411472,     ws = 0x2aabad2f3028
> {        id = "obj",       {s,f,r,e} =
> {0x2aabad2f3348,,+530,(nil),+31928},     },     http = {       ws =
> 0x2aabad2f3028 {          id = "obj",         {s,f,r,e} =
> {0x2aabad2f3348,,+530,(nil),+31928},       },       hd = {         "Date:
> Tue, 02 Sep 2008 20:44:22 GMT",         "Server: Apache",         "X
> -Powered-By: PHP/5.2.6",         "Content-language: en",
> Sep  3 00:20:20 varnish2 varnishd[25355]: mgt_child_inherit(7, sock)
> Sep  3 00:20:20 varnish2 varnishd[25355]: mgt_child_inherit(8, sock)
> Sep  3 00:20:20 varnish2 varnishd[25355]: mgt_child_inherit(9, cli_in)
> Sep  3 00:20:20 varnish2 varnishd[25355]: mgt_child_inherit(12, cli_out)
> Sep  3 00:20:20 varnish2 varnishd[25355]: child (28791) Started
> Sep  3 00:20:20 varnish2 varnishd[25355]: mgt_child_inherit(9, (null))
> Sep  3 00:20:20 varnish2 varnishd[25355]: mgt_child_inherit(12, (null))
> Sep  3 00:20:20 varnish2 varnishd[25355]: mgt_child_inherit(7, (null))
> Sep  3 00:20:20 varnish2 varnishd[25355]: mgt_child_inherit(8, (null))
> Sep  3 00:20:20 varnish2 varnishd[25355]: Pushing vcls failed:
> dlopen(./vcl.1P9zoqAU.so): ./vcl.1P9zoqAU.so: cannot open shared object
> file: No such file or directory
> Sep  3 00:20:20 varnish2 varnishd[25355]: Child (28791) said Closed fds:
> 5 6 10 11 13 14
> Sep  3 00:20:20 varnish2 varnishd[25355]: Child (28791) said Child starts
> Sep  3 00:20:20 varnish2 varnishd[25355]: Child (28791) said managed to
> mmap 15032385536 bytes of 15032385536
> Sep  3 00:20:20 varnish2 varnishd[25355]: Child (28791) said Ready
>

>
> No core dump seem to have survived.
>
> Any suggestion for what to look for?

New description:

 Sep  3 00:20:20 varnish2 varnishd[25355]: Child (25376) died signal=6
 Sep  3 00:20:20 varnish2 varnishd[25355]: Child (25376) Panic message:
 Assert error in WS_Reserve(), cache_ws.c line 156:   Condition(ws->r ==
 NULL) not true.  thread = (cache-worker)sp = 0x14a64fc8 {   fd = 1507, id
 = 1507, xid = 684175780,   client = 72.81.232.3:1299,   step = 0x8,
 handling = 0x0,   err_code = 301, err_reason = (null),   ws = 0x14a65038 {
 id = "sess",     {s,f,r,e} = {0x14a65760,,+947,(nil),+32768},   },
 worker = 0x2aaee1db0c10 {     },     vcl = {       srcname = {
 "/home/artur/wikia-beta.vcl",         "Default",       },     },   obj =
 0x2aabad2f3000 {     refcnt = 3, xid = 676411472,     ws = 0x2aabad2f3028
 {        id = "obj",       {s,f,r,e} =
 {0x2aabad2f3348,,+530,(nil),+31928},     },     http = {       ws =
 0x2aabad2f3028 {          id = "obj",         {s,f,r,e} =
 {0x2aabad2f3348,,+530,(nil),+31928},       },       hd = {         "Date:
 Tue, 02 Sep 2008 20:44:22 GMT",         "Server: Apache",         "X
 -Powered-By: PHP/5.2.6",         "Content-language: en",
 Sep  3 00:20:20 varnish2 varnishd[25355]: mgt_child_inherit(7, sock)
 Sep  3 00:20:20 varnish2 varnishd[25355]: mgt_child_inherit(8, sock)
 Sep  3 00:20:20 varnish2 varnishd[25355]: mgt_child_inherit(9, cli_in)
 Sep  3 00:20:20 varnish2 varnishd[25355]: mgt_child_inherit(12, cli_out)
 Sep  3 00:20:20 varnish2 varnishd[25355]: child (28791) Started
 Sep  3 00:20:20 varnish2 varnishd[25355]: mgt_child_inherit(9, (null))
 Sep  3 00:20:20 varnish2 varnishd[25355]: mgt_child_inherit(12, (null))
 Sep  3 00:20:20 varnish2 varnishd[25355]: mgt_child_inherit(7, (null))
 Sep  3 00:20:20 varnish2 varnishd[25355]: mgt_child_inherit(8, (null))
 Sep  3 00:20:20 varnish2 varnishd[25355]: Pushing vcls failed:
 dlopen(./vcl.1P9zoqAU.so): ./vcl.1P9zoqAU.so: cannot open shared object
 file: No such file or directory
 Sep  3 00:20:20 varnish2 varnishd[25355]: Child (28791) said Closed fds: 5
 6 10 11 13 14
 Sep  3 00:20:20 varnish2 varnishd[25355]: Child (28791) said Child starts
 Sep  3 00:20:20 varnish2 varnishd[25355]: Child (28791) said managed to
 mmap 15032385536 bytes of 15032385536
 Sep  3 00:20:20 varnish2 varnishd[25355]: Child (28791) said Ready



 No core dump seem to have survived.

 Any suggestion for what to look for?

--

Comment:

 Re-opening this: It's not applicable to trunk, but it is applicable to
 2.1.4 and current 2.1 (ie: soon-to-be 2.1.5). Check committed with r5646 .

 Haven't had a chance to track it for 2.1.

 No practical impact to users who don't use vcl_hit for set obj.http (which
 should be all), but race and assert-issues for those who now do.

-- 
Ticket URL: <http://www.varnish-cache.org/trac/ticket/310#comment:11>
Varnish <http://varnish-cache.org/>
The Varnish HTTP Accelerator