[Varnish] #1148: Fryer: Assert error in VRT_r_req_restarts()

[Varnish]

#1148: Fryer: Assert error in VRT_r_req_restarts()
----------------------+-----------------------------------------------------
 Reporter:  kristian  |       Owner:       
     Type:  defect    |      Status:  new  
 Priority:  normal    |   Milestone:       
Component:  varnishd  |     Version:  trunk
 Severity:  normal    |    Keywords:       
----------------------+-----------------------------------------------------
 Only applies to trunk.

 Fryer fails (see: https://www.varnish-cache.org/lists/pipermail/varnish-
 test/2012-June/001084.html)

 Possibly a duplicate of #1147.

 {{{
 2012-06-03 19:36:13 [2, 6]: httperf-lru-nostream-gzip-deflateoff(httperf):
 Starting test
 2012-06-03 19:40:39 WARNING [0,266]: httperf-lru-nostream-gzip-
 deflateoff(httperf): Panic detected. I think!
 2012-06-03 19:40:39 WARNING [0, 0]: httperf-lru-nostream-gzip-
 deflateoff(httperf):
 Last panic at: Sun, 03 Jun 2012 19:38:27 GMT
 Assert error in VRT_r_req_restarts(), cache/cache_vrt_var.c line 365:
   Condition((sp) != NULL) not true.
 thread = (cache-worker)
 ident = Linux,2.6.32-38-generic,x86_64,-smalloc,-smalloc,-hcritbit,epoll
 Backtrace:
   0x431d48: pan_ic+d8
   0x43bbe5: VRT_r_req_restarts+65
   0x7f567bafc3e8: _end+7f567b478c20
   0x4399fb: VCL_recv_method+4b
   0x4164c5: cnt_recv+1e5
   0x41ae1d: CNT_Session+57d
   0x4366cd: ses_pool_task+fd
   0x433552: Pool_Work_Thread+112
   0x4407f8: wrk_thread_real+c8
   0x7f568a06c9ca: _end+7f56899e9202
 sp = 0x7f5680623a20 {
   fd = 21, id = 21, xid = 284089736,
   client = 10.20.100.8 6598,
   step = STP_RECV,
   handling = deliver,
   restarts = 0, esi_level = 0
   ws = 0x7f567c939158 {
     id = "req",
     {s,f,r,e} = {0x7f567c93a730,+488,(nil),+59632},
   },
   http[req] = {
     ws = 0x7f567c939158[req]
       "GET",
       "/0/6/6/8/7/4.html",
       "HTTP/1.1",
       "User-Agent: httperf/0.9.0",
       "Host: 10.20.100.12",
   },
   worker = 0x7f5679ecec60 {
     ws = 0x7f5679ecee20 {
       id = "wrk",
       {s,f,r,e} = {0x7f5679ece450,0x7f5679ece450,(nil),+2048},
     },
   },
     vcl = {
       srcname = {
         "input",
         "Default",
       },
     },
 },




 2012-06-03 19:40:39 WARNING [0, 0]: httperf-lru-nostream-gzip-
 deflateoff(httperf): Varnishstat uptime and measured run-time is too large
 (measured: 263 stat: 132 diff: 131). Did we crash?
 2012-06-03 19:40:40 WARNING [0, 0]: httperf-lru-nostream-gzip-
 deflateoff(httperf): Out of bounds: n_lru_nuked(0) less than lower
 boundary 80000
 2012-06-03 19:40:40 WARNING [0, 0]: httperf-lru-nostream-gzip-
 deflateoff(httperf): Out of bounds: client_req(216621) less than lower
 boundary 1999720
 2012-06-03 19:40:40 [1, 0]: httperf-lru-nostream-gzip-deflateoff(httperf):
 Load:  21:40:40 up 3 days,  8:03,  3 users,  load average: 0.26, 0.65,
 0.36

 2012-06-03 19:40:40 [1, 0]: httperf-lru-nostream-gzip-deflateoff(httperf):
 Test name: httperf-lru-nostream-gzip-deflateoff
 2012-06-03 19:40:40 [1, 0]: httperf-lru-nostream-gzip-deflateoff(httperf):
 Varnish options:
 2012-06-03 19:40:40 [1, 0]: httperf-lru-nostream-gzip-deflateoff(httperf):
 -t=3600
 2012-06-03 19:40:40 [1, 0]: httperf-lru-nostream-gzip-deflateoff(httperf):
 -s=malloc,30M
 2012-06-03 19:40:40 [1, 0]: httperf-lru-nostream-gzip-deflateoff(httperf):
 Varnish parameters:
 2012-06-03 19:40:40 [1, 0]: httperf-lru-nostream-gzip-deflateoff(httperf):
 thread_pool_max=5000
 2012-06-03 19:40:40 [1, 0]: httperf-lru-nostream-gzip-deflateoff(httperf):
 nuke_limit=250
 2012-06-03 19:40:40 [1, 0]: httperf-lru-nostream-gzip-deflateoff(httperf):
 http_gzip_support=on
 2012-06-03 19:40:40 [1, 0]: httperf-lru-nostream-gzip-deflateoff(httperf):
 thread_pool_min=200
 2012-06-03 19:40:40 [1, 0]: httperf-lru-nostream-gzip-deflateoff(httperf):
 Payload size (excludes headers): 10K
 2012-06-03 19:40:40 [1, 0]: httperf-lru-nostream-gzip-deflateoff(httperf):
 Branch: master
 2012-06-03 19:40:40 [1, 0]: httperf-lru-nostream-gzip-deflateoff(httperf):
 Number of clients involved: 24
 2012-06-03 19:40:40 [1, 0]: httperf-lru-nostream-gzip-deflateoff(httperf):
 Type of test: httperf
 2012-06-03 19:40:40 [1, 0]: httperf-lru-nostream-gzip-deflateoff(httperf):
 Test iterations: 1
 2012-06-03 19:40:40 [1, 0]: httperf-lru-nostream-gzip-deflateoff(httperf):
 Runtime: 263 seconds
 2012-06-03 19:40:40 [1, 0]: httperf-lru-nostream-gzip-deflateoff(httperf):
 VCL:
 backend foo {
         .host = "localhost";
         .port = "80";
 }

 sub vcl_fetch {
         set beresp.do_stream = false;
         set beresp.do_gzip = true;
 }

 2012-06-03 19:40:40 [1, 0]: httperf-lru-nostream-gzip-deflateoff(httperf):
 Number of total connections: 200000
 2012-06-03 19:40:40 [1, 0]: httperf-lru-nostream-gzip-deflateoff(httperf):
 Note: connections are subject to rounding when divided among clients.
 Expect slight deviations.
 2012-06-03 19:40:40 [1, 0]: httperf-lru-nostream-gzip-deflateoff(httperf):
 Requests per connection: 10
 2012-06-03 19:40:40 [1, 0]: httperf-lru-nostream-gzip-deflateoff(httperf):
 Extra options to httperf: --wset=1000000,0.1
 2012-06-03 19:40:40 [1, 0]: httperf-lru-nostream-gzip-deflateoff(httperf):
 Httperf command (last client): httperf --hog --timeout 60 --num-calls 10
 --num-conns 8333 --port 8080 --burst-length 10 --client 23/24 --server
 10.20.100.12 --wset=1000000,0.1

 }}}

 This specific test pressures the LRU system but other tests design to
 pressure other aspects (like cold-vs-hot hits) also exhibit the same
 nature.

-- 
Ticket URL: <https://www.varnish-cache.org/trac/ticket/1148>
Varnish <https://varnish-cache.org/>
The Varnish HTTP Accelerator