[Fryer] master FAIL. 9 of 25 tests succeeded.

fryer at oneiros.varnish-software.com fryer at oneiros.varnish-software.com
Sat Jun 9 00:14:51 CEST 2012


Tests Failed: httperf-lru-nostream-gzip httperf-lru-nostream-gzip-deflateoff httperf-lru-default httperf-lru-stream-default httperf-hot httperf-lru-nostream-nogzip cold-gzip httperf-lru-stream-gzip httperf-lru-stream-nogzip cold-nogzip siege-test httperf-lru-nostream-default httperf-rapid-expire streaming-grace cold-default purge-fail 


Tests OK: streaming memleak 4gpluss-stream 4gpluss basic-fryer 4gpluss-nostream lru-random 4gpluss-nogzip streaming-gzip 



2012-06-08 19:32:18 [1,16]: Server pantoum checked out varnish-3.0.0-beta2-1014-ge75cd2e of branch master
2012-06-08 19:32:42 [2,24]: httperf-lru-nostream-gzip(httperf): Starting test
2012-06-08 19:36:16 WARNING [0,214]: httperf-lru-nostream-gzip(httperf): Panic detected. I think!
2012-06-08 19:36:16 WARNING [0, 0]: httperf-lru-nostream-gzip(httperf): 
Last panic at: Fri, 08 Jun 2012 19:34:46 GMT
Assert error in VCL_recv_method(), ../../include/tbl/vcl_returns.h line 27:
  Condition((req->sp) != NULL) not true.
thread = (cache-worker)
ident = Linux,2.6.32-38-generic,x86_64,-smalloc,-smalloc,-hcritbit,epoll
Backtrace:
  0x431d88: pan_ic+d8
  0x43a3b5: VCL_recv_method+1a5
  0x4164c5: cnt_recv+1e5
  0x41ae1d: CNT_Session+57d
  0x43670d: ses_pool_task+fd
  0x433592: Pool_Work_Thread+112
  0x441128: wrk_thread_real+c8
  0x7f81f28a59ca: _end+7f81f2221202
  0x7f81f2602cdd: _end+7f81f1f7e515
sp = 0x7f81e3404920 {
  fd = 22, id = 22, xid = 1685394060,
  client = 10.20.100.8 11922,
  step = STP_RECV,
  handling = deliver,
  restarts = 0, esi_level = 0
  ws = 0x7f81e28bd158 { 
    id = "req",
    {s,f,r,e} = {0x7f81e28be730,+248,(nil),+59632},
  },
  http[req] = {
    ws = 0x7f81e28bd158[req]
      "GET",
      "/1/2/8/8/7/1.html",
      "HTTP/1.1",
      "User-Agent: httperf/0.9.0",
      "Host: 10.20.100.12",
  },
  worker = 0x7f81e2a02c60 {
    ws = 0x7f81e2a02e20 { 
      id = "wrk",
      {s,f,r,e} = {0x7f81e2a02450,0x7f81e2a02450,(nil),+2048},
    },
  },
    vcl = {
      srcname = {
        "input",
        "Default",
      },
    },
},




2012-06-08 19:36:16 WARNING [0, 0]: httperf-lru-nostream-gzip(httperf): Varnishstat uptime and measured run-time is too large (measured: 210 stat: 89 diff: 121). Did we crash?
2012-06-08 19:36:16 WARNING [0, 0]: httperf-lru-nostream-gzip(httperf): Out of bounds: n_lru_nuked(0) less than lower boundary 80000
2012-06-08 19:36:16 WARNING [0, 0]: httperf-lru-nostream-gzip(httperf): Out of bounds: client_req(282788) less than lower boundary 1989920
2012-06-08 19:36:16 [1, 0]: httperf-lru-nostream-gzip(httperf): Load:  21:36:16 up 8 days,  7:59,  0 users,  load average: 1.18, 1.10, 0.46

2012-06-08 19:36:16 [1, 0]: httperf-lru-nostream-gzip(httperf): Test name: httperf-lru-nostream-gzip
2012-06-08 19:36:16 [1, 0]: httperf-lru-nostream-gzip(httperf): Varnish options: 
2012-06-08 19:36:16 [1, 0]: httperf-lru-nostream-gzip(httperf): -t=3600
2012-06-08 19:36:16 [1, 0]: httperf-lru-nostream-gzip(httperf): -s=malloc,30M
2012-06-08 19:36:16 [1, 0]: httperf-lru-nostream-gzip(httperf): Varnish parameters: 
2012-06-08 19:36:16 [1, 0]: httperf-lru-nostream-gzip(httperf): thread_stats_rate=1
2012-06-08 19:36:16 [1, 0]: httperf-lru-nostream-gzip(httperf): thread_pool_max=5000
2012-06-08 19:36:16 [1, 0]: httperf-lru-nostream-gzip(httperf): nuke_limit=250
2012-06-08 19:36:16 [1, 0]: httperf-lru-nostream-gzip(httperf): http_gzip_support=on
2012-06-08 19:36:16 [1, 0]: httperf-lru-nostream-gzip(httperf): thread_pool_min=200
2012-06-08 19:36:16 [1, 0]: httperf-lru-nostream-gzip(httperf): Payload size (excludes headers): 10K
2012-06-08 19:36:16 [1, 0]: httperf-lru-nostream-gzip(httperf): Branch: master
2012-06-08 19:36:16 [1, 0]: httperf-lru-nostream-gzip(httperf): Number of clients involved: 24
2012-06-08 19:36:16 [1, 0]: httperf-lru-nostream-gzip(httperf): Type of test: httperf
2012-06-08 19:36:16 [1, 0]: httperf-lru-nostream-gzip(httperf): Test iterations: 1
2012-06-08 19:36:16 [1, 0]: httperf-lru-nostream-gzip(httperf): Runtime: 210 seconds
2012-06-08 19:36:16 [1, 0]: httperf-lru-nostream-gzip(httperf): VCL: 
backend foo {
	.host = "localhost";
	.port = "80";
}

sub vcl_fetch {
	set beresp.do_stream = false;
}

2012-06-08 19:36:16 [1, 0]: httperf-lru-nostream-gzip(httperf): Number of total connections: 200000
2012-06-08 19:36:16 [1, 0]: httperf-lru-nostream-gzip(httperf): Note: connections are subject to rounding when divided among clients. Expect slight deviations.
2012-06-08 19:36:16 [1, 0]: httperf-lru-nostream-gzip(httperf): Requests per connection: 10
2012-06-08 19:36:16 [1, 0]: httperf-lru-nostream-gzip(httperf): Extra options to httperf: --wset=1000000,0.1
2012-06-08 19:36:16 [1, 0]: httperf-lru-nostream-gzip(httperf): Httperf command (last client): httperf --hog --timeout 60 --num-calls 10 --num-conns 8333 --port 8080 --burst-length 10 --client 23/24 --server 10.20.100.12 --wset=1000000,0.1
2012-06-08 19:36:23 [2, 6]: httperf-lru-nostream-gzip-deflateoff(httperf): Starting test
2012-06-08 19:40:00 WARNING [0,216]: httperf-lru-nostream-gzip-deflateoff(httperf): Panic detected. I think!
2012-06-08 19:40:00 WARNING [0, 0]: httperf-lru-nostream-gzip-deflateoff(httperf): 
Last panic at: Fri, 08 Jun 2012 19:39:05 GMT
Assert error in VCL_recv_method(), ../../include/tbl/vcl_returns.h line 27:
  Condition((req->sp) != NULL) not true.
thread = (cache-worker)
ident = Linux,2.6.32-38-generic,x86_64,-smalloc,-smalloc,-hcritbit,epoll
Backtrace:
  0x431d88: pan_ic+d8
  0x43a3b5: VCL_recv_method+1a5
  0x4164c5: cnt_recv+1e5
  0x41ae1d: CNT_Session+57d
  0x43670d: ses_pool_task+fd
  0x433592: Pool_Work_Thread+112
  0x441128: wrk_thread_real+c8
  0x7fbe573039ca: _end+7fbe56c7f202
  0x7fbe57060cdd: _end+7fbe569dc515
sp = 0x7fbe4ad0ab20 {
  fd = 20, id = 20, xid = 163967086,
  client = 10.20.100.8 14237,
  step = STP_RECV,
  handling = deliver,
  restarts = 0, esi_level = 0
  ws = 0x7fbe477ac158 { 
    id = "req",
    {s,f,r,e} = {0x7fbe477ad730,+248,(nil),+59632},
  },
  http[req] = {
    ws = 0x7fbe477ac158[req]
      "GET",
      "/1/5/6/9/4/9.html",
      "HTTP/1.1",
      "User-Agent: httperf/0.9.0",
      "Host: 10.20.100.12",
  },
  worker = 0x7fbe4722ec60 {
    ws = 0x7fbe4722ee20 { 
      id = "wrk",
      {s,f,r,e} = {0x7fbe4722e450,0x7fbe4722e450,(nil),+2048},
    },
  },
    vcl = {
      srcname = {
        "input",
        "Default",
      },
    },
},




2012-06-08 19:40:00 WARNING [0, 0]: httperf-lru-nostream-gzip-deflateoff(httperf): Varnishstat uptime and measured run-time is too large (measured: 212 stat: 54 diff: 158). Did we crash?
2012-06-08 19:40:00 WARNING [0, 0]: httperf-lru-nostream-gzip-deflateoff(httperf): Out of bounds: n_lru_nuked(0) less than lower boundary 80000
2012-06-08 19:40:00 WARNING [0, 0]: httperf-lru-nostream-gzip-deflateoff(httperf): Out of bounds: client_req(113130) less than lower boundary 1989920
2012-06-08 19:40:00 [1, 0]: httperf-lru-nostream-gzip-deflateoff(httperf): Load:  21:40:00 up 8 days,  8:02,  0 users,  load average: 0.93, 1.19, 0.64

2012-06-08 19:40:00 [1, 0]: httperf-lru-nostream-gzip-deflateoff(httperf): Test name: httperf-lru-nostream-gzip-deflateoff
2012-06-08 19:40:00 [1, 0]: httperf-lru-nostream-gzip-deflateoff(httperf): Varnish options: 
2012-06-08 19:40:00 [1, 0]: httperf-lru-nostream-gzip-deflateoff(httperf): -t=3600
2012-06-08 19:40:00 [1, 0]: httperf-lru-nostream-gzip-deflateoff(httperf): -s=malloc,30M
2012-06-08 19:40:00 [1, 0]: httperf-lru-nostream-gzip-deflateoff(httperf): Varnish parameters: 
2012-06-08 19:40:00 [1, 0]: httperf-lru-nostream-gzip-deflateoff(httperf): thread_stats_rate=1
2012-06-08 19:40:00 [1, 0]: httperf-lru-nostream-gzip-deflateoff(httperf): thread_pool_max=5000
2012-06-08 19:40:00 [1, 0]: httperf-lru-nostream-gzip-deflateoff(httperf): nuke_limit=250
2012-06-08 19:40:00 [1, 0]: httperf-lru-nostream-gzip-deflateoff(httperf): http_gzip_support=on
2012-06-08 19:40:00 [1, 0]: httperf-lru-nostream-gzip-deflateoff(httperf): thread_pool_min=200
2012-06-08 19:40:00 [1, 0]: httperf-lru-nostream-gzip-deflateoff(httperf): Payload size (excludes headers): 10K
2012-06-08 19:40:00 [1, 0]: httperf-lru-nostream-gzip-deflateoff(httperf): Branch: master
2012-06-08 19:40:00 [1, 0]: httperf-lru-nostream-gzip-deflateoff(httperf): Number of clients involved: 24
2012-06-08 19:40:00 [1, 0]: httperf-lru-nostream-gzip-deflateoff(httperf): Type of test: httperf
2012-06-08 19:40:00 [1, 0]: httperf-lru-nostream-gzip-deflateoff(httperf): Test iterations: 1
2012-06-08 19:40:00 [1, 0]: httperf-lru-nostream-gzip-deflateoff(httperf): Runtime: 212 seconds
2012-06-08 19:40:00 [1, 0]: httperf-lru-nostream-gzip-deflateoff(httperf): VCL: 
backend foo {
	.host = "localhost";
	.port = "80";
}

sub vcl_fetch {
	set beresp.do_stream = false;
	set beresp.do_gzip = true;
}

2012-06-08 19:40:00 [1, 0]: httperf-lru-nostream-gzip-deflateoff(httperf): Number of total connections: 200000
2012-06-08 19:40:00 [1, 0]: httperf-lru-nostream-gzip-deflateoff(httperf): Note: connections are subject to rounding when divided among clients. Expect slight deviations.
2012-06-08 19:40:00 [1, 0]: httperf-lru-nostream-gzip-deflateoff(httperf): Requests per connection: 10
2012-06-08 19:40:00 [1, 0]: httperf-lru-nostream-gzip-deflateoff(httperf): Extra options to httperf: --wset=1000000,0.1
2012-06-08 19:40:00 [1, 0]: httperf-lru-nostream-gzip-deflateoff(httperf): Httperf command (last client): httperf --hog --timeout 60 --num-calls 10 --num-conns 8333 --port 8080 --burst-length 10 --client 23/24 --server 10.20.100.12 --wset=1000000,0.1
2012-06-08 19:40:07 [2, 6]: streaming(httperf): Starting test
2012-06-08 19:43:01 [2,174]: httperf-lru-default(httperf): Starting test
2012-06-08 19:46:36 WARNING [0,214]: httperf-lru-default(httperf): Panic detected. I think!
2012-06-08 19:46:36 WARNING [0, 0]: httperf-lru-default(httperf): 
Last panic at: Fri, 08 Jun 2012 19:45:31 GMT
Assert error in VCL_recv_method(), ../../include/tbl/vcl_returns.h line 27:
  Condition((req->sp) != NULL) not true.
thread = (cache-worker)
ident = Linux,2.6.32-38-generic,x86_64,-smalloc,-smalloc,-hcritbit,epoll
Backtrace:
  0x431d88: pan_ic+d8
  0x43a3b5: VCL_recv_method+1a5
  0x4164c5: cnt_recv+1e5
  0x41ae1d: CNT_Session+57d
  0x43670d: ses_pool_task+fd
  0x433592: Pool_Work_Thread+112
  0x441128: wrk_thread_real+c8
  0x7fcb6edef9ca: _end+7fcb6e76b202
  0x7fcb6eb4ccdd: _end+7fcb6e4c8515
sp = 0x7fcb5e2dfa20 {
  fd = 17, id = 17, xid = 611630915,
  client = 10.20.100.8 13705,
  step = STP_RECV,
  handling = deliver,
  restarts = 0, esi_level = 0
  ws = 0x7fcb5e992158 { 
    id = "req",
    {s,f,r,e} = {0x7fcb5e993730,+248,(nil),+59632},
  },
  http[req] = {
    ws = 0x7fcb5e992158[req]
      "GET",
      "/1/5/2/0/0/1.html",
      "HTTP/1.1",
      "User-Agent: httperf/0.9.0",
      "Host: 10.20.100.12",
  },
  worker = 0x7fcb5ec12c60 {
    ws = 0x7fcb5ec12e20 { 
      id = "wrk",
      {s,f,r,e} = {0x7fcb5ec12450,0x7fcb5ec12450,(nil),+2048},
    },
  },
    vcl = {
      srcname = {
        "input",
        "Default",
      },
    },
},




2012-06-08 19:46:36 WARNING [0, 0]: httperf-lru-default(httperf): Varnishstat uptime and measured run-time is too large (measured: 210 stat: 63 diff: 147). Did we crash?
2012-06-08 19:46:36 WARNING [0, 0]: httperf-lru-default(httperf): Out of bounds: n_lru_nuked(0) less than lower boundary 80000
2012-06-08 19:46:36 WARNING [0, 0]: httperf-lru-default(httperf): Out of bounds: client_req(166850) less than lower boundary 1989920
2012-06-08 19:46:36 [1, 0]: httperf-lru-default(httperf): Load:  21:46:36 up 8 days,  8:09,  0 users,  load average: 0.85, 1.00, 0.71

2012-06-08 19:46:36 [1, 0]: httperf-lru-default(httperf): Test name: httperf-lru-default
2012-06-08 19:46:36 [1, 0]: httperf-lru-default(httperf): Varnish options: 
2012-06-08 19:46:36 [1, 0]: httperf-lru-default(httperf): -t=3600
2012-06-08 19:46:36 [1, 0]: httperf-lru-default(httperf): -s=malloc,30M
2012-06-08 19:46:36 [1, 0]: httperf-lru-default(httperf): Varnish parameters: 
2012-06-08 19:46:36 [1, 0]: httperf-lru-default(httperf): thread_stats_rate=1
2012-06-08 19:46:36 [1, 0]: httperf-lru-default(httperf): thread_pool_max=5000
2012-06-08 19:46:36 [1, 0]: httperf-lru-default(httperf): nuke_limit=250
2012-06-08 19:46:36 [1, 0]: httperf-lru-default(httperf): thread_pool_min=200
2012-06-08 19:46:36 [1, 0]: httperf-lru-default(httperf): Payload size (excludes headers): 10K
2012-06-08 19:46:36 [1, 0]: httperf-lru-default(httperf): Branch: master
2012-06-08 19:46:36 [1, 0]: httperf-lru-default(httperf): Number of clients involved: 24
2012-06-08 19:46:36 [1, 0]: httperf-lru-default(httperf): Type of test: httperf
2012-06-08 19:46:36 [1, 0]: httperf-lru-default(httperf): Test iterations: 1
2012-06-08 19:46:36 [1, 0]: httperf-lru-default(httperf): Runtime: 210 seconds
2012-06-08 19:46:36 [1, 0]: httperf-lru-default(httperf): VCL: 
backend foo {
	.host = "localhost";
	.port = "80";
}

sub vcl_fetch {
	set beresp.do_stream = true;
}

2012-06-08 19:46:36 [1, 0]: httperf-lru-default(httperf): Number of total connections: 200000
2012-06-08 19:46:36 [1, 0]: httperf-lru-default(httperf): Note: connections are subject to rounding when divided among clients. Expect slight deviations.
2012-06-08 19:46:36 [1, 0]: httperf-lru-default(httperf): Requests per connection: 10
2012-06-08 19:46:36 [1, 0]: httperf-lru-default(httperf): Extra options to httperf: --wset=1000000,0.1
2012-06-08 19:46:36 [1, 0]: httperf-lru-default(httperf): Httperf command (last client): httperf --hog --timeout 60 --num-calls 10 --num-conns 8333 --port 8080 --burst-length 10 --client 23/24 --server 10.20.100.12 --wset=1000000,0.1
2012-06-08 19:46:43 [2, 6]: memleak(httperf): Starting test
2012-06-08 19:49:06 [2,143]: 4gpluss-stream(httperf): Starting test
2012-06-08 19:49:09 WARNING [0, 2]: Varnish failed to start. Fallback attempts starting
2012-06-08 19:49:09 [1, 0]: Removed (hopefully incompatible) parameter to try to start varnish. Key: thread_stats_rate=1
2012-06-08 19:49:10 [1, 0]: Removed (hopefully incompatible) parameter to try to start varnish. Key: thread_pool_max=300
2012-06-08 19:49:10 [1, 0]: Removed (hopefully incompatible) parameter to try to start varnish. Key: sess_timeout=60000s
2012-06-08 19:49:11 [1, 0]: Fallback worked. Parameter that seemed to cause problems: sess_timeout
2012-06-08 20:09:24 [2,1213]: httperf-lru-stream-default(httperf): Starting test
2012-06-08 20:12:53 WARNING [0,209]: httperf-lru-stream-default(httperf): Panic detected. I think!
2012-06-08 20:12:53 WARNING [0, 0]: httperf-lru-stream-default(httperf): 
Last panic at: Fri, 08 Jun 2012 20:11:44 GMT
Assert error in VCL_recv_method(), ../../include/tbl/vcl_returns.h line 27:
  Condition((req->sp) != NULL) not true.
thread = (cache-worker)
ident = Linux,2.6.32-38-generic,x86_64,-smalloc,-smalloc,-hcritbit,epoll
Backtrace:
  0x431d88: pan_ic+d8
  0x43a3b5: VCL_recv_method+1a5
  0x4164c5: cnt_recv+1e5
  0x41ae1d: CNT_Session+57d
  0x43670d: ses_pool_task+fd
  0x433592: Pool_Work_Thread+112
  0x441128: wrk_thread_real+c8
  0x7f7335af59ca: _end+7f7335471202
  0x7f7335852cdd: _end+7f73351ce515
sp = 0x7f7329505120 {
  fd = 21, id = 21, xid = 276836532,
  client = 10.20.100.9 13255,
  step = STP_RECV,
  handling = deliver,
  restarts = 0, esi_level = 0
  ws = 0x7f7325a8a158 { 
    id = "req",
    {s,f,r,e} = {0x7f7325a8b730,+248,(nil),+59632},
  },
  http[req] = {
    ws = 0x7f7325a8a158[req]
      "GET",
      "/1/4/7/5/0/5.html",
      "HTTP/1.1",
      "User-Agent: httperf/0.9.0",
      "Host: 10.20.100.12",
  },
  worker = 0x7f7325f7ec60 {
    ws = 0x7f7325f7ee20 { 
      id = "wrk",
      {s,f,r,e} = {0x7f7325f7e450,0x7f7325f7e450,(nil),+2048},
    },
  },
    vcl = {
      srcname = {
        "input",
        "Default",
      },
    },
},




2012-06-08 20:12:53 WARNING [0, 0]: httperf-lru-stream-default(httperf): Varnishstat uptime and measured run-time is too large (measured: 204 stat: 68 diff: 136). Did we crash?
2012-06-08 20:12:54 WARNING [0, 0]: httperf-lru-stream-default(httperf): Out of bounds: n_lru_nuked(0) less than lower boundary 80000
2012-06-08 20:12:54 WARNING [0, 0]: httperf-lru-stream-default(httperf): Out of bounds: client_req(130330) less than lower boundary 1989920
2012-06-08 20:12:54 [1, 0]: httperf-lru-stream-default(httperf): Load:  22:12:54 up 8 days,  8:35,  0 users,  load average: 0.59, 0.78, 0.85

2012-06-08 20:12:54 [1, 0]: httperf-lru-stream-default(httperf): Test name: httperf-lru-stream-default
2012-06-08 20:12:54 [1, 0]: httperf-lru-stream-default(httperf): Varnish options: 
2012-06-08 20:12:54 [1, 0]: httperf-lru-stream-default(httperf): -t=3600
2012-06-08 20:12:54 [1, 0]: httperf-lru-stream-default(httperf): -s=malloc,30M
2012-06-08 20:12:54 [1, 0]: httperf-lru-stream-default(httperf): Varnish parameters: 
2012-06-08 20:12:54 [1, 0]: httperf-lru-stream-default(httperf): thread_stats_rate=1
2012-06-08 20:12:54 [1, 0]: httperf-lru-stream-default(httperf): thread_pool_max=5000
2012-06-08 20:12:54 [1, 0]: httperf-lru-stream-default(httperf): nuke_limit=250
2012-06-08 20:12:54 [1, 0]: httperf-lru-stream-default(httperf): thread_pool_min=200
2012-06-08 20:12:54 [1, 0]: httperf-lru-stream-default(httperf): Payload size (excludes headers): 10K
2012-06-08 20:12:54 [1, 0]: httperf-lru-stream-default(httperf): Branch: master
2012-06-08 20:12:54 [1, 0]: httperf-lru-stream-default(httperf): Number of clients involved: 24
2012-06-08 20:12:54 [1, 0]: httperf-lru-stream-default(httperf): Type of test: httperf
2012-06-08 20:12:54 [1, 0]: httperf-lru-stream-default(httperf): Test iterations: 1
2012-06-08 20:12:54 [1, 0]: httperf-lru-stream-default(httperf): Runtime: 204 seconds
2012-06-08 20:12:54 [1, 0]: httperf-lru-stream-default(httperf): VCL: 
backend foo {
	.host = "localhost";
	.port = "80";
}

sub vcl_fetch {
	set beresp.do_stream = true;
}

2012-06-08 20:12:54 [1, 0]: httperf-lru-stream-default(httperf): Number of total connections: 200000
2012-06-08 20:12:54 [1, 0]: httperf-lru-stream-default(httperf): Note: connections are subject to rounding when divided among clients. Expect slight deviations.
2012-06-08 20:12:54 [1, 0]: httperf-lru-stream-default(httperf): Requests per connection: 10
2012-06-08 20:12:54 [1, 0]: httperf-lru-stream-default(httperf): Extra options to httperf: --wset=1000000,0.1
2012-06-08 20:12:54 [1, 0]: httperf-lru-stream-default(httperf): Httperf command (last client): httperf --hog --timeout 60 --num-calls 10 --num-conns 8333 --port 8080 --burst-length 10 --client 23/24 --server 10.20.100.12 --wset=1000000,0.1
2012-06-08 20:13:01 [2, 6]: httperf-hot(httperf): Starting test
2012-06-08 20:14:03 WARNING [0,62]: httperf-hot(httperf): Panic detected. I think!
2012-06-08 20:14:03 WARNING [0, 0]: httperf-hot(httperf): 
Last panic at: Fri, 08 Jun 2012 20:13:34 GMT
Assert error in VCL_recv_method(), ../../include/tbl/vcl_returns.h line 27:
  Condition((req->sp) != NULL) not true.
thread = (cache-worker)
ident = Linux,2.6.32-38-generic,x86_64,-smalloc,-smalloc,-hcritbit,epoll
Backtrace:
  0x431d88: pan_ic+d8
  0x43a3b5: VCL_recv_method+1a5
  0x4164c5: cnt_recv+1e5
  0x41ae1d: CNT_Session+57d
  0x43670d: ses_pool_task+fd
  0x433592: Pool_Work_Thread+112
  0x441128: wrk_thread_real+c8
  0x7ffc66e919ca: _end+7ffc6680d202
  0x7ffc66beecdd: _end+7ffc6656a515
sp = 0x7ffc57b49f20 {
  fd = 15, id = 15, xid = 67553681,
  client = 10.20.100.8 4421,
  step = STP_RECV,
  handling = deliver,
  restarts = 0, esi_level = 0
  ws = 0x7ffc5cab2158 { 
    id = "req",
    {s,f,r,e} = {0x7ffc5cab3730,+80,(nil),+59632},
  },
  http[req] = {
    ws = 0x7ffc5cab2158[req]
      "GET",
      "/4/6/3.html",
      "HTTP/1.1",
      "User-Agent: httperf/0.9.0",
      "Host: 10.20.100.12",
  },
  worker = 0x7ffc57f85c60 {
    ws = 0x7ffc57f85e20 { 
      id = "wrk",
      {s,f,r,e} = {0x7ffc57f85450,0x7ffc57f85450,(nil),+2048},
    },
  },
    vcl = {
      srcname = {
        "input",
        "Default",
      },
    },
},




2012-06-08 20:14:03 WARNING [0, 0]: httperf-hot(httperf): Out of bounds: client_req(99860) less than lower boundary 989840
2012-06-08 20:14:03 [1, 0]: httperf-hot(httperf): Load:  22:14:03 up 8 days,  8:36,  0 users,  load average: 0.57, 0.73, 0.82

2012-06-08 20:14:03 [1, 0]: httperf-hot(httperf): Test name: httperf-hot
2012-06-08 20:14:03 [1, 0]: httperf-hot(httperf): Varnish options: 
2012-06-08 20:14:03 [1, 0]: httperf-hot(httperf): Varnish parameters: 
2012-06-08 20:14:03 [1, 0]: httperf-hot(httperf): thread_stats_rate=1
2012-06-08 20:14:03 [1, 0]: httperf-hot(httperf): Payload size (excludes headers): 256
2012-06-08 20:14:03 [1, 0]: httperf-hot(httperf): Branch: master
2012-06-08 20:14:03 [1, 0]: httperf-hot(httperf): Number of clients involved: 24
2012-06-08 20:14:03 [1, 0]: httperf-hot(httperf): Type of test: httperf
2012-06-08 20:14:03 [1, 0]: httperf-hot(httperf): Test iterations: 1
2012-06-08 20:14:03 [1, 0]: httperf-hot(httperf): Runtime: 58 seconds
2012-06-08 20:14:03 [1, 0]: httperf-hot(httperf): VCL: 
backend foo {
	.host = "localhost";
	.port = "80";
}

sub vcl_fetch {
	set beresp.do_stream = true;
}

2012-06-08 20:14:03 [1, 0]: httperf-hot(httperf): Number of total connections: 100000
2012-06-08 20:14:03 [1, 0]: httperf-hot(httperf): Note: connections are subject to rounding when divided among clients. Expect slight deviations.
2012-06-08 20:14:03 [1, 0]: httperf-hot(httperf): Requests per connection: 10
2012-06-08 20:14:03 [1, 0]: httperf-hot(httperf): Extra options to httperf: --wset=1000,0.25
2012-06-08 20:14:03 [1, 0]: httperf-hot(httperf): Httperf command (last client): httperf --hog --timeout 60 --num-calls 10 --num-conns 4166 --port 8080 --burst-length 10 --client 23/24 --server 10.20.100.12 --wset=1000,0.25
2012-06-08 20:14:10 [2, 6]: httperf-lru-nostream-nogzip(httperf): Starting test
2012-06-08 20:17:06 WARNING [0,175]: httperf-lru-nostream-nogzip(httperf): Panic detected. I think!
2012-06-08 20:17:06 WARNING [0, 0]: httperf-lru-nostream-nogzip(httperf): 
Last panic at: Fri, 08 Jun 2012 20:16:09 GMT
Assert error in VCL_recv_method(), ../../include/tbl/vcl_returns.h line 27:
  Condition((req->sp) != NULL) not true.
thread = (cache-worker)
ident = Linux,2.6.32-38-generic,x86_64,-smalloc,-smalloc,-hcritbit,epoll
Backtrace:
  0x431d88: pan_ic+d8
  0x43a3b5: VCL_recv_method+1a5
  0x4164c5: cnt_recv+1e5
  0x41ae1d: CNT_Session+57d
  0x43670d: ses_pool_task+fd
  0x433592: Pool_Work_Thread+112
  0x441128: wrk_thread_real+c8
  0x7f58d0b399ca: _end+7f58d04b5202
  0x7f58d0896cdd: _end+7f58d0212515
sp = 0x7f58c1813920 {
  fd = 18, id = 18, xid = 1478023697,
  client = 10.20.100.9 14239,
  step = STP_RECV,
  handling = deliver,
  restarts = 0, esi_level = 0
  ws = 0x7f58c1657158 { 
    id = "req",
    {s,f,r,e} = {0x7f58c1658730,+328,(nil),+59632},
  },
  http[req] = {
    ws = 0x7f58c1657158[req]
      "GET",
      "/1/6/1/7/1/9.html",
      "HTTP/1.1",
      "User-Agent: httperf/0.9.0",
      "Host: 10.20.100.12",
  },
  worker = 0x7f58c0dd2c60 {
    ws = 0x7f58c0dd2e20 { 
      id = "wrk",
      {s,f,r,e} = {0x7f58c0dd2450,0x7f58c0dd2450,(nil),+2048},
    },
  },
    vcl = {
      srcname = {
        "input",
        "Default",
      },
    },
},




2012-06-08 20:17:06 WARNING [0, 0]: httperf-lru-nostream-nogzip(httperf): Varnishstat uptime and measured run-time is too large (measured: 171 stat: 55 diff: 116). Did we crash?
2012-06-08 20:17:06 WARNING [0, 0]: httperf-lru-nostream-nogzip(httperf): Out of bounds: n_lru_nuked(5474) less than lower boundary 80000
2012-06-08 20:17:06 WARNING [0, 0]: httperf-lru-nostream-nogzip(httperf): Out of bounds: client_req(83420) less than lower boundary 1989920
2012-06-08 20:17:06 [1, 0]: httperf-lru-nostream-nogzip(httperf): Load:  22:17:06 up 8 days,  8:40,  0 users,  load average: 1.91, 2.09, 1.39

2012-06-08 20:17:06 [1, 0]: httperf-lru-nostream-nogzip(httperf): Test name: httperf-lru-nostream-nogzip
2012-06-08 20:17:06 [1, 0]: httperf-lru-nostream-nogzip(httperf): Varnish options: 
2012-06-08 20:17:06 [1, 0]: httperf-lru-nostream-nogzip(httperf): -t=3600
2012-06-08 20:17:06 [1, 0]: httperf-lru-nostream-nogzip(httperf): -s=malloc,30M
2012-06-08 20:17:06 [1, 0]: httperf-lru-nostream-nogzip(httperf): Varnish parameters: 
2012-06-08 20:17:06 [1, 0]: httperf-lru-nostream-nogzip(httperf): thread_stats_rate=1
2012-06-08 20:17:06 [1, 0]: httperf-lru-nostream-nogzip(httperf): thread_pool_max=5000
2012-06-08 20:17:06 [1, 0]: httperf-lru-nostream-nogzip(httperf): nuke_limit=250
2012-06-08 20:17:06 [1, 0]: httperf-lru-nostream-nogzip(httperf): http_gzip_support=off
2012-06-08 20:17:06 [1, 0]: httperf-lru-nostream-nogzip(httperf): thread_pool_min=200
2012-06-08 20:17:06 [1, 0]: httperf-lru-nostream-nogzip(httperf): Payload size (excludes headers): 10K
2012-06-08 20:17:06 [1, 0]: httperf-lru-nostream-nogzip(httperf): Branch: master
2012-06-08 20:17:06 [1, 0]: httperf-lru-nostream-nogzip(httperf): Number of clients involved: 24
2012-06-08 20:17:06 [1, 0]: httperf-lru-nostream-nogzip(httperf): Type of test: httperf
2012-06-08 20:17:06 [1, 0]: httperf-lru-nostream-nogzip(httperf): Test iterations: 1
2012-06-08 20:17:06 [1, 0]: httperf-lru-nostream-nogzip(httperf): Runtime: 171 seconds
2012-06-08 20:17:06 [1, 0]: httperf-lru-nostream-nogzip(httperf): VCL: 
backend foo {
	.host = "localhost";
	.port = "80";
}

sub vcl_fetch {
	set beresp.do_stream = false;
}

2012-06-08 20:17:06 [1, 0]: httperf-lru-nostream-nogzip(httperf): Number of total connections: 200000
2012-06-08 20:17:06 [1, 0]: httperf-lru-nostream-nogzip(httperf): Note: connections are subject to rounding when divided among clients. Expect slight deviations.
2012-06-08 20:17:06 [1, 0]: httperf-lru-nostream-nogzip(httperf): Requests per connection: 10
2012-06-08 20:17:06 [1, 0]: httperf-lru-nostream-nogzip(httperf): Extra options to httperf: --wset=1000000,0.1
2012-06-08 20:17:06 [1, 0]: httperf-lru-nostream-nogzip(httperf): Httperf command (last client): httperf --hog --timeout 60 --num-calls 10 --num-conns 8333 --port 8080 --burst-length 10 --client 23/24 --server 10.20.100.12 --wset=1000000,0.1
2012-06-08 20:17:13 [2, 6]: cold-gzip(httperf): Starting test
2012-06-08 20:20:12 WARNING [0,179]: cold-gzip(httperf): Panic detected. I think!
2012-06-08 20:20:12 WARNING [0, 0]: cold-gzip(httperf): 
Last panic at: Fri, 08 Jun 2012 20:18:37 GMT
Assert error in cnt_first(), cache/cache_center.c line 943:
  Condition(req->sp == sp) not true.
thread = (cache-worker)
ident = Linux,2.6.32-38-generic,x86_64,-smalloc,-smalloc,-hcritbit,epoll
Backtrace:
  0x431d88: pan_ic+d8
  0x41b021: CNT_Session+781
  0x43670d: ses_pool_task+fd
  0x433592: Pool_Work_Thread+112
  0x441128: wrk_thread_real+c8
  0x7fac12d239ca: _end+7fac1269f202
  0x7fac12a80cdd: _end+7fac123fc515
sp = 0x7fabfef47d20 {
  fd = 27, id = 27, xid = 0,
  client =  ,
  step = STP_FIRST,
  handling = deliver,
  restarts = 0, esi_level = 0
  ws = 0x7fac01025158 { 
    id = "req",
    {s,f,r,e} = {0x7fac01026730,0x7fac01026730,(nil),+59632},
  },
  http[req] = {
    ws = (nil)[]
  },
  worker = 0x7fac03fe0c60 {
    ws = 0x7fac03fe0e20 { 
      id = "wrk",
      {s,f,r,e} = {0x7fac03fe0450,0x7fac03fe0450,(nil),+2048},
    },
  },
},




2012-06-08 20:20:12 WARNING [0, 0]: cold-gzip(httperf): Varnishstat uptime and measured run-time is too large (measured: 175 stat: 94 diff: 81). Did we crash?
2012-06-08 20:23:34 WARNING [0,201]: cold-gzip(httperf): Panic detected. I think!
2012-06-08 20:23:34 WARNING [0, 0]: cold-gzip(httperf): 
Last panic at: Fri, 08 Jun 2012 20:21:50 GMT
Assert error in cnt_first(), cache/cache_center.c line 943:
  Condition(req->sp == sp) not true.
thread = (cache-worker)
ident = Linux,2.6.32-38-generic,x86_64,-smalloc,-smalloc,-hcritbit,epoll
Backtrace:
  0x431d88: pan_ic+d8
  0x41b021: CNT_Session+781
  0x43670d: ses_pool_task+fd
  0x433592: Pool_Work_Thread+112
  0x441128: wrk_thread_real+c8
  0x7fac12d239ca: _end+7fac1269f202
  0x7fac12a80cdd: _end+7fac123fc515
sp = 0x7fac03e72e20 {
  fd = 30, id = 30, xid = 0,
  client =  ,
  step = STP_FIRST,
  handling = deliver,
  restarts = 0, esi_level = 0
  ws = 0x7fabffa3e158 { 
    id = "req",
    {s,f,r,e} = {0x7fabffa3f730,0x7fabffa3f730,(nil),+59632},
  },
  http[req] = {
    ws = (nil)[]
  },
  worker = 0x7fac03f30c60 {
    ws = 0x7fac03f30e20 { 
      id = "wrk",
      {s,f,r,e} = {0x7fac03f30450,0x7fac03f30450,(nil),+2048},
    },
  },
},




2012-06-08 20:23:34 WARNING [0, 0]: cold-gzip(httperf): Varnishstat uptime and measured run-time is too large (measured: 377 stat: 103 diff: 274). Did we crash?
2012-06-08 20:23:35 WARNING [0, 0]: cold-gzip(httperf): Out of bounds: client_req(248710) less than lower boundary 1589840
2012-06-08 20:23:35 [1, 0]: cold-gzip(httperf): Load:  22:23:35 up 8 days,  8:46,  0 users,  load average: 0.65, 1.17, 1.20

2012-06-08 20:23:35 [1, 0]: cold-gzip(httperf): Test name: cold-gzip
2012-06-08 20:23:35 [1, 0]: cold-gzip(httperf): Varnish options: 
2012-06-08 20:23:35 [1, 0]: cold-gzip(httperf): -t=3600
2012-06-08 20:23:35 [1, 0]: cold-gzip(httperf): -s=malloc,10G
2012-06-08 20:23:35 [1, 0]: cold-gzip(httperf): Varnish parameters: 
2012-06-08 20:23:35 [1, 0]: cold-gzip(httperf): thread_stats_rate=1
2012-06-08 20:23:35 [1, 0]: cold-gzip(httperf): http_gzip_support=on
2012-06-08 20:23:35 [1, 0]: cold-gzip(httperf): Payload size (excludes headers): 256
2012-06-08 20:23:35 [1, 0]: cold-gzip(httperf): Branch: master
2012-06-08 20:23:35 [1, 0]: cold-gzip(httperf): Number of clients involved: 24
2012-06-08 20:23:35 [1, 0]: cold-gzip(httperf): Type of test: httperf
2012-06-08 20:23:35 [1, 0]: cold-gzip(httperf): Test iterations: 2
2012-06-08 20:23:35 [1, 0]: cold-gzip(httperf): Runtime: 377 seconds
2012-06-08 20:23:35 [1, 0]: cold-gzip(httperf): VCL: 
backend foo {
	.host = "localhost";
	.port = "80";
}

sub vcl_fetch {
	set beresp.do_stream = true;
}

2012-06-08 20:23:35 [1, 0]: cold-gzip(httperf): Number of total connections: 80000
2012-06-08 20:23:35 [1, 0]: cold-gzip(httperf): Note: connections are subject to rounding when divided among clients. Expect slight deviations.
2012-06-08 20:23:35 [1, 0]: cold-gzip(httperf): Requests per connection: 10
2012-06-08 20:23:35 [1, 0]: cold-gzip(httperf): Extra options to httperf: --wset=4000000,0.50
2012-06-08 20:23:35 [1, 0]: cold-gzip(httperf): Httperf command (last client): httperf --hog --timeout 60 --num-calls 10 --num-conns 3333 --port 8080 --burst-length 10 --client 23/24 --server 10.20.100.12 --wset=4000000,0.50
2012-06-08 20:23:42 [2, 6]: 4gpluss(httperf): Starting test
2012-06-08 20:23:45 WARNING [0, 2]: Varnish failed to start. Fallback attempts starting
2012-06-08 20:23:45 [1, 0]: Removed (hopefully incompatible) parameter to try to start varnish. Key: thread_stats_rate=1
2012-06-08 20:23:45 [1, 0]: Removed (hopefully incompatible) parameter to try to start varnish. Key: thread_pool_max=300
2012-06-08 20:23:45 [1, 0]: Removed (hopefully incompatible) parameter to try to start varnish. Key: sess_timeout=60000s
2012-06-08 20:23:46 [1, 0]: Fallback worked. Parameter that seemed to cause problems: sess_timeout
2012-06-08 20:45:14 [2,1287]: httperf-lru-stream-gzip(httperf): Starting test
2012-06-08 20:48:46 WARNING [0,211]: httperf-lru-stream-gzip(httperf): Panic detected. I think!
2012-06-08 20:48:46 WARNING [0, 0]: httperf-lru-stream-gzip(httperf): 
Last panic at: Fri, 08 Jun 2012 20:47:17 GMT
Assert error in VCL_fetch_method(), ../../include/tbl/vcl_returns.h line 56:
  Condition((req->sp) != NULL) not true.
thread = (cache-worker)
ident = Linux,2.6.32-38-generic,x86_64,-smalloc,-smalloc,-hcritbit,epoll
Backtrace:
  0x431d88: pan_ic+d8
  0x439875: VCL_fetch_method+1a5
  0x4186a9: cnt_fetch+479
  0x41accd: CNT_Session+42d
  0x43670d: ses_pool_task+fd
  0x433592: Pool_Work_Thread+112
  0x441128: wrk_thread_real+c8
  0x7f490b0199ca: _end+7f490a995202
  0x7f490ad76cdd: _end+7f490a6f2515
sp = 0x7f48fc07f320 {
  fd = 15, id = 15, xid = 174835159,
  client = 10.20.100.9 14224,
  step = STP_FETCH,
  handling = fetch,
  err_code = 200, err_reason = (null),
  restarts = 0, esi_level = 0
  busyobj = 0x7f48fad24020 {
    ws = 0x7f48fad24070 { 
      id = "bo",
      {s,f,r,e} = {0x7f48fad25aa0,+512,(nil),+58752},
    },
    do_stream
    bodystatus = 3 (chunked),
    },
    http[bereq] = {
      ws = 0x7f48fad24070[bo]
        "GET",
        "/1/5/5/8/3/3.html",
        "HTTP/1.1",
        "User-Agent: httperf/0.9.0",
        "Host: 10.20.100.12",
        "X-Forwarded-For: 10.20.100.9",
        "X-Varnish: 174835159",
        "Accept-Encoding: gzip",
    },
    http[beresp] = {
      ws = 0x7f48fad24070[bo]
        "HTTP/1.1",
        "200",
        "OK",
        "Server: nginx/0.7.65",
        "Date: Fri, 08 Jun 2012 20:47:17 GMT",
        "Content-Type: text/plain",
        "Last-Modified: Fri, 08 Jun 2012 20:45:17 GMT",
        "Transfer-Encoding: chunked",
        "Connection: keep-alive",
        "Content-Encoding: gzip",
    },
  ws = 0x7f48fbbed158 { 
    id = "req",
    {s,f,r,e} = {0x7f48fbbee730,+136,(nil),+59632},
  },
  http[req] = {
    ws = 0x7f48fbbed158[req]
      "GET",
      "/1/5/5/8/3/3.html",
      "HTTP/1.1",
      "User-Agent: httperf/0.9.0",
      "Host: 10.20.100.12",
      "X-Forwarded-For: 10.20.100.9",
  },
  worker = 0x7f48fb0f6c60 {
    ws = 0x7f48fb0f6e20 { 
      id = "wrk",
      {s,f,r,e} = {0x7f48fb0f6450,0x7f48fb0f6450,(nil),+2048},
    },
  },
    vcl = {
      srcname = {
        "input",
        "Default",
      },
    },
},




2012-06-08 20:48:46 WARNING [0, 0]: httperf-lru-stream-gzip(httperf): Varnishstat uptime and measured run-time is too large (measured: 207 stat: 87 diff: 120). Did we crash?
2012-06-08 20:48:46 WARNING [0, 0]: httperf-lru-stream-gzip(httperf): Out of bounds: n_lru_nuked(0) less than lower boundary 80000
2012-06-08 20:48:46 WARNING [0, 0]: httperf-lru-stream-gzip(httperf): Out of bounds: client_req(225750) less than lower boundary 1989920
2012-06-08 20:48:46 [1, 0]: httperf-lru-stream-gzip(httperf): Load:  22:48:46 up 8 days,  9:11,  0 users,  load average: 7.32, 5.55, 3.05

2012-06-08 20:48:46 [1, 0]: httperf-lru-stream-gzip(httperf): Test name: httperf-lru-stream-gzip
2012-06-08 20:48:46 [1, 0]: httperf-lru-stream-gzip(httperf): Varnish options: 
2012-06-08 20:48:46 [1, 0]: httperf-lru-stream-gzip(httperf): -t=3600
2012-06-08 20:48:46 [1, 0]: httperf-lru-stream-gzip(httperf): -s=malloc,30M
2012-06-08 20:48:46 [1, 0]: httperf-lru-stream-gzip(httperf): Varnish parameters: 
2012-06-08 20:48:46 [1, 0]: httperf-lru-stream-gzip(httperf): thread_stats_rate=1
2012-06-08 20:48:46 [1, 0]: httperf-lru-stream-gzip(httperf): thread_pool_max=5000
2012-06-08 20:48:46 [1, 0]: httperf-lru-stream-gzip(httperf): nuke_limit=250
2012-06-08 20:48:46 [1, 0]: httperf-lru-stream-gzip(httperf): http_gzip_support=on
2012-06-08 20:48:46 [1, 0]: httperf-lru-stream-gzip(httperf): thread_pool_min=200
2012-06-08 20:48:46 [1, 0]: httperf-lru-stream-gzip(httperf): Payload size (excludes headers): 10K
2012-06-08 20:48:46 [1, 0]: httperf-lru-stream-gzip(httperf): Branch: master
2012-06-08 20:48:46 [1, 0]: httperf-lru-stream-gzip(httperf): Number of clients involved: 24
2012-06-08 20:48:46 [1, 0]: httperf-lru-stream-gzip(httperf): Type of test: httperf
2012-06-08 20:48:46 [1, 0]: httperf-lru-stream-gzip(httperf): Test iterations: 1
2012-06-08 20:48:46 [1, 0]: httperf-lru-stream-gzip(httperf): Runtime: 207 seconds
2012-06-08 20:48:46 [1, 0]: httperf-lru-stream-gzip(httperf): VCL: 
backend foo {
	.host = "localhost";
	.port = "80";
}

sub vcl_fetch {
	set beresp.do_stream = true;
}

2012-06-08 20:48:46 [1, 0]: httperf-lru-stream-gzip(httperf): Number of total connections: 200000
2012-06-08 20:48:46 [1, 0]: httperf-lru-stream-gzip(httperf): Note: connections are subject to rounding when divided among clients. Expect slight deviations.
2012-06-08 20:48:46 [1, 0]: httperf-lru-stream-gzip(httperf): Requests per connection: 10
2012-06-08 20:48:46 [1, 0]: httperf-lru-stream-gzip(httperf): Extra options to httperf: --wset=1000000,0.1
2012-06-08 20:48:46 [1, 0]: httperf-lru-stream-gzip(httperf): Httperf command (last client): httperf --hog --timeout 60 --num-calls 10 --num-conns 8333 --port 8080 --burst-length 10 --client 23/24 --server 10.20.100.12 --wset=1000000,0.1
2012-06-08 20:48:53 [2, 6]: httperf-lru-stream-nogzip(httperf): Starting test
2012-06-08 20:52:02 WARNING [0,189]: httperf-lru-stream-nogzip(httperf): Panic detected. I think!
2012-06-08 20:52:02 WARNING [0, 0]: httperf-lru-stream-nogzip(httperf): 
Last panic at: Fri, 08 Jun 2012 20:51:30 GMT
Assert error in VCL_recv_method(), ../../include/tbl/vcl_returns.h line 27:
  Condition((req->sp) != NULL) not true.
thread = (cache-worker)
ident = Linux,2.6.32-38-generic,x86_64,-smalloc,-smalloc,-hcritbit,epoll
Backtrace:
  0x431d88: pan_ic+d8
  0x43a3b5: VCL_recv_method+1a5
  0x4164c5: cnt_recv+1e5
  0x41ae1d: CNT_Session+57d
  0x43670d: ses_pool_task+fd
  0x433592: Pool_Work_Thread+112
  0x441128: wrk_thread_real+c8
  0x7f12caca39ca: _end+7f12ca61f202
  0x7f12caa00cdd: _end+7f12ca37c515
sp = 0x7f12b8546720 {
  fd = 18, id = 18, xid = 1486593637,
  client = 10.20.100.8 17216,
  step = STP_RECV,
  handling = deliver,
  restarts = 0, esi_level = 0
  ws = 0x7f12ba477158 { 
    id = "req",
    {s,f,r,e} = {0x7f12ba478730,+488,(nil),+59632},
  },
  http[req] = {
    ws = 0x7f12ba477158[req]
      "GET",
      "/1/9/2/7/3/0.html",
      "HTTP/1.1",
      "User-Agent: httperf/0.9.0",
      "Host: 10.20.100.12",
  },
  worker = 0x7f12baca2c60 {
    ws = 0x7f12baca2e20 { 
      id = "wrk",
      {s,f,r,e} = {0x7f12baca2450,0x7f12baca2450,(nil),+2048},
    },
  },
    vcl = {
      srcname = {
        "input",
        "Default",
      },
    },
},




2012-06-08 20:52:02 WARNING [0, 0]: httperf-lru-stream-nogzip(httperf): Varnishstat uptime and measured run-time is too large (measured: 185 stat: 31 diff: 154). Did we crash?
2012-06-08 20:52:02 WARNING [0, 0]: httperf-lru-stream-nogzip(httperf): Out of bounds: n_lru_nuked(1163) less than lower boundary 80000
2012-06-08 20:52:02 WARNING [0, 0]: httperf-lru-stream-nogzip(httperf): Out of bounds: client_req(40290) less than lower boundary 1989920
2012-06-08 20:52:03 [1, 0]: httperf-lru-stream-nogzip(httperf): Load:  22:52:03 up 8 days,  9:14,  0 users,  load average: 1.54, 4.29, 3.10

2012-06-08 20:52:03 [1, 0]: httperf-lru-stream-nogzip(httperf): Test name: httperf-lru-stream-nogzip
2012-06-08 20:52:03 [1, 0]: httperf-lru-stream-nogzip(httperf): Varnish options: 
2012-06-08 20:52:03 [1, 0]: httperf-lru-stream-nogzip(httperf): -t=3600
2012-06-08 20:52:03 [1, 0]: httperf-lru-stream-nogzip(httperf): -s=malloc,30M
2012-06-08 20:52:03 [1, 0]: httperf-lru-stream-nogzip(httperf): Varnish parameters: 
2012-06-08 20:52:03 [1, 0]: httperf-lru-stream-nogzip(httperf): thread_stats_rate=1
2012-06-08 20:52:03 [1, 0]: httperf-lru-stream-nogzip(httperf): thread_pool_max=5000
2012-06-08 20:52:03 [1, 0]: httperf-lru-stream-nogzip(httperf): nuke_limit=250
2012-06-08 20:52:03 [1, 0]: httperf-lru-stream-nogzip(httperf): http_gzip_support=off
2012-06-08 20:52:03 [1, 0]: httperf-lru-stream-nogzip(httperf): thread_pool_min=200
2012-06-08 20:52:03 [1, 0]: httperf-lru-stream-nogzip(httperf): Payload size (excludes headers): 10K
2012-06-08 20:52:03 [1, 0]: httperf-lru-stream-nogzip(httperf): Branch: master
2012-06-08 20:52:03 [1, 0]: httperf-lru-stream-nogzip(httperf): Number of clients involved: 24
2012-06-08 20:52:03 [1, 0]: httperf-lru-stream-nogzip(httperf): Type of test: httperf
2012-06-08 20:52:03 [1, 0]: httperf-lru-stream-nogzip(httperf): Test iterations: 1
2012-06-08 20:52:03 [1, 0]: httperf-lru-stream-nogzip(httperf): Runtime: 185 seconds
2012-06-08 20:52:03 [1, 0]: httperf-lru-stream-nogzip(httperf): VCL: 
backend foo {
	.host = "localhost";
	.port = "80";
}

sub vcl_fetch {
	set beresp.do_stream = true;
}

2012-06-08 20:52:03 [1, 0]: httperf-lru-stream-nogzip(httperf): Number of total connections: 200000
2012-06-08 20:52:03 [1, 0]: httperf-lru-stream-nogzip(httperf): Note: connections are subject to rounding when divided among clients. Expect slight deviations.
2012-06-08 20:52:03 [1, 0]: httperf-lru-stream-nogzip(httperf): Requests per connection: 10
2012-06-08 20:52:03 [1, 0]: httperf-lru-stream-nogzip(httperf): Extra options to httperf: --wset=1000000,0.1
2012-06-08 20:52:03 [1, 0]: httperf-lru-stream-nogzip(httperf): Httperf command (last client): httperf --hog --timeout 60 --num-calls 10 --num-conns 8333 --port 8080 --burst-length 10 --client 23/24 --server 10.20.100.12 --wset=1000000,0.1
2012-06-08 20:52:09 [2, 6]: basic-fryer(httperf): Starting test
2012-06-08 20:52:31 [2,21]: cold-nogzip(httperf): Starting test
2012-06-08 20:55:59 WARNING [0,207]: cold-nogzip(httperf): Panic detected. I think!
2012-06-08 20:55:59 WARNING [0, 0]: cold-nogzip(httperf): 
Last panic at: Fri, 08 Jun 2012 20:54:00 GMT
Assert error in cnt_first(), cache/cache_center.c line 943:
  Condition(req->sp == sp) not true.
thread = (cache-worker)
ident = Linux,2.6.32-38-generic,x86_64,-smalloc,-smalloc,-hcritbit,epoll
Backtrace:
  0x431d88: pan_ic+d8
  0x41b021: CNT_Session+781
  0x43670d: ses_pool_task+fd
  0x433592: Pool_Work_Thread+112
  0x441128: wrk_thread_real+c8
  0x7fb705ae89ca: _end+7fb705464202
  0x7fb705845cdd: _end+7fb7051c1515
sp = 0x7fb6f6c28e20 {
  fd = 17, id = 17, xid = 0,
  client =  ,
  step = STP_FIRST,
  handling = deliver,
  restarts = 0, esi_level = 0
  ws = 0x7fb6f1832158 { 
    id = "req",
    {s,f,r,e} = {0x7fb6f1833730,0x7fb6f1833730,(nil),+59632},
  },
  http[req] = {
    ws = (nil)[]
  },
  worker = 0x7fb6f6dfec60 {
    ws = 0x7fb6f6dfee20 { 
      id = "wrk",
      {s,f,r,e} = {0x7fb6f6dfe450,0x7fb6f6dfe450,(nil),+2048},
    },
  },
},




2012-06-08 20:55:59 WARNING [0, 0]: cold-nogzip(httperf): Varnishstat uptime and measured run-time is too large (measured: 203 stat: 118 diff: 85). Did we crash?
2012-06-08 20:59:22 WARNING [0,202]: cold-nogzip(httperf): Panic detected. I think!
2012-06-08 20:59:22 WARNING [0, 0]: cold-nogzip(httperf): 
Last panic at: Fri, 08 Jun 2012 20:58:23 GMT
Assert error in VCL_fetch_method(), ../../include/tbl/vcl_returns.h line 56:
  Condition((req->sp) != NULL) not true.
thread = (cache-worker)
ident = Linux,2.6.32-38-generic,x86_64,-smalloc,-smalloc,-hcritbit,epoll
Backtrace:
  0x431d88: pan_ic+d8
  0x439875: VCL_fetch_method+1a5
  0x4186a9: cnt_fetch+479
  0x41accd: CNT_Session+42d
  0x43670d: ses_pool_task+fd
  0x433592: Pool_Work_Thread+112
  0x441128: wrk_thread_real+c8
  0x7fb705ae89ca: _end+7fb705464202
  0x7fb705845cdd: _end+7fb7051c1515
sp = 0x7fb6f3617020 {
  fd = 16, id = 16, xid = 568650061,
  client = 10.20.100.9 6175,
  step = STP_FETCH,
  handling = fetch,
  err_code = 200, err_reason = (null),
  restarts = 0, esi_level = 0
  busyobj = 0x7fb6f79a5020 {
    ws = 0x7fb6f79a5070 { 
      id = "bo",
      {s,f,r,e} = {0x7fb6f79a6aa0,+248,(nil),+58752},
    },
    do_stream
    bodystatus = 4 (length),
    },
    http[bereq] = {
      ws = 0x7fb6f79a5070[bo]
        "GET",
        "/0/2/9/6/0/7/0.html",
        "HTTP/1.1",
        "User-Agent: httperf/0.9.0",
        "Host: 10.20.100.12",
        "X-Forwarded-For: 10.20.100.9",
        "X-Varnish: 568650061",
    },
    http[beresp] = {
      ws = 0x7fb6f79a5070[bo]
        "HTTP/1.1",
        "200",
        "OK",
        "Server: nginx/0.7.65",
        "Date: Fri, 08 Jun 2012 20:58:23 GMT",
        "Content-Type: text/plain",
        "Content-Length: 256",
        "Last-Modified: Fri, 08 Jun 2012 20:52:35 GMT",
        "Connection: keep-alive",
        "Accept-Ranges: bytes",
    },
  ws = 0x7fb6f272c158 { 
    id = "req",
    {s,f,r,e} = {0x7fb6f272d730,+216,(nil),+59632},
  },
  http[req] = {
    ws = 0x7fb6f272c158[req]
      "GET",
      "/0/2/9/6/0/7/0.html",
      "HTTP/1.1",
      "User-Agent: httperf/0.9.0",
      "Host: 10.20.100.12",
      "X-Forwarded-For: 10.20.100.9",
  },
  worker = 0x7fb6f6686c60 {
    ws = 0x7fb6f6686e20 { 
      id = "wrk",
      {s,f,r,e} = {0x7fb6f6686450,0x7fb6f6686450,(nil),+2048},
    },
  },
    vcl = {
      srcname = {
        "input",
        "Default",
      },
    },
},




2012-06-08 20:59:22 WARNING [0, 0]: cold-nogzip(httperf): Varnishstat uptime and measured run-time is too large (measured: 406 stat: 58 diff: 348). Did we crash?
2012-06-08 20:59:22 WARNING [0, 0]: cold-nogzip(httperf): Out of bounds: uptime(58) less than lower boundary 100
2012-06-08 20:59:22 WARNING [0, 0]: cold-nogzip(httperf): Out of bounds: client_req(55000) less than lower boundary 1589840
2012-06-08 20:59:22 [1, 0]: cold-nogzip(httperf): Load:  22:59:22 up 8 days,  9:22,  0 users,  load average: 0.58, 1.47, 2.16

2012-06-08 20:59:22 [1, 0]: cold-nogzip(httperf): Test name: cold-nogzip
2012-06-08 20:59:22 [1, 0]: cold-nogzip(httperf): Varnish options: 
2012-06-08 20:59:22 [1, 0]: cold-nogzip(httperf): -t=3600
2012-06-08 20:59:22 [1, 0]: cold-nogzip(httperf): -s=malloc,10G
2012-06-08 20:59:22 [1, 0]: cold-nogzip(httperf): Varnish parameters: 
2012-06-08 20:59:22 [1, 0]: cold-nogzip(httperf): thread_stats_rate=1
2012-06-08 20:59:22 [1, 0]: cold-nogzip(httperf): http_gzip_support=off
2012-06-08 20:59:22 [1, 0]: cold-nogzip(httperf): Payload size (excludes headers): 256
2012-06-08 20:59:22 [1, 0]: cold-nogzip(httperf): Branch: master
2012-06-08 20:59:22 [1, 0]: cold-nogzip(httperf): Number of clients involved: 24
2012-06-08 20:59:22 [1, 0]: cold-nogzip(httperf): Type of test: httperf
2012-06-08 20:59:22 [1, 0]: cold-nogzip(httperf): Test iterations: 2
2012-06-08 20:59:22 [1, 0]: cold-nogzip(httperf): Runtime: 406 seconds
2012-06-08 20:59:22 [1, 0]: cold-nogzip(httperf): VCL: 
backend foo {
	.host = "localhost";
	.port = "80";
}

sub vcl_fetch {
	set beresp.do_stream = true;
}

2012-06-08 20:59:22 [1, 0]: cold-nogzip(httperf): Number of total connections: 80000
2012-06-08 20:59:22 [1, 0]: cold-nogzip(httperf): Note: connections are subject to rounding when divided among clients. Expect slight deviations.
2012-06-08 20:59:22 [1, 0]: cold-nogzip(httperf): Requests per connection: 10
2012-06-08 20:59:22 [1, 0]: cold-nogzip(httperf): Extra options to httperf: --wset=4000000,0.50
2012-06-08 20:59:22 [1, 0]: cold-nogzip(httperf): Httperf command (last client): httperf --hog --timeout 60 --num-calls 10 --num-conns 3333 --port 8080 --burst-length 10 --client 23/24 --server 10.20.100.12 --wset=4000000,0.50
2012-06-08 20:59:29 [2, 6]: 4gpluss-nostream(httperf): Starting test
2012-06-08 20:59:32 WARNING [0, 2]: Varnish failed to start. Fallback attempts starting
2012-06-08 20:59:32 [1, 0]: Removed (hopefully incompatible) parameter to try to start varnish. Key: thread_stats_rate=1
2012-06-08 20:59:33 [1, 0]: Removed (hopefully incompatible) parameter to try to start varnish. Key: thread_pool_max=300
2012-06-08 20:59:33 [1, 0]: Removed (hopefully incompatible) parameter to try to start varnish. Key: sess_timeout=60000s
2012-06-08 20:59:34 [1, 0]: Fallback worked. Parameter that seemed to cause problems: sess_timeout
2012-06-08 21:19:31 [2,1197]: lru-random(httperf): Starting test
2012-06-08 21:31:09 [2,698]: siege-test(siege): Starting test
2012-06-08 21:31:32 WARNING [0,22]: siege-test(siege): Panic detected. I think!
2012-06-08 21:31:32 WARNING [0, 0]: siege-test(siege): 
Last panic at: Fri, 08 Jun 2012 21:31:15 GMT
Assert error in VCL_hash_method(), ../../include/tbl/vcl_returns.h line 39:
  Condition((req->sp) != NULL) not true.
thread = (cache-worker)
ident = Linux,2.6.32-38-generic,x86_64,-smalloc,-smalloc,-hcritbit,epoll
Backtrace:
  0x431d88: pan_ic+d8
  0x439e15: VCL_hash_method+1a5
  0x4164fe: cnt_recv+21e
  0x41ae1d: CNT_Session+57d
  0x43670d: ses_pool_task+fd
  0x433592: Pool_Work_Thread+112
  0x441128: wrk_thread_real+c8
  0x7f23575269ca: _end+7f2356ea2202
  0x7f2357283cdd: _end+7f2356bff515
sp = 0x7f2348203520 {
  fd = 15, id = 15, xid = 63063706,
  client = 10.20.100.7 50973,
  step = STP_RECV,
  handling = lookup,
  restarts = 0, esi_level = 0
  ws = 0x7f2348313158 { 
    id = "req",
    {s,f,r,e} = {0x7f2348314730,+200,(nil),+59632},
  },
  http[req] = {
    ws = 0x7f2348313158[req]
      "GET",
      "/",
      "HTTP/1.1",
      "Host: 10.20.100.12:8080",
      "Accept: */*",
      "User-Agent: JoeDog/1.00 [en] (X11; I; Siege 2.66)",
      "Connection: close",
      "X-Forwarded-For: 10.20.100.7",
      "Accept-Encoding: gzip",
  },
  worker = 0x7f23489fcc60 {
    ws = 0x7f23489fce20 { 
      id = "wrk",
      {s,f,r,e} = {0x7f23489fc450,0x7f23489fc450,(nil),+2048},
    },
  },
    vcl = {
      srcname = {
        "input",
        "Default",
      },
    },
},




2012-06-08 21:31:32 [1, 0]: siege-test(siege): Load:  23:31:32 up 8 days,  9:54,  0 users,  load average: 0.16, 0.53, 0.78

2012-06-08 21:31:32 [1, 0]: siege-test(siege): Test name: siege-test
2012-06-08 21:31:32 [1, 0]: siege-test(siege): Varnish options: 
2012-06-08 21:31:32 [1, 0]: siege-test(siege): Varnish parameters: 
2012-06-08 21:31:32 [1, 0]: siege-test(siege): thread_stats_rate=1
2012-06-08 21:31:32 [1, 0]: siege-test(siege): Payload size (excludes headers): 256
2012-06-08 21:31:32 [1, 0]: siege-test(siege): Branch: master
2012-06-08 21:31:32 [1, 0]: siege-test(siege): Number of clients involved: 0
2012-06-08 21:31:32 [1, 0]: siege-test(siege): Type of test: siege
2012-06-08 21:31:32 [1, 0]: siege-test(siege): Test iterations: 1
2012-06-08 21:31:32 [1, 0]: siege-test(siege): Runtime: 18 seconds
2012-06-08 21:31:32 [1, 0]: siege-test(siege): VCL: 
backend foo {
	.host = "localhost";
	.port = "80";
}

sub vcl_fetch {
	set beresp.do_stream = true;
}

2012-06-08 21:31:39 [2, 6]: httperf-lru-nostream-default(httperf): Starting test
2012-06-08 21:35:09 WARNING [0,210]: httperf-lru-nostream-default(httperf): Panic detected. I think!
2012-06-08 21:35:09 WARNING [0, 0]: httperf-lru-nostream-default(httperf): 
Last panic at: Fri, 08 Jun 2012 21:33:45 GMT
Assert error in VCL_recv_method(), ../../include/tbl/vcl_returns.h line 27:
  Condition((req->sp) != NULL) not true.
thread = (cache-worker)
ident = Linux,2.6.32-38-generic,x86_64,-smalloc,-smalloc,-hcritbit,epoll
Backtrace:
  0x431d88: pan_ic+d8
  0x43a3b5: VCL_recv_method+1a5
  0x4164c5: cnt_recv+1e5
  0x41ae1d: CNT_Session+57d
  0x43670d: ses_pool_task+fd
  0x433592: Pool_Work_Thread+112
  0x441128: wrk_thread_real+c8
  0x7ff803bc59ca: _end+7ff803541202
  0x7ff803922cdd: _end+7ff80329e515
sp = 0x7ff7fa239b20 {
  fd = 19, id = 19, xid = 539475646,
  client = 10.20.100.8 16603,
  step = STP_RECV,
  handling = deliver,
  restarts = 0, esi_level = 0
  ws = 0x7ff7f3553158 { 
    id = "req",
    {s,f,r,e} = {0x7ff7f3554730,+248,(nil),+59632},
  },
  http[req] = {
    ws = 0x7ff7f3553158[req]
      "GET",
      "/1/8/2/0/7/2.html",
      "HTTP/1.1",
      "User-Agent: httperf/0.9.0",
      "Host: 10.20.100.12",
  },
  worker = 0x7ff7f3b3ac60 {
    ws = 0x7ff7f3b3ae20 { 
      id = "wrk",
      {s,f,r,e} = {0x7ff7f3b3a450,0x7ff7f3b3a450,(nil),+2048},
    },
  },
    vcl = {
      srcname = {
        "input",
        "Default",
      },
    },
},




2012-06-08 21:35:09 WARNING [0, 0]: httperf-lru-nostream-default(httperf): Varnishstat uptime and measured run-time is too large (measured: 206 stat: 83 diff: 123). Did we crash?
2012-06-08 21:35:09 WARNING [0, 0]: httperf-lru-nostream-default(httperf): Out of bounds: n_lru_nuked(0) less than lower boundary 80000
2012-06-08 21:35:09 WARNING [0, 0]: httperf-lru-nostream-default(httperf): Out of bounds: client_req(113140) less than lower boundary 1989920
2012-06-08 21:35:09 [1, 0]: httperf-lru-nostream-default(httperf): Load:  23:35:09 up 8 days,  9:58,  0 users,  load average: 0.83, 0.80, 0.84

2012-06-08 21:35:09 [1, 0]: httperf-lru-nostream-default(httperf): Test name: httperf-lru-nostream-default
2012-06-08 21:35:09 [1, 0]: httperf-lru-nostream-default(httperf): Varnish options: 
2012-06-08 21:35:09 [1, 0]: httperf-lru-nostream-default(httperf): -t=3600
2012-06-08 21:35:09 [1, 0]: httperf-lru-nostream-default(httperf): -s=malloc,30M
2012-06-08 21:35:09 [1, 0]: httperf-lru-nostream-default(httperf): Varnish parameters: 
2012-06-08 21:35:09 [1, 0]: httperf-lru-nostream-default(httperf): thread_stats_rate=1
2012-06-08 21:35:09 [1, 0]: httperf-lru-nostream-default(httperf): thread_pool_max=5000
2012-06-08 21:35:09 [1, 0]: httperf-lru-nostream-default(httperf): nuke_limit=250
2012-06-08 21:35:09 [1, 0]: httperf-lru-nostream-default(httperf): thread_pool_min=200
2012-06-08 21:35:09 [1, 0]: httperf-lru-nostream-default(httperf): Payload size (excludes headers): 10K
2012-06-08 21:35:09 [1, 0]: httperf-lru-nostream-default(httperf): Branch: master
2012-06-08 21:35:09 [1, 0]: httperf-lru-nostream-default(httperf): Number of clients involved: 24
2012-06-08 21:35:09 [1, 0]: httperf-lru-nostream-default(httperf): Type of test: httperf
2012-06-08 21:35:09 [1, 0]: httperf-lru-nostream-default(httperf): Test iterations: 1
2012-06-08 21:35:09 [1, 0]: httperf-lru-nostream-default(httperf): Runtime: 206 seconds
2012-06-08 21:35:09 [1, 0]: httperf-lru-nostream-default(httperf): VCL: 
backend foo {
	.host = "localhost";
	.port = "80";
}

sub vcl_fetch {
	set beresp.do_stream = false;
}

2012-06-08 21:35:09 [1, 0]: httperf-lru-nostream-default(httperf): Number of total connections: 200000
2012-06-08 21:35:09 [1, 0]: httperf-lru-nostream-default(httperf): Note: connections are subject to rounding when divided among clients. Expect slight deviations.
2012-06-08 21:35:09 [1, 0]: httperf-lru-nostream-default(httperf): Requests per connection: 10
2012-06-08 21:35:09 [1, 0]: httperf-lru-nostream-default(httperf): Extra options to httperf: --wset=1000000,0.1
2012-06-08 21:35:09 [1, 0]: httperf-lru-nostream-default(httperf): Httperf command (last client): httperf --hog --timeout 60 --num-calls 10 --num-conns 8333 --port 8080 --burst-length 10 --client 23/24 --server 10.20.100.12 --wset=1000000,0.1
2012-06-08 21:35:16 [2, 6]: httperf-rapid-expire(httperf): Starting test
2012-06-08 21:36:19 WARNING [0,63]: httperf-rapid-expire(httperf): Panic detected. I think!
2012-06-08 21:36:19 WARNING [0, 0]: httperf-rapid-expire(httperf): 
Last panic at: Fri, 08 Jun 2012 21:35:51 GMT
Assert error in VCL_recv_method(), ../../include/tbl/vcl_returns.h line 27:
  Condition((req->sp) != NULL) not true.
thread = (cache-worker)
ident = Linux,2.6.32-38-generic,x86_64,-smalloc,-smalloc,-hcritbit,epoll
Backtrace:
  0x431d88: pan_ic+d8
  0x43a3b5: VCL_recv_method+1a5
  0x4164c5: cnt_recv+1e5
  0x41ae1d: CNT_Session+57d
  0x43670d: ses_pool_task+fd
  0x433592: Pool_Work_Thread+112
  0x441128: wrk_thread_real+c8
  0x7fd06988b9ca: _end+7fd069207202
  0x7fd0695e8cdd: _end+7fd068f64515
sp = 0x7fd05a408f20 {
  fd = 22, id = 22, xid = 1025309369,
  client = 10.20.100.8 8452,
  step = STP_RECV,
  handling = deliver,
  restarts = 0, esi_level = 0
  ws = 0x7fd05a8ae158 { 
    id = "req",
    {s,f,r,e} = {0x7fd05a8af730,+224,(nil),+59632},
  },
  http[req] = {
    ws = 0x7fd05a8ae158[req]
      "GET",
      "/0/6.html",
      "HTTP/1.1",
      "User-Agent: httperf/0.9.0",
      "Host: 10.20.100.12",
  },
  worker = 0x7fd05ac38c60 {
    ws = 0x7fd05ac38e20 { 
      id = "wrk",
      {s,f,r,e} = {0x7fd05ac38450,0x7fd05ac38450,(nil),+2048},
    },
  },
    vcl = {
      srcname = {
        "input",
        "Default",
      },
    },
},




2012-06-08 21:36:19 WARNING [0, 0]: httperf-rapid-expire(httperf): Varnishstat uptime and measured run-time is too large (measured: 59 stat: 28 diff: 31). Did we crash?
2012-06-08 21:36:20 WARNING [0, 0]: httperf-rapid-expire(httperf): Out of bounds: client_req(81620) less than lower boundary 989840
2012-06-08 21:36:20 [1, 0]: httperf-rapid-expire(httperf): Load:  23:36:20 up 8 days,  9:59,  0 users,  load average: 0.66, 0.78, 0.83

2012-06-08 21:36:20 [1, 0]: httperf-rapid-expire(httperf): Test name: httperf-rapid-expire
2012-06-08 21:36:20 [1, 0]: httperf-rapid-expire(httperf): Varnish options: 
2012-06-08 21:36:20 [1, 0]: httperf-rapid-expire(httperf): -t=2
2012-06-08 21:36:20 [1, 0]: httperf-rapid-expire(httperf): Varnish parameters: 
2012-06-08 21:36:20 [1, 0]: httperf-rapid-expire(httperf): thread_stats_rate=1
2012-06-08 21:36:20 [1, 0]: httperf-rapid-expire(httperf): Payload size (excludes headers): 256
2012-06-08 21:36:20 [1, 0]: httperf-rapid-expire(httperf): Branch: master
2012-06-08 21:36:20 [1, 0]: httperf-rapid-expire(httperf): Number of clients involved: 24
2012-06-08 21:36:20 [1, 0]: httperf-rapid-expire(httperf): Type of test: httperf
2012-06-08 21:36:20 [1, 0]: httperf-rapid-expire(httperf): Test iterations: 1
2012-06-08 21:36:20 [1, 0]: httperf-rapid-expire(httperf): Runtime: 59 seconds
2012-06-08 21:36:20 [1, 0]: httperf-rapid-expire(httperf): VCL: 
backend foo {
	.host = "localhost";
	.port = "80";
}

sub vcl_fetch {
	set beresp.do_stream = true;
}

2012-06-08 21:36:20 [1, 0]: httperf-rapid-expire(httperf): Number of total connections: 100000
2012-06-08 21:36:20 [1, 0]: httperf-rapid-expire(httperf): Note: connections are subject to rounding when divided among clients. Expect slight deviations.
2012-06-08 21:36:20 [1, 0]: httperf-rapid-expire(httperf): Requests per connection: 10
2012-06-08 21:36:20 [1, 0]: httperf-rapid-expire(httperf): Extra options to httperf: --wset=100,0.30
2012-06-08 21:36:20 [1, 0]: httperf-rapid-expire(httperf): Httperf command (last client): httperf --hog --timeout 60 --num-calls 10 --num-conns 4166 --port 8080 --burst-length 10 --client 23/24 --server 10.20.100.12 --wset=100,0.30
2012-06-08 21:36:27 [2, 6]: streaming-grace(httperf): Starting test
2012-06-08 21:39:21 WARNING [0,174]: streaming-grace(httperf): Panic detected. I think!
2012-06-08 21:39:21 WARNING [0, 0]: streaming-grace(httperf): 
Last panic at: Fri, 08 Jun 2012 21:38:22 GMT
Assert error in VCL_recv_method(), ../../include/tbl/vcl_returns.h line 27:
  Condition((req->sp) != NULL) not true.
thread = (cache-worker)
ident = Linux,2.6.32-38-generic,x86_64,-smalloc,-smalloc,-hcritbit,epoll
Backtrace:
  0x431d88: pan_ic+d8
  0x43a3b5: VCL_recv_method+1a5
  0x4164c5: cnt_recv+1e5
  0x41ae1d: CNT_Session+57d
  0x43670d: ses_pool_task+fd
  0x433592: Pool_Work_Thread+112
  0x441128: wrk_thread_real+c8
  0x7f3e0f8339ca: _end+7f3e0f1af202
  0x7f3e0f590cdd: _end+7f3e0ef0c515
sp = 0x7f3dff30a120 {
  fd = 499, id = 499, xid = 685311811,
  client = 10.20.100.9 6153,
  step = STP_RECV,
  handling = deliver,
  restarts = 0, esi_level = 0
  ws = 0x7f3dfb013158 { 
    id = "req",
    {s,f,r,e} = {0x7f3dfb014730,+80,(nil),+59632},
  },
  http[req] = {
    ws = 0x7f3dfb013158[req]
      "GET",
      "/7/9/9.html",
      "HTTP/1.1",
      "User-Agent: httperf/0.9.0",
      "Host: 10.20.100.12",
  },
  worker = 0x7f3e02b68c60 {
    ws = 0x7f3e02b68e20 { 
      id = "wrk",
      {s,f,r,e} = {0x7f3e02b68450,0x7f3e02b68450,(nil),+2048},
    },
  },
    vcl = {
      srcname = {
        "input",
        "Default",
      },
    },
},




2012-06-08 21:39:21 WARNING [0, 0]: streaming-grace(httperf): Varnishstat uptime and measured run-time is too large (measured: 170 stat: 58 diff: 112). Did we crash?
2012-06-08 21:39:21 [1, 0]: streaming-grace(httperf): Load:  23:39:21 up 8 days, 10:02,  0 users,  load average: 0.56, 0.74, 0.80

2012-06-08 21:39:21 [1, 0]: streaming-grace(httperf): Test name: streaming-grace
2012-06-08 21:39:21 [1, 0]: streaming-grace(httperf): Varnish options: 
2012-06-08 21:39:21 [1, 0]: streaming-grace(httperf): -t=1
2012-06-08 21:39:21 [1, 0]: streaming-grace(httperf): Varnish parameters: 
2012-06-08 21:39:21 [1, 0]: streaming-grace(httperf): thread_stats_rate=1
2012-06-08 21:39:21 [1, 0]: streaming-grace(httperf): thread_pool_add_delay=1
2012-06-08 21:39:21 [1, 0]: streaming-grace(httperf): http_gzip_support=off
2012-06-08 21:39:21 [1, 0]: streaming-grace(httperf): default_grace=10
2012-06-08 21:39:21 [1, 0]: streaming-grace(httperf): Payload size (excludes headers): 1M
2012-06-08 21:39:21 [1, 0]: streaming-grace(httperf): Branch: master
2012-06-08 21:39:21 [1, 0]: streaming-grace(httperf): Number of clients involved: 24
2012-06-08 21:39:21 [1, 0]: streaming-grace(httperf): Type of test: httperf
2012-06-08 21:39:21 [1, 0]: streaming-grace(httperf): Test iterations: 1
2012-06-08 21:39:21 [1, 0]: streaming-grace(httperf): Runtime: 170 seconds
2012-06-08 21:39:21 [1, 0]: streaming-grace(httperf): VCL: 
backend foo {
	.host = "localhost";
	.port = "80";
	.connect_timeout = 10s;
}

sub vcl_recv {
	set req.grace = 15s;
}
sub vcl_fetch {
	set beresp.do_stream = true;
	set beresp.grace = 10s;
	set beresp.ttl = 15s;
}

sub vcl_deliver {
	set resp.http.x-fryer = "some test";
}

2012-06-08 21:39:21 [1, 0]: streaming-grace(httperf): Number of total connections: 10000
2012-06-08 21:39:21 [1, 0]: streaming-grace(httperf): Note: connections are subject to rounding when divided among clients. Expect slight deviations.
2012-06-08 21:39:21 [1, 0]: streaming-grace(httperf): Requests per connection: 1
2012-06-08 21:39:21 [1, 0]: streaming-grace(httperf): Extra options to httperf: --wset=1000,0.1 --rate 3
2012-06-08 21:39:21 [1, 0]: streaming-grace(httperf): Httperf command (last client): httperf --hog --timeout 60 --num-calls 1 --num-conns 416 --port 8080 --burst-length 1 --client 23/24 --server 10.20.100.12 --wset=1000,0.1 --rate 3
2012-06-08 21:39:28 [2, 6]: cold-default(httperf): Starting test
2012-06-08 21:42:48 WARNING [0,200]: cold-default(httperf): Panic detected. I think!
2012-06-08 21:42:48 WARNING [0, 0]: cold-default(httperf): 
Last panic at: Fri, 08 Jun 2012 21:41:33 GMT
Assert error in VCL_fetch_method(), ../../include/tbl/vcl_returns.h line 56:
  Condition((req->sp) != NULL) not true.
thread = (cache-worker)
ident = Linux,2.6.32-38-generic,x86_64,-smalloc,-smalloc,-hcritbit,epoll
Backtrace:
  0x431d88: pan_ic+d8
  0x439875: VCL_fetch_method+1a5
  0x4186a9: cnt_fetch+479
  0x41accd: CNT_Session+42d
  0x43670d: ses_pool_task+fd
  0x433592: Pool_Work_Thread+112
  0x441128: wrk_thread_real+c8
  0x7fa6175839ca: _end+7fa616eff202
  0x7fa6172e0cdd: _end+7fa616c5c515
sp = 0x7fa608002c20 {
  fd = 24, id = 24, xid = 1181120776,
  client = 10.20.100.9 7375,
  step = STP_FETCH,
  handling = fetch,
  err_code = 200, err_reason = (null),
  restarts = 0, esi_level = 0
  busyobj = 0x7fa601fa4020 {
    ws = 0x7fa601fa4070 { 
      id = "bo",
      {s,f,r,e} = {0x7fa601fa5aa0,+448,(nil),+58752},
    },
    do_stream
    bodystatus = 3 (chunked),
    },
    http[bereq] = {
      ws = 0x7fa601fa4070[bo]
        "GET",
        "/0/3/6/3/9/8/9.html",
        "HTTP/1.1",
        "User-Agent: httperf/0.9.0",
        "Host: 10.20.100.12",
        "X-Forwarded-For: 10.20.100.9",
        "X-Varnish: 1181120776",
        "Accept-Encoding: gzip",
    },
    http[beresp] = {
      ws = 0x7fa601fa4070[bo]
        "HTTP/1.1",
        "200",
        "OK",
        "Server: nginx/0.7.65",
        "Date: Fri, 08 Jun 2012 21:41:33 GMT",
        "Content-Type: text/plain",
        "Last-Modified: Fri, 08 Jun 2012 21:39:31 GMT",
        "Transfer-Encoding: chunked",
        "Connection: keep-alive",
        "Content-Encoding: gzip",
    },
  ws = 0x7fa6060ac158 { 
    id = "req",
    {s,f,r,e} = {0x7fa6060ad730,+216,(nil),+59632},
  },
  http[req] = {
    ws = 0x7fa6060ac158[req]
      "GET",
      "/0/3/6/3/9/8/9.html",
      "HTTP/1.1",
      "User-Agent: httperf/0.9.0",
      "Host: 10.20.100.12",
      "X-Forwarded-For: 10.20.100.9",
  },
  worker = 0x7fa608b72c60 {
    ws = 0x7fa608b72e20 { 
      id = "wrk",
      {s,f,r,e} = {0x7fa608b72450,0x7fa608b72450,(nil),+2048},
    },
  },
    vcl = {
      srcname = {
        "input",
        "Default",
      },
    },
},




2012-06-08 21:42:48 WARNING [0, 0]: cold-default(httperf): Varnishstat uptime and measured run-time is too large (measured: 196 stat: 74 diff: 122). Did we crash?
2012-06-08 21:46:18 WARNING [0,210]: cold-default(httperf): Panic detected. I think!
2012-06-08 21:46:18 WARNING [0, 0]: cold-default(httperf): 
Last panic at: Fri, 08 Jun 2012 21:44:52 GMT
Assert error in cnt_first(), cache/cache_center.c line 943:
  Condition(req->sp == sp) not true.
thread = (cache-worker)
ident = Linux,2.6.32-38-generic,x86_64,-smalloc,-smalloc,-hcritbit,epoll
Backtrace:
  0x431d88: pan_ic+d8
  0x41b021: CNT_Session+781
  0x43670d: ses_pool_task+fd
  0x433592: Pool_Work_Thread+112
  0x441128: wrk_thread_real+c8
  0x7fa6175839ca: _end+7fa616eff202
  0x7fa6172e0cdd: _end+7fa616c5c515
sp = 0x7fa5f87af120 {
  fd = 20, id = 20, xid = 0,
  client =  ,
  step = STP_FIRST,
  handling = deliver,
  restarts = 0, esi_level = 0
  ws = 0x7fa5f45a5158 { 
    id = "req",
    {s,f,r,e} = {0x7fa5f45a6730,0x7fa5f45a6730,(nil),+59632},
  },
  http[req] = {
    ws = (nil)[]
  },
  worker = 0x7fa6089b4c60 {
    ws = 0x7fa6089b4e20 { 
      id = "wrk",
      {s,f,r,e} = {0x7fa6089b4450,0x7fa6089b4450,(nil),+2048},
    },
  },
},




2012-06-08 21:46:18 WARNING [0, 0]: cold-default(httperf): Varnishstat uptime and measured run-time is too large (measured: 406 stat: 85 diff: 321). Did we crash?
2012-06-08 21:46:18 WARNING [0, 0]: cold-default(httperf): Out of bounds: uptime(85) less than lower boundary 100
2012-06-08 21:46:18 WARNING [0, 0]: cold-default(httperf): Out of bounds: client_req(167530) less than lower boundary 1589840
2012-06-08 21:46:19 [1, 0]: cold-default(httperf): Load:  23:46:19 up 8 days, 10:09,  0 users,  load average: 0.49, 0.65, 0.73

2012-06-08 21:46:19 [1, 0]: cold-default(httperf): Test name: cold-default
2012-06-08 21:46:19 [1, 0]: cold-default(httperf): Varnish options: 
2012-06-08 21:46:19 [1, 0]: cold-default(httperf): -t=3600
2012-06-08 21:46:19 [1, 0]: cold-default(httperf): -s=malloc,10G
2012-06-08 21:46:19 [1, 0]: cold-default(httperf): Varnish parameters: 
2012-06-08 21:46:19 [1, 0]: cold-default(httperf): thread_stats_rate=1
2012-06-08 21:46:19 [1, 0]: cold-default(httperf): Payload size (excludes headers): 256
2012-06-08 21:46:19 [1, 0]: cold-default(httperf): Branch: master
2012-06-08 21:46:19 [1, 0]: cold-default(httperf): Number of clients involved: 24
2012-06-08 21:46:19 [1, 0]: cold-default(httperf): Type of test: httperf
2012-06-08 21:46:19 [1, 0]: cold-default(httperf): Test iterations: 2
2012-06-08 21:46:19 [1, 0]: cold-default(httperf): Runtime: 406 seconds
2012-06-08 21:46:19 [1, 0]: cold-default(httperf): VCL: 
backend foo {
	.host = "localhost";
	.port = "80";
}

sub vcl_fetch {
	set beresp.do_stream = true;
}

2012-06-08 21:46:19 [1, 0]: cold-default(httperf): Number of total connections: 80000
2012-06-08 21:46:19 [1, 0]: cold-default(httperf): Note: connections are subject to rounding when divided among clients. Expect slight deviations.
2012-06-08 21:46:19 [1, 0]: cold-default(httperf): Requests per connection: 10
2012-06-08 21:46:19 [1, 0]: cold-default(httperf): Extra options to httperf: --wset=4000000,0.50
2012-06-08 21:46:19 [1, 0]: cold-default(httperf): Httperf command (last client): httperf --hog --timeout 60 --num-calls 10 --num-conns 3333 --port 8080 --burst-length 10 --client 23/24 --server 10.20.100.12 --wset=4000000,0.50
2012-06-08 21:46:30 [2,11]: 4gpluss-nogzip(httperf): Starting test
2012-06-08 21:46:34 WARNING [0, 3]: Varnish failed to start. Fallback attempts starting
2012-06-08 21:46:34 [1, 0]: Removed (hopefully incompatible) parameter to try to start varnish. Key: thread_stats_rate=1
2012-06-08 21:46:34 [1, 0]: Removed (hopefully incompatible) parameter to try to start varnish. Key: thread_pool_max=300
2012-06-08 21:46:34 [1, 0]: Removed (hopefully incompatible) parameter to try to start varnish. Key: sess_timeout=60000s
2012-06-08 21:46:35 [1, 0]: Fallback worked. Parameter that seemed to cause problems: sess_timeout
2012-06-08 22:08:06 [2,1290]: purge-fail(httperf): Starting test
2012-06-08 22:12:09 WARNING [0,243]: purge-fail(httperf): Panic detected. I think!
2012-06-08 22:12:09 WARNING [0, 0]: purge-fail(httperf): 
Last panic at: Fri, 08 Jun 2012 22:11:35 GMT
Assert error in VCL_deliver_method(), ../../include/tbl/vcl_returns.h line 60:
  Condition((req->sp) != NULL) not true.
thread = (cache-worker)
ident = Linux,2.6.32-38-generic,x86_64,-smalloc,-smalloc,-hcritbit,epoll
Backtrace:
  0x431d88: pan_ic+d8
  0x439695: VCL_deliver_method+1a5
  0x419729: cnt_prepresp+269
  0x41ac6d: CNT_Session+3cd
  0x43670d: ses_pool_task+fd
  0x433592: Pool_Work_Thread+112
  0x441128: wrk_thread_real+c8
  0x7f32a23a39ca: _end+7f32a1d1f202
  0x7f32a2100cdd: _end+7f32a1a7c515
sp = 0x7f32a1d21220 {
  fd = 13, id = 13, xid = 1715061035,
  client = 10.20.100.7 25305,
  step = STP_PREPRESP,
  handling = deliver,
  restarts = 0, esi_level = 0
  ws = 0x7f3293546158 { 
    id = "req",
    {s,f,r,e} = {0x7f3293547730,+224,(nil),+59632},
  },
  http[req] = {
    ws = 0x7f3293546158[req]
      "PURGE",
      "/foo",
      "HTTP/1.1",
      "User-Agent: httperf/0.9.0",
      "Host: 10.20.100.12",
  },
    http[resp] = {
      ws = 0x7f3293546158[req]
        "HTTP/1.1",
        "Not in cache but not confusing httperf",
        "Server: Varnish",
        "Content-Type: text/html; charset=utf-8",
        "Retry-After: 5",
        "Content-Length: 476",
        "Accept-Ranges: bytes",
        "Date: Fri, 08 Jun 2012 22:11:35 GMT",
        "X-Varnish: 1715061035",
        "Age: 0",
        "Via: 1.1 varnish",
        "Connection: close",
    },
  worker = 0x7f3293671c60 {
    ws = 0x7f3293671e20 { 
      id = "wrk",
      {s,f,r,e} = {0x7f3293671450,0x7f3293671450,(nil),+2048},
    },
  },
    vcl = {
      srcname = {
        "input",
        "Default",
      },
    },
  obj = 0x7f32902df000 {
    xid = 1715061035,
    ws = 0x7f32902df018 { 
      id = "obj",
      {s,f,r,e} = {0x7f32902df548,+176,(nil),+32768},
    },
    http[obj] = {
      ws = 0x7f32902df018[obj]
        "HTTP/1.1",
        "Not in cache but not confusing httperf",
        "Date: Fri, 08 Jun 2012 22:11:35 GMT",
        "Server: Varnish",
        "Content-Type: text/html; charset=utf-8",
        "Retry-After: 5",
        "Content-Length: 476",
    },
    len = 476,
    store = {
      476 {
        0a 3c 3f 78 6d 6c 20 76 65 72 73 69 6f 6e 3d 22 |.<?xml version="|
        31 2e 30 22 20 65 6e 63 6f 64 69 6e 67 3d 22 75 |1.0" encoding="u|
        74 66 2d 38 22 3f 3e 0a 3c 21 44 4f 43 54 59 50 |tf-8"?>.<!DOCTYP|
        45 20 68 74 6d 6c 20 50 55 42 4c 49 43 20 22 2d |E html PUBLIC "-|
        [412 more]
      },
    },
  },
},




2012-06-08 22:12:09 WARNING [0, 0]: purge-fail(httperf): Varnishstat uptime and measured run-time is too large (measured: 239 stat: 33 diff: 206). Did we crash?
2012-06-08 22:12:10 WARNING [0, 0]: purge-fail(httperf): Out of bounds: client_req(9162) less than lower boundary 290000
2012-06-08 22:12:10 [1, 0]: purge-fail(httperf): Load:  00:12:10 up 8 days, 10:35,  0 users,  load average: 0.33, 0.56, 0.98

2012-06-08 22:12:10 [1, 0]: purge-fail(httperf): Test name: purge-fail
2012-06-08 22:12:10 [1, 0]: purge-fail(httperf): Varnish options: 
2012-06-08 22:12:10 [1, 0]: purge-fail(httperf): Varnish parameters: 
2012-06-08 22:12:10 [1, 0]: purge-fail(httperf): thread_stats_rate=1
2012-06-08 22:12:10 [1, 0]: purge-fail(httperf): Payload size (excludes headers): 1K
2012-06-08 22:12:10 [1, 0]: purge-fail(httperf): Branch: master
2012-06-08 22:12:10 [1, 0]: purge-fail(httperf): Number of clients involved: 24
2012-06-08 22:12:10 [1, 0]: purge-fail(httperf): Type of test: httperf
2012-06-08 22:12:10 [1, 0]: purge-fail(httperf): Test iterations: 1
2012-06-08 22:12:10 [1, 0]: purge-fail(httperf): Runtime: 239 seconds
2012-06-08 22:12:10 [1, 0]: purge-fail(httperf): VCL: 
backend foo {
	.host = "localhost";
	.port = "80";
}

sub vcl_recv {
	if (!req.url ~ "/0/0.html") {
		set req.request = "PURGE";
	}
	set req.url = "/foo";
	return (lookup);
}
sub vcl_hit {
	if (req.request == "PURGE") {
		set obj.ttl = 0s;
		error 200 "OK";
	}
}
sub vcl_miss {
	if (req.request == "PURGE") {
		error 200 "Not in cache but not confusing httperf";
	}
}


2012-06-08 22:12:10 [1, 0]: purge-fail(httperf): Number of total connections: 300000
2012-06-08 22:12:10 [1, 0]: purge-fail(httperf): Note: connections are subject to rounding when divided among clients. Expect slight deviations.
2012-06-08 22:12:10 [1, 0]: purge-fail(httperf): Requests per connection: 1
2012-06-08 22:12:10 [1, 0]: purge-fail(httperf): Extra options to httperf: --wset=999,0.5 --timeout=5
2012-06-08 22:12:10 [1, 0]: purge-fail(httperf): Httperf command (last client): httperf --hog --timeout 60 --num-calls 1 --num-conns 12500 --port 8080 --burst-length 10 --client 23/24 --server 10.20.100.12 --wset=999,0.5 --timeout=5
2012-06-08 22:12:17 [2, 6]: streaming-gzip(httperf): Starting test
2012-06-08 22:14:50 WARNING [0,153]: Tests finished with problems detected. Failed expectations: 16 Total run time: 9769 seconds 



More information about the varnish-test mailing list