[Fryer] master FAIL. 10 of 25 tests succeeded.

fryer at oneiros.varnish-software.com fryer at oneiros.varnish-software.com
Mon Jun 11 00:16:06 CEST 2012


Tests Failed: httperf-lru-nostream-gzip httperf-lru-nostream-gzip-deflateoff httperf-lru-default httperf-lru-stream-default httperf-hot httperf-lru-nostream-nogzip cold-gzip httperf-lru-stream-gzip httperf-lru-stream-nogzip cold-nogzip siege-test httperf-lru-nostream-default httperf-rapid-expire cold-default purge-fail 


Tests OK: streaming memleak 4gpluss-stream 4gpluss basic-fryer 4gpluss-nostream lru-random streaming-grace 4gpluss-nogzip streaming-gzip 



2012-06-10 19:32:15 [1,13]: Server pantoum checked out varnish-3.0.0-beta2-1014-ge75cd2e of branch master
2012-06-10 19:32:38 [2,23]: httperf-lru-nostream-gzip(httperf): Starting test
2012-06-10 19:35:56 WARNING [0,197]: httperf-lru-nostream-gzip(httperf): Panic detected. I think!
2012-06-10 19:35:56 WARNING [0, 0]: httperf-lru-nostream-gzip(httperf): 
Last panic at: Sun, 10 Jun 2012 19:34:42 GMT
Assert error in VCL_fetch_method(), ../../include/tbl/vcl_returns.h line 56:
  Condition((req->sp) != NULL) not true.
thread = (cache-worker)
ident = Linux,2.6.32-38-generic,x86_64,-smalloc,-smalloc,-hcritbit,epoll
Backtrace:
  0x431d88: pan_ic+d8
  0x439875: VCL_fetch_method+1a5
  0x4186a9: cnt_fetch+479
  0x41accd: CNT_Session+42d
  0x43670d: ses_pool_task+fd
  0x433592: Pool_Work_Thread+112
  0x441128: wrk_thread_real+c8
  0x7f4d65a4b9ca: _end+7f4d653c7202
  0x7f4d657a8cdd: _end+7f4d65124515
sp = 0x7f4d56102920 {
  fd = 14, id = 14, xid = 1210838623,
  client = 10.20.100.9 15832,
  step = STP_FETCH,
  handling = fetch,
  err_code = 200, err_reason = (null),
  restarts = 0, esi_level = 0
  busyobj = 0x7f4d5666b020 {
    ws = 0x7f4d5666b070 { 
      id = "bo",
      {s,f,r,e} = {0x7f4d5666caa0,+512,(nil),+58752},
    },
    do_stream
    bodystatus = 3 (chunked),
    },
    http[bereq] = {
      ws = 0x7f4d5666b070[bo]
        "GET",
        "/1/7/6/9/8/2.html",
        "HTTP/1.1",
        "User-Agent: httperf/0.9.0",
        "Host: 10.20.100.12",
        "X-Forwarded-For: 10.20.100.9",
        "X-Varnish: 1210838623",
        "Accept-Encoding: gzip",
    },
    http[beresp] = {
      ws = 0x7f4d5666b070[bo]
        "HTTP/1.1",
        "200",
        "OK",
        "Server: nginx/0.7.65",
        "Date: Sun, 10 Jun 2012 19:34:42 GMT",
        "Content-Type: text/plain",
        "Last-Modified: Sun, 10 Jun 2012 19:32:42 GMT",
        "Transfer-Encoding: chunked",
        "Connection: keep-alive",
        "Content-Encoding: gzip",
    },
  ws = 0x7f4d55f35158 { 
    id = "req",
    {s,f,r,e} = {0x7f4d55f36730,+136,(nil),+59632},
  },
  http[req] = {
    ws = 0x7f4d55f35158[req]
      "GET",
      "/1/7/6/9/8/2.html",
      "HTTP/1.1",
      "User-Agent: httperf/0.9.0",
      "Host: 10.20.100.12",
      "X-Forwarded-For: 10.20.100.9",
  },
  worker = 0x7f4d55a8ac60 {
    ws = 0x7f4d55a8ae20 { 
      id = "wrk",
      {s,f,r,e} = {0x7f4d55a8a450,0x7f4d55a8a450,(nil),+2048},
    },
  },
    vcl = {
      srcname = {
        "input",
        "Default",
      },
    },
},




2012-06-10 19:35:56 WARNING [0, 0]: httperf-lru-nostream-gzip(httperf): Varnishstat uptime and measured run-time is too large (measured: 193 stat: 73 diff: 120). Did we crash?
2012-06-10 19:35:56 WARNING [0, 0]: httperf-lru-nostream-gzip(httperf): Out of bounds: n_lru_nuked(0) less than lower boundary 80000
2012-06-10 19:35:56 WARNING [0, 0]: httperf-lru-nostream-gzip(httperf): Out of bounds: client_req(127750) less than lower boundary 1989920
2012-06-10 19:35:56 [1, 0]: httperf-lru-nostream-gzip(httperf): Load:  21:35:56 up 10 days,  7:58,  0 users,  load average: 0.68, 0.47, 0.19

2012-06-10 19:35:56 [1, 0]: httperf-lru-nostream-gzip(httperf): Test name: httperf-lru-nostream-gzip
2012-06-10 19:35:56 [1, 0]: httperf-lru-nostream-gzip(httperf): Varnish options: 
2012-06-10 19:35:56 [1, 0]: httperf-lru-nostream-gzip(httperf): -t=3600
2012-06-10 19:35:56 [1, 0]: httperf-lru-nostream-gzip(httperf): -s=malloc,30M
2012-06-10 19:35:56 [1, 0]: httperf-lru-nostream-gzip(httperf): Varnish parameters: 
2012-06-10 19:35:56 [1, 0]: httperf-lru-nostream-gzip(httperf): thread_stats_rate=1
2012-06-10 19:35:56 [1, 0]: httperf-lru-nostream-gzip(httperf): thread_pool_max=5000
2012-06-10 19:35:56 [1, 0]: httperf-lru-nostream-gzip(httperf): nuke_limit=250
2012-06-10 19:35:56 [1, 0]: httperf-lru-nostream-gzip(httperf): http_gzip_support=on
2012-06-10 19:35:56 [1, 0]: httperf-lru-nostream-gzip(httperf): thread_pool_min=200
2012-06-10 19:35:56 [1, 0]: httperf-lru-nostream-gzip(httperf): Payload size (excludes headers): 10K
2012-06-10 19:35:56 [1, 0]: httperf-lru-nostream-gzip(httperf): Branch: master
2012-06-10 19:35:56 [1, 0]: httperf-lru-nostream-gzip(httperf): Number of clients involved: 24
2012-06-10 19:35:56 [1, 0]: httperf-lru-nostream-gzip(httperf): Type of test: httperf
2012-06-10 19:35:56 [1, 0]: httperf-lru-nostream-gzip(httperf): Test iterations: 1
2012-06-10 19:35:56 [1, 0]: httperf-lru-nostream-gzip(httperf): Runtime: 193 seconds
2012-06-10 19:35:56 [1, 0]: httperf-lru-nostream-gzip(httperf): VCL: 
backend foo {
	.host = "localhost";
	.port = "80";
}

sub vcl_fetch {
	set beresp.do_stream = false;
}

2012-06-10 19:35:56 [1, 0]: httperf-lru-nostream-gzip(httperf): Number of total connections: 200000
2012-06-10 19:35:56 [1, 0]: httperf-lru-nostream-gzip(httperf): Note: connections are subject to rounding when divided among clients. Expect slight deviations.
2012-06-10 19:35:56 [1, 0]: httperf-lru-nostream-gzip(httperf): Requests per connection: 10
2012-06-10 19:35:56 [1, 0]: httperf-lru-nostream-gzip(httperf): Extra options to httperf: --wset=1000000,0.1
2012-06-10 19:35:56 [1, 0]: httperf-lru-nostream-gzip(httperf): Httperf command (last client): httperf --hog --timeout 60 --num-calls 10 --num-conns 8333 --port 8080 --burst-length 10 --client 23/24 --server 10.20.100.12 --wset=1000000,0.1
2012-06-10 19:36:03 [2, 6]: httperf-lru-nostream-gzip-deflateoff(httperf): Starting test
2012-06-10 19:40:19 WARNING [0,255]: httperf-lru-nostream-gzip-deflateoff(httperf): Panic detected. I think!
2012-06-10 19:40:19 WARNING [0, 0]: httperf-lru-nostream-gzip-deflateoff(httperf): 
Last panic at: Sun, 10 Jun 2012 19:37:57 GMT
Assert error in VCL_recv_method(), ../../include/tbl/vcl_returns.h line 27:
  Condition((req->sp) != NULL) not true.
thread = (cache-worker)
ident = Linux,2.6.32-38-generic,x86_64,-smalloc,-smalloc,-hcritbit,epoll
Backtrace:
  0x431d88: pan_ic+d8
  0x43a3b5: VCL_recv_method+1a5
  0x4164c5: cnt_recv+1e5
  0x41ae1d: CNT_Session+57d
  0x43670d: ses_pool_task+fd
  0x433592: Pool_Work_Thread+112
  0x441128: wrk_thread_real+c8
  0x7f7611d2f9ca: _end+7f76116ab202
  0x7f7611a8ccdd: _end+7f7611408515
sp = 0x7f7602605f20 {
  fd = 20, id = 20, xid = 1214516247,
  client = 10.20.100.9 4953,
  step = STP_RECV,
  handling = deliver,
  restarts = 0, esi_level = 0
  ws = 0x7f7601d2d158 { 
    id = "req",
    {s,f,r,e} = {0x7f7601d2e730,+248,(nil),+59632},
  },
  http[req] = {
    ws = 0x7f7601d2d158[req]
      "GET",
      "/0/4/4/9/0/8.html",
      "HTTP/1.1",
      "User-Agent: httperf/0.9.0",
      "Host: 10.20.100.12",
  },
  worker = 0x7f7601acac60 {
    ws = 0x7f7601acae20 { 
      id = "wrk",
      {s,f,r,e} = {0x7f7601aca450,0x7f7601aca450,(nil),+2048},
    },
  },
    vcl = {
      srcname = {
        "input",
        "Default",
      },
    },
},




2012-06-10 19:40:19 WARNING [0, 0]: httperf-lru-nostream-gzip-deflateoff(httperf): Varnishstat uptime and measured run-time is too large (measured: 252 stat: 141 diff: 111). Did we crash?
2012-06-10 19:40:19 WARNING [0, 0]: httperf-lru-nostream-gzip-deflateoff(httperf): Out of bounds: n_lru_nuked(0) less than lower boundary 80000
2012-06-10 19:40:19 WARNING [0, 0]: httperf-lru-nostream-gzip-deflateoff(httperf): Out of bounds: client_req(271640) less than lower boundary 1989920
2012-06-10 19:40:20 [1, 0]: httperf-lru-nostream-gzip-deflateoff(httperf): Load:  21:40:20 up 10 days,  8:03,  0 users,  load average: 0.34, 0.68, 0.36

2012-06-10 19:40:20 [1, 0]: httperf-lru-nostream-gzip-deflateoff(httperf): Test name: httperf-lru-nostream-gzip-deflateoff
2012-06-10 19:40:20 [1, 0]: httperf-lru-nostream-gzip-deflateoff(httperf): Varnish options: 
2012-06-10 19:40:20 [1, 0]: httperf-lru-nostream-gzip-deflateoff(httperf): -t=3600
2012-06-10 19:40:20 [1, 0]: httperf-lru-nostream-gzip-deflateoff(httperf): -s=malloc,30M
2012-06-10 19:40:20 [1, 0]: httperf-lru-nostream-gzip-deflateoff(httperf): Varnish parameters: 
2012-06-10 19:40:20 [1, 0]: httperf-lru-nostream-gzip-deflateoff(httperf): thread_stats_rate=1
2012-06-10 19:40:20 [1, 0]: httperf-lru-nostream-gzip-deflateoff(httperf): thread_pool_max=5000
2012-06-10 19:40:20 [1, 0]: httperf-lru-nostream-gzip-deflateoff(httperf): nuke_limit=250
2012-06-10 19:40:20 [1, 0]: httperf-lru-nostream-gzip-deflateoff(httperf): http_gzip_support=on
2012-06-10 19:40:20 [1, 0]: httperf-lru-nostream-gzip-deflateoff(httperf): thread_pool_min=200
2012-06-10 19:40:20 [1, 0]: httperf-lru-nostream-gzip-deflateoff(httperf): Payload size (excludes headers): 10K
2012-06-10 19:40:20 [1, 0]: httperf-lru-nostream-gzip-deflateoff(httperf): Branch: master
2012-06-10 19:40:20 [1, 0]: httperf-lru-nostream-gzip-deflateoff(httperf): Number of clients involved: 24
2012-06-10 19:40:20 [1, 0]: httperf-lru-nostream-gzip-deflateoff(httperf): Type of test: httperf
2012-06-10 19:40:20 [1, 0]: httperf-lru-nostream-gzip-deflateoff(httperf): Test iterations: 1
2012-06-10 19:40:20 [1, 0]: httperf-lru-nostream-gzip-deflateoff(httperf): Runtime: 252 seconds
2012-06-10 19:40:20 [1, 0]: httperf-lru-nostream-gzip-deflateoff(httperf): VCL: 
backend foo {
	.host = "localhost";
	.port = "80";
}

sub vcl_fetch {
	set beresp.do_stream = false;
	set beresp.do_gzip = true;
}

2012-06-10 19:40:20 [1, 0]: httperf-lru-nostream-gzip-deflateoff(httperf): Number of total connections: 200000
2012-06-10 19:40:20 [1, 0]: httperf-lru-nostream-gzip-deflateoff(httperf): Note: connections are subject to rounding when divided among clients. Expect slight deviations.
2012-06-10 19:40:20 [1, 0]: httperf-lru-nostream-gzip-deflateoff(httperf): Requests per connection: 10
2012-06-10 19:40:20 [1, 0]: httperf-lru-nostream-gzip-deflateoff(httperf): Extra options to httperf: --wset=1000000,0.1
2012-06-10 19:40:20 [1, 0]: httperf-lru-nostream-gzip-deflateoff(httperf): Httperf command (last client): httperf --hog --timeout 60 --num-calls 10 --num-conns 8333 --port 8080 --burst-length 10 --client 23/24 --server 10.20.100.12 --wset=1000000,0.1
2012-06-10 19:40:26 [2, 6]: streaming(httperf): Starting test
2012-06-10 19:43:20 [2,174]: httperf-lru-default(httperf): Starting test
2012-06-10 19:46:49 WARNING [0,208]: httperf-lru-default(httperf): Panic detected. I think!
2012-06-10 19:46:49 WARNING [0, 0]: httperf-lru-default(httperf): 
Last panic at: Sun, 10 Jun 2012 19:45:34 GMT
Assert error in VCL_fetch_method(), ../../include/tbl/vcl_returns.h line 56:
  Condition((req->sp) != NULL) not true.
thread = (cache-worker)
ident = Linux,2.6.32-38-generic,x86_64,-smalloc,-smalloc,-hcritbit,epoll
Backtrace:
  0x431d88: pan_ic+d8
  0x439875: VCL_fetch_method+1a5
  0x4186a9: cnt_fetch+479
  0x41accd: CNT_Session+42d
  0x43670d: ses_pool_task+fd
  0x433592: Pool_Work_Thread+112
  0x441128: wrk_thread_real+c8
  0x7fd919aa89ca: _end+7fd919424202
  0x7fd919805cdd: _end+7fd919181515
sp = 0x7fd90a502320 {
  fd = 24, id = 24, xid = 1308652841,
  client = 10.20.100.9 16452,
  step = STP_FETCH,
  handling = fetch,
  err_code = 200, err_reason = (null),
  restarts = 0, esi_level = 0
  busyobj = 0x7fd90a58d020 {
    ws = 0x7fd90a58d070 { 
      id = "bo",
      {s,f,r,e} = {0x7fd90a58eaa0,+512,(nil),+58752},
    },
    do_stream
    bodystatus = 3 (chunked),
    },
    http[bereq] = {
      ws = 0x7fd90a58d070[bo]
        "GET",
        "/1/8/2/1/4/1.html",
        "HTTP/1.1",
        "User-Agent: httperf/0.9.0",
        "Host: 10.20.100.12",
        "X-Forwarded-For: 10.20.100.9",
        "X-Varnish: 1308652841",
        "Accept-Encoding: gzip",
    },
    http[beresp] = {
      ws = 0x7fd90a58d070[bo]
        "HTTP/1.1",
        "200",
        "OK",
        "Server: nginx/0.7.65",
        "Date: Sun, 10 Jun 2012 19:45:34 GMT",
        "Content-Type: text/plain",
        "Last-Modified: Sun, 10 Jun 2012 19:43:24 GMT",
        "Transfer-Encoding: chunked",
        "Connection: keep-alive",
        "Content-Encoding: gzip",
    },
  ws = 0x7fd90d5d2158 { 
    id = "req",
    {s,f,r,e} = {0x7fd90d5d3730,+136,(nil),+59632},
  },
  http[req] = {
    ws = 0x7fd90d5d2158[req]
      "GET",
      "/1/8/2/1/4/1.html",
      "HTTP/1.1",
      "User-Agent: httperf/0.9.0",
      "Host: 10.20.100.12",
      "X-Forwarded-For: 10.20.100.9",
  },
  worker = 0x7fd90990ec60 {
    ws = 0x7fd90990ee20 { 
      id = "wrk",
      {s,f,r,e} = {0x7fd90990e450,0x7fd90990e450,(nil),+2048},
    },
  },
    vcl = {
      srcname = {
        "input",
        "Default",
      },
    },
},




2012-06-10 19:46:49 WARNING [0, 0]: httperf-lru-default(httperf): Varnishstat uptime and measured run-time is too large (measured: 204 stat: 74 diff: 130). Did we crash?
2012-06-10 19:46:49 WARNING [0, 0]: httperf-lru-default(httperf): Out of bounds: n_lru_nuked(0) less than lower boundary 80000
2012-06-10 19:46:49 WARNING [0, 0]: httperf-lru-default(httperf): Out of bounds: client_req(107040) less than lower boundary 1989920
2012-06-10 19:46:50 [1, 0]: httperf-lru-default(httperf): Load:  21:46:50 up 10 days,  8:09,  0 users,  load average: 8.09, 6.79, 2.98

2012-06-10 19:46:50 [1, 0]: httperf-lru-default(httperf): Test name: httperf-lru-default
2012-06-10 19:46:50 [1, 0]: httperf-lru-default(httperf): Varnish options: 
2012-06-10 19:46:50 [1, 0]: httperf-lru-default(httperf): -t=3600
2012-06-10 19:46:50 [1, 0]: httperf-lru-default(httperf): -s=malloc,30M
2012-06-10 19:46:50 [1, 0]: httperf-lru-default(httperf): Varnish parameters: 
2012-06-10 19:46:50 [1, 0]: httperf-lru-default(httperf): thread_stats_rate=1
2012-06-10 19:46:50 [1, 0]: httperf-lru-default(httperf): thread_pool_max=5000
2012-06-10 19:46:50 [1, 0]: httperf-lru-default(httperf): nuke_limit=250
2012-06-10 19:46:50 [1, 0]: httperf-lru-default(httperf): thread_pool_min=200
2012-06-10 19:46:50 [1, 0]: httperf-lru-default(httperf): Payload size (excludes headers): 10K
2012-06-10 19:46:50 [1, 0]: httperf-lru-default(httperf): Branch: master
2012-06-10 19:46:50 [1, 0]: httperf-lru-default(httperf): Number of clients involved: 24
2012-06-10 19:46:50 [1, 0]: httperf-lru-default(httperf): Type of test: httperf
2012-06-10 19:46:50 [1, 0]: httperf-lru-default(httperf): Test iterations: 1
2012-06-10 19:46:50 [1, 0]: httperf-lru-default(httperf): Runtime: 204 seconds
2012-06-10 19:46:50 [1, 0]: httperf-lru-default(httperf): VCL: 
backend foo {
	.host = "localhost";
	.port = "80";
}

sub vcl_fetch {
	set beresp.do_stream = true;
}

2012-06-10 19:46:50 [1, 0]: httperf-lru-default(httperf): Number of total connections: 200000
2012-06-10 19:46:50 [1, 0]: httperf-lru-default(httperf): Note: connections are subject to rounding when divided among clients. Expect slight deviations.
2012-06-10 19:46:50 [1, 0]: httperf-lru-default(httperf): Requests per connection: 10
2012-06-10 19:46:50 [1, 0]: httperf-lru-default(httperf): Extra options to httperf: --wset=1000000,0.1
2012-06-10 19:46:50 [1, 0]: httperf-lru-default(httperf): Httperf command (last client): httperf --hog --timeout 60 --num-calls 10 --num-conns 8333 --port 8080 --burst-length 10 --client 23/24 --server 10.20.100.12 --wset=1000000,0.1
2012-06-10 19:46:56 [2, 6]: memleak(httperf): Starting test
2012-06-10 19:49:21 [2,144]: 4gpluss-stream(httperf): Starting test
2012-06-10 19:49:24 WARNING [0, 2]: Varnish failed to start. Fallback attempts starting
2012-06-10 19:49:24 [1, 0]: Removed (hopefully incompatible) parameter to try to start varnish. Key: thread_stats_rate=1
2012-06-10 19:49:24 [1, 0]: Removed (hopefully incompatible) parameter to try to start varnish. Key: thread_pool_max=300
2012-06-10 19:49:24 [1, 0]: Removed (hopefully incompatible) parameter to try to start varnish. Key: sess_timeout=60000s
2012-06-10 19:49:25 [1, 0]: Fallback worked. Parameter that seemed to cause problems: sess_timeout
2012-06-10 20:09:11 [2,1186]: httperf-lru-stream-default(httperf): Starting test
2012-06-10 20:12:43 WARNING [0,211]: httperf-lru-stream-default(httperf): Panic detected. I think!
2012-06-10 20:12:43 WARNING [0, 0]: httperf-lru-stream-default(httperf): 
Last panic at: Sun, 10 Jun 2012 20:11:30 GMT
Assert error in cnt_first(), cache/cache_center.c line 943:
  Condition(req->sp == sp) not true.
thread = (cache-worker)
ident = Linux,2.6.32-38-generic,x86_64,-smalloc,-smalloc,-hcritbit,epoll
Backtrace:
  0x431d88: pan_ic+d8
  0x41b021: CNT_Session+781
  0x43670d: ses_pool_task+fd
  0x433592: Pool_Work_Thread+112
  0x441128: wrk_thread_real+c8
  0x7f32433069ca: _end+7f3242c82202
  0x7f3243063cdd: _end+7f32429df515
sp = 0x7f3234309e20 {
  fd = 18, id = 18, xid = 0,
  client =  ,
  step = STP_FIRST,
  handling = deliver,
  restarts = 0, esi_level = 0
  ws = 0x7f3233b60158 { 
    id = "req",
    {s,f,r,e} = {0x7f3233b61730,0x7f3233b61730,(nil),+59632},
  },
  http[req] = {
    ws = (nil)[]
  },
  worker = 0x7f3233186c60 {
    ws = 0x7f3233186e20 { 
      id = "wrk",
      {s,f,r,e} = {0x7f3233186450,0x7f3233186450,(nil),+2048},
    },
  },
},




2012-06-10 20:12:43 WARNING [0, 0]: httperf-lru-stream-default(httperf): Varnishstat uptime and measured run-time is too large (measured: 202 stat: 72 diff: 130). Did we crash?
2012-06-10 20:12:44 WARNING [0, 0]: httperf-lru-stream-default(httperf): Out of bounds: n_lru_nuked(0) less than lower boundary 80000
2012-06-10 20:12:44 WARNING [0, 0]: httperf-lru-stream-default(httperf): Out of bounds: client_req(173050) less than lower boundary 1989920
2012-06-10 20:12:44 [1, 0]: httperf-lru-stream-default(httperf): Load:  22:12:44 up 10 days,  8:35,  0 users,  load average: 0.61, 0.77, 1.27

2012-06-10 20:12:44 [1, 0]: httperf-lru-stream-default(httperf): Test name: httperf-lru-stream-default
2012-06-10 20:12:44 [1, 0]: httperf-lru-stream-default(httperf): Varnish options: 
2012-06-10 20:12:44 [1, 0]: httperf-lru-stream-default(httperf): -t=3600
2012-06-10 20:12:44 [1, 0]: httperf-lru-stream-default(httperf): -s=malloc,30M
2012-06-10 20:12:44 [1, 0]: httperf-lru-stream-default(httperf): Varnish parameters: 
2012-06-10 20:12:44 [1, 0]: httperf-lru-stream-default(httperf): thread_stats_rate=1
2012-06-10 20:12:44 [1, 0]: httperf-lru-stream-default(httperf): thread_pool_max=5000
2012-06-10 20:12:44 [1, 0]: httperf-lru-stream-default(httperf): nuke_limit=250
2012-06-10 20:12:44 [1, 0]: httperf-lru-stream-default(httperf): thread_pool_min=200
2012-06-10 20:12:44 [1, 0]: httperf-lru-stream-default(httperf): Payload size (excludes headers): 10K
2012-06-10 20:12:44 [1, 0]: httperf-lru-stream-default(httperf): Branch: master
2012-06-10 20:12:44 [1, 0]: httperf-lru-stream-default(httperf): Number of clients involved: 24
2012-06-10 20:12:44 [1, 0]: httperf-lru-stream-default(httperf): Type of test: httperf
2012-06-10 20:12:44 [1, 0]: httperf-lru-stream-default(httperf): Test iterations: 1
2012-06-10 20:12:44 [1, 0]: httperf-lru-stream-default(httperf): Runtime: 202 seconds
2012-06-10 20:12:44 [1, 0]: httperf-lru-stream-default(httperf): VCL: 
backend foo {
	.host = "localhost";
	.port = "80";
}

sub vcl_fetch {
	set beresp.do_stream = true;
}

2012-06-10 20:12:44 [1, 0]: httperf-lru-stream-default(httperf): Number of total connections: 200000
2012-06-10 20:12:44 [1, 0]: httperf-lru-stream-default(httperf): Note: connections are subject to rounding when divided among clients. Expect slight deviations.
2012-06-10 20:12:44 [1, 0]: httperf-lru-stream-default(httperf): Requests per connection: 10
2012-06-10 20:12:44 [1, 0]: httperf-lru-stream-default(httperf): Extra options to httperf: --wset=1000000,0.1
2012-06-10 20:12:44 [1, 0]: httperf-lru-stream-default(httperf): Httperf command (last client): httperf --hog --timeout 60 --num-calls 10 --num-conns 8333 --port 8080 --burst-length 10 --client 23/24 --server 10.20.100.12 --wset=1000000,0.1
2012-06-10 20:12:50 [2, 6]: httperf-hot(httperf): Starting test
2012-06-10 20:14:06 WARNING [0,75]: httperf-hot(httperf): Panic detected. I think!
2012-06-10 20:14:06 WARNING [0, 0]: httperf-hot(httperf): 
Last panic at: Sun, 10 Jun 2012 20:13:27 GMT
Assert error in VCL_recv_method(), ../../include/tbl/vcl_returns.h line 27:
  Condition((req->sp) != NULL) not true.
thread = (cache-worker)
ident = Linux,2.6.32-38-generic,x86_64,-smalloc,-smalloc,-hcritbit,epoll
Backtrace:
  0x431d88: pan_ic+d8
  0x43a3b5: VCL_recv_method+1a5
  0x4164c5: cnt_recv+1e5
  0x41ae1d: CNT_Session+57d
  0x43670d: ses_pool_task+fd
  0x433592: Pool_Work_Thread+112
  0x441128: wrk_thread_real+c8
  0x7f180b6ec9ca: _end+7f180b068202
  0x7f180b449cdd: _end+7f180adc5515
sp = 0x7f17fc705020 {
  fd = 24, id = 24, xid = 62321546,
  client = 10.20.100.9 6300,
  step = STP_RECV,
  handling = deliver,
  restarts = 0, esi_level = 0
  ws = 0x7f17fd7b6158 { 
    id = "req",
    {s,f,r,e} = {0x7f17fd7b7730,+528,(nil),+59632},
  },
  http[req] = {
    ws = 0x7f17fd7b6158[req]
      "GET",
      "/8/2/5.html",
      "HTTP/1.1",
      "User-Agent: httperf/0.9.0",
      "Host: 10.20.100.12",
  },
  worker = 0x7f17fca68c60 {
    ws = 0x7f17fca68e20 { 
      id = "wrk",
      {s,f,r,e} = {0x7f17fca68450,0x7f17fca68450,(nil),+2048},
    },
  },
    vcl = {
      srcname = {
        "input",
        "Default",
      },
    },
},




2012-06-10 20:14:06 WARNING [0, 0]: httperf-hot(httperf): Out of bounds: client_req(90910) less than lower boundary 989840
2012-06-10 20:14:06 [1, 0]: httperf-hot(httperf): Load:  22:14:06 up 10 days,  8:37,  0 users,  load average: 0.55, 0.74, 1.22

2012-06-10 20:14:06 [1, 0]: httperf-hot(httperf): Test name: httperf-hot
2012-06-10 20:14:06 [1, 0]: httperf-hot(httperf): Varnish options: 
2012-06-10 20:14:06 [1, 0]: httperf-hot(httperf): Varnish parameters: 
2012-06-10 20:14:06 [1, 0]: httperf-hot(httperf): thread_stats_rate=1
2012-06-10 20:14:06 [1, 0]: httperf-hot(httperf): Payload size (excludes headers): 256
2012-06-10 20:14:06 [1, 0]: httperf-hot(httperf): Branch: master
2012-06-10 20:14:06 [1, 0]: httperf-hot(httperf): Number of clients involved: 24
2012-06-10 20:14:06 [1, 0]: httperf-hot(httperf): Type of test: httperf
2012-06-10 20:14:06 [1, 0]: httperf-hot(httperf): Test iterations: 1
2012-06-10 20:14:06 [1, 0]: httperf-hot(httperf): Runtime: 66 seconds
2012-06-10 20:14:06 [1, 0]: httperf-hot(httperf): VCL: 
backend foo {
	.host = "localhost";
	.port = "80";
}

sub vcl_fetch {
	set beresp.do_stream = true;
}

2012-06-10 20:14:06 [1, 0]: httperf-hot(httperf): Number of total connections: 100000
2012-06-10 20:14:06 [1, 0]: httperf-hot(httperf): Note: connections are subject to rounding when divided among clients. Expect slight deviations.
2012-06-10 20:14:06 [1, 0]: httperf-hot(httperf): Requests per connection: 10
2012-06-10 20:14:06 [1, 0]: httperf-hot(httperf): Extra options to httperf: --wset=1000,0.25
2012-06-10 20:14:06 [1, 0]: httperf-hot(httperf): Httperf command (last client): httperf --hog --timeout 60 --num-calls 10 --num-conns 4166 --port 8080 --burst-length 10 --client 23/24 --server 10.20.100.12 --wset=1000,0.25
2012-06-10 20:14:13 [2, 6]: httperf-lru-nostream-nogzip(httperf): Starting test
2012-06-10 20:17:57 WARNING [0,223]: httperf-lru-nostream-nogzip(httperf): Panic detected. I think!
2012-06-10 20:17:57 WARNING [0, 0]: httperf-lru-nostream-nogzip(httperf): 
Last panic at: Sun, 10 Jun 2012 20:16:14 GMT
Assert error in VCL_recv_method(), ../../include/tbl/vcl_returns.h line 27:
  Condition((req->sp) != NULL) not true.
thread = (cache-worker)
ident = Linux,2.6.32-38-generic,x86_64,-smalloc,-smalloc,-hcritbit,epoll
Backtrace:
  0x431d88: pan_ic+d8
  0x43a3b5: VCL_recv_method+1a5
  0x4164c5: cnt_recv+1e5
  0x41ae1d: CNT_Session+57d
  0x43670d: ses_pool_task+fd
  0x433592: Pool_Work_Thread+112
  0x441128: wrk_thread_real+c8
  0x7f68c5f499ca: _end+7f68c58c5202
  0x7f68c5ca6cdd: _end+7f68c5622515
sp = 0x7f68b4a08620 {
  fd = 29, id = 29, xid = 355979280,
  client = 10.20.100.8 16975,
  step = STP_RECV,
  handling = deliver,
  restarts = 0, esi_level = 0
  ws = 0x7f68b67b1158 { 
    id = "req",
    {s,f,r,e} = {0x7f68b67b2730,+248,(nil),+59632},
  },
  http[req] = {
    ws = 0x7f68b67b1158[req]
      "GET",
      "/1/8/9/3/2/6.html",
      "HTTP/1.1",
      "User-Agent: httperf/0.9.0",
      "Host: 10.20.100.12",
  },
  worker = 0x7f68b5f66c60 {
    ws = 0x7f68b5f66e20 { 
      id = "wrk",
      {s,f,r,e} = {0x7f68b5f66450,0x7f68b5f66450,(nil),+2048},
    },
  },
    vcl = {
      srcname = {
        "input",
        "Default",
      },
    },
},




2012-06-10 20:17:57 WARNING [0, 0]: httperf-lru-nostream-nogzip(httperf): Varnishstat uptime and measured run-time is too large (measured: 220 stat: 102 diff: 118). Did we crash?
2012-06-10 20:17:57 WARNING [0, 0]: httperf-lru-nostream-nogzip(httperf): Out of bounds: n_lru_nuked(17633) less than lower boundary 80000
2012-06-10 20:17:57 WARNING [0, 0]: httperf-lru-nostream-nogzip(httperf): Out of bounds: client_req(204940) less than lower boundary 1989920
2012-06-10 20:17:58 [1, 0]: httperf-lru-nostream-nogzip(httperf): Load:  22:17:58 up 10 days,  8:40,  0 users,  load average: 0.39, 0.76, 1.13

2012-06-10 20:17:58 [1, 0]: httperf-lru-nostream-nogzip(httperf): Test name: httperf-lru-nostream-nogzip
2012-06-10 20:17:58 [1, 0]: httperf-lru-nostream-nogzip(httperf): Varnish options: 
2012-06-10 20:17:58 [1, 0]: httperf-lru-nostream-nogzip(httperf): -t=3600
2012-06-10 20:17:58 [1, 0]: httperf-lru-nostream-nogzip(httperf): -s=malloc,30M
2012-06-10 20:17:58 [1, 0]: httperf-lru-nostream-nogzip(httperf): Varnish parameters: 
2012-06-10 20:17:58 [1, 0]: httperf-lru-nostream-nogzip(httperf): thread_stats_rate=1
2012-06-10 20:17:58 [1, 0]: httperf-lru-nostream-nogzip(httperf): thread_pool_max=5000
2012-06-10 20:17:58 [1, 0]: httperf-lru-nostream-nogzip(httperf): nuke_limit=250
2012-06-10 20:17:58 [1, 0]: httperf-lru-nostream-nogzip(httperf): http_gzip_support=off
2012-06-10 20:17:58 [1, 0]: httperf-lru-nostream-nogzip(httperf): thread_pool_min=200
2012-06-10 20:17:58 [1, 0]: httperf-lru-nostream-nogzip(httperf): Payload size (excludes headers): 10K
2012-06-10 20:17:58 [1, 0]: httperf-lru-nostream-nogzip(httperf): Branch: master
2012-06-10 20:17:58 [1, 0]: httperf-lru-nostream-nogzip(httperf): Number of clients involved: 24
2012-06-10 20:17:58 [1, 0]: httperf-lru-nostream-nogzip(httperf): Type of test: httperf
2012-06-10 20:17:58 [1, 0]: httperf-lru-nostream-nogzip(httperf): Test iterations: 1
2012-06-10 20:17:58 [1, 0]: httperf-lru-nostream-nogzip(httperf): Runtime: 220 seconds
2012-06-10 20:17:58 [1, 0]: httperf-lru-nostream-nogzip(httperf): VCL: 
backend foo {
	.host = "localhost";
	.port = "80";
}

sub vcl_fetch {
	set beresp.do_stream = false;
}

2012-06-10 20:17:58 [1, 0]: httperf-lru-nostream-nogzip(httperf): Number of total connections: 200000
2012-06-10 20:17:58 [1, 0]: httperf-lru-nostream-nogzip(httperf): Note: connections are subject to rounding when divided among clients. Expect slight deviations.
2012-06-10 20:17:58 [1, 0]: httperf-lru-nostream-nogzip(httperf): Requests per connection: 10
2012-06-10 20:17:58 [1, 0]: httperf-lru-nostream-nogzip(httperf): Extra options to httperf: --wset=1000000,0.1
2012-06-10 20:17:58 [1, 0]: httperf-lru-nostream-nogzip(httperf): Httperf command (last client): httperf --hog --timeout 60 --num-calls 10 --num-conns 8333 --port 8080 --burst-length 10 --client 23/24 --server 10.20.100.12 --wset=1000000,0.1
2012-06-10 20:18:04 [2, 6]: cold-gzip(httperf): Starting test
2012-06-10 20:21:31 WARNING [0,206]: cold-gzip(httperf): Panic detected. I think!
2012-06-10 20:21:31 WARNING [0, 0]: cold-gzip(httperf): 
Last panic at: Sun, 10 Jun 2012 20:19:44 GMT
Assert error in cnt_first(), cache/cache_center.c line 943:
  Condition(req->sp == sp) not true.
thread = (cache-worker)
ident = Linux,2.6.32-38-generic,x86_64,-smalloc,-smalloc,-hcritbit,epoll
Backtrace:
  0x431d88: pan_ic+d8
  0x41b021: CNT_Session+781
  0x43670d: ses_pool_task+fd
  0x433592: Pool_Work_Thread+112
  0x441128: wrk_thread_real+c8
  0x7f708e4ee9ca: _end+7f708de6a202
  0x7f708e24bcdd: _end+7f708dbc7515
sp = 0x7f7078924120 {
  fd = 16, id = 16, xid = 0,
  client =  ,
  step = STP_FIRST,
  handling = deliver,
  restarts = 0, esi_level = 0
  ws = 0x7f707e7d5158 { 
    id = "req",
    {s,f,r,e} = {0x7f707e7d6730,0x7f707e7d6730,(nil),+59632},
  },
  http[req] = {
    ws = (nil)[]
  },
  worker = 0x7f707f17ac60 {
    ws = 0x7f707f17ae20 { 
      id = "wrk",
      {s,f,r,e} = {0x7f707f17a450,0x7f707f17a450,(nil),+2048},
    },
  },
},




2012-06-10 20:21:31 WARNING [0, 0]: cold-gzip(httperf): Varnishstat uptime and measured run-time is too large (measured: 203 stat: 106 diff: 97). Did we crash?
2012-06-10 20:24:56 WARNING [0,204]: cold-gzip(httperf): Panic detected. I think!
2012-06-10 20:24:56 WARNING [0, 0]: cold-gzip(httperf): 
Last panic at: Sun, 10 Jun 2012 20:23:12 GMT
Assert error in cnt_first(), cache/cache_center.c line 943:
  Condition(req->sp == sp) not true.
thread = (cache-worker)
ident = Linux,2.6.32-38-generic,x86_64,-smalloc,-smalloc,-hcritbit,epoll
Backtrace:
  0x431d88: pan_ic+d8
  0x41b021: CNT_Session+781
  0x43670d: ses_pool_task+fd
  0x433592: Pool_Work_Thread+112
  0x441128: wrk_thread_real+c8
  0x7f708e4ee9ca: _end+7f708de6a202
  0x7f708e24bcdd: _end+7f708dbc7515
sp = 0x7f707f503820 {
  fd = 16, id = 16, xid = 0,
  client =  ,
  step = STP_FIRST,
  handling = deliver,
  restarts = 0, esi_level = 0
  ws = 0x7f707e989158 { 
    id = "req",
    {s,f,r,e} = {0x7f707e98a730,0x7f707e98a730,(nil),+59632},
  },
  http[req] = {
    ws = (nil)[]
  },
  worker = 0x7f707f885c60 {
    ws = 0x7f707f885e20 { 
      id = "wrk",
      {s,f,r,e} = {0x7f707f885450,0x7f707f885450,(nil),+2048},
    },
  },
},




2012-06-10 20:24:56 WARNING [0, 0]: cold-gzip(httperf): Varnishstat uptime and measured run-time is too large (measured: 407 stat: 102 diff: 305). Did we crash?
2012-06-10 20:24:56 WARNING [0, 0]: cold-gzip(httperf): Out of bounds: client_req(150012) less than lower boundary 1589840
2012-06-10 20:24:56 [1, 0]: cold-gzip(httperf): Load:  22:24:56 up 10 days,  8:47,  0 users,  load average: 0.55, 0.68, 0.95

2012-06-10 20:24:56 [1, 0]: cold-gzip(httperf): Test name: cold-gzip
2012-06-10 20:24:56 [1, 0]: cold-gzip(httperf): Varnish options: 
2012-06-10 20:24:56 [1, 0]: cold-gzip(httperf): -t=3600
2012-06-10 20:24:56 [1, 0]: cold-gzip(httperf): -s=malloc,10G
2012-06-10 20:24:56 [1, 0]: cold-gzip(httperf): Varnish parameters: 
2012-06-10 20:24:56 [1, 0]: cold-gzip(httperf): thread_stats_rate=1
2012-06-10 20:24:56 [1, 0]: cold-gzip(httperf): http_gzip_support=on
2012-06-10 20:24:56 [1, 0]: cold-gzip(httperf): Payload size (excludes headers): 256
2012-06-10 20:24:56 [1, 0]: cold-gzip(httperf): Branch: master
2012-06-10 20:24:56 [1, 0]: cold-gzip(httperf): Number of clients involved: 24
2012-06-10 20:24:56 [1, 0]: cold-gzip(httperf): Type of test: httperf
2012-06-10 20:24:56 [1, 0]: cold-gzip(httperf): Test iterations: 2
2012-06-10 20:24:56 [1, 0]: cold-gzip(httperf): Runtime: 407 seconds
2012-06-10 20:24:56 [1, 0]: cold-gzip(httperf): VCL: 
backend foo {
	.host = "localhost";
	.port = "80";
}

sub vcl_fetch {
	set beresp.do_stream = true;
}

2012-06-10 20:24:56 [1, 0]: cold-gzip(httperf): Number of total connections: 80000
2012-06-10 20:24:56 [1, 0]: cold-gzip(httperf): Note: connections are subject to rounding when divided among clients. Expect slight deviations.
2012-06-10 20:24:56 [1, 0]: cold-gzip(httperf): Requests per connection: 10
2012-06-10 20:24:56 [1, 0]: cold-gzip(httperf): Extra options to httperf: --wset=4000000,0.50
2012-06-10 20:24:56 [1, 0]: cold-gzip(httperf): Httperf command (last client): httperf --hog --timeout 60 --num-calls 10 --num-conns 3333 --port 8080 --burst-length 10 --client 23/24 --server 10.20.100.12 --wset=4000000,0.50
2012-06-10 20:25:03 [2, 6]: 4gpluss(httperf): Starting test
2012-06-10 20:25:06 WARNING [0, 3]: Varnish failed to start. Fallback attempts starting
2012-06-10 20:25:06 [1, 0]: Removed (hopefully incompatible) parameter to try to start varnish. Key: thread_stats_rate=1
2012-06-10 20:25:07 [1, 0]: Removed (hopefully incompatible) parameter to try to start varnish. Key: thread_pool_max=300
2012-06-10 20:25:07 [1, 0]: Removed (hopefully incompatible) parameter to try to start varnish. Key: sess_timeout=60000s
2012-06-10 20:25:08 [1, 0]: Fallback worked. Parameter that seemed to cause problems: sess_timeout
2012-06-10 20:46:42 [2,1294]: httperf-lru-stream-gzip(httperf): Starting test
2012-06-10 20:50:21 WARNING [0,219]: httperf-lru-stream-gzip(httperf): Panic detected. I think!
2012-06-10 20:50:21 WARNING [0, 0]: httperf-lru-stream-gzip(httperf): 
Last panic at: Sun, 10 Jun 2012 20:49:27 GMT
Assert error in VCL_recv_method(), ../../include/tbl/vcl_returns.h line 27:
  Condition((req->sp) != NULL) not true.
thread = (cache-worker)
ident = Linux,2.6.32-38-generic,x86_64,-smalloc,-smalloc,-hcritbit,epoll
Backtrace:
  0x431d88: pan_ic+d8
  0x43a3b5: VCL_recv_method+1a5
  0x4164c5: cnt_recv+1e5
  0x41ae1d: CNT_Session+57d
  0x43670d: ses_pool_task+fd
  0x433592: Pool_Work_Thread+112
  0x441128: wrk_thread_real+c8
  0x7f30d90469ca: _end+7f30d89c2202
  0x7f30d8da3cdd: _end+7f30d871f515
sp = 0x7f30c9d15f20 {
  fd = 26, id = 26, xid = 1360894032,
  client = 10.20.100.9 16986,
  step = STP_RECV,
  handling = deliver,
  restarts = 0, esi_level = 0
  ws = 0x7f30c8b02158 { 
    id = "req",
    {s,f,r,e} = {0x7f30c8b03730,+168,(nil),+59632},
  },
  http[req] = {
    ws = 0x7f30c8b02158[req]
      "GET",
      "/1/9/1/2/8/7.html",
      "HTTP/1.1",
      "User-Agent: httperf/0.9.0",
      "Host: 10.20.100.12",
  },
  worker = 0x7f30c90c6c60 {
    ws = 0x7f30c90c6e20 { 
      id = "wrk",
      {s,f,r,e} = {0x7f30c90c6450,0x7f30c90c6450,(nil),+2048},
    },
  },
    vcl = {
      srcname = {
        "input",
        "Default",
      },
    },
},




2012-06-10 20:50:21 WARNING [0, 0]: httperf-lru-stream-gzip(httperf): Varnishstat uptime and measured run-time is too large (measured: 214 stat: 53 diff: 161). Did we crash?
2012-06-10 20:50:22 WARNING [0, 0]: httperf-lru-stream-gzip(httperf): Out of bounds: n_lru_nuked(0) less than lower boundary 80000
2012-06-10 20:50:22 WARNING [0, 0]: httperf-lru-stream-gzip(httperf): Out of bounds: client_req(51853) less than lower boundary 1989920
2012-06-10 20:50:22 [1, 0]: httperf-lru-stream-gzip(httperf): Load:  22:50:22 up 10 days,  9:13,  0 users,  load average: 0.60, 0.85, 1.16

2012-06-10 20:50:22 [1, 0]: httperf-lru-stream-gzip(httperf): Test name: httperf-lru-stream-gzip
2012-06-10 20:50:22 [1, 0]: httperf-lru-stream-gzip(httperf): Varnish options: 
2012-06-10 20:50:22 [1, 0]: httperf-lru-stream-gzip(httperf): -t=3600
2012-06-10 20:50:22 [1, 0]: httperf-lru-stream-gzip(httperf): -s=malloc,30M
2012-06-10 20:50:22 [1, 0]: httperf-lru-stream-gzip(httperf): Varnish parameters: 
2012-06-10 20:50:22 [1, 0]: httperf-lru-stream-gzip(httperf): thread_stats_rate=1
2012-06-10 20:50:22 [1, 0]: httperf-lru-stream-gzip(httperf): thread_pool_max=5000
2012-06-10 20:50:22 [1, 0]: httperf-lru-stream-gzip(httperf): nuke_limit=250
2012-06-10 20:50:22 [1, 0]: httperf-lru-stream-gzip(httperf): http_gzip_support=on
2012-06-10 20:50:22 [1, 0]: httperf-lru-stream-gzip(httperf): thread_pool_min=200
2012-06-10 20:50:22 [1, 0]: httperf-lru-stream-gzip(httperf): Payload size (excludes headers): 10K
2012-06-10 20:50:22 [1, 0]: httperf-lru-stream-gzip(httperf): Branch: master
2012-06-10 20:50:22 [1, 0]: httperf-lru-stream-gzip(httperf): Number of clients involved: 24
2012-06-10 20:50:22 [1, 0]: httperf-lru-stream-gzip(httperf): Type of test: httperf
2012-06-10 20:50:22 [1, 0]: httperf-lru-stream-gzip(httperf): Test iterations: 1
2012-06-10 20:50:22 [1, 0]: httperf-lru-stream-gzip(httperf): Runtime: 214 seconds
2012-06-10 20:50:22 [1, 0]: httperf-lru-stream-gzip(httperf): VCL: 
backend foo {
	.host = "localhost";
	.port = "80";
}

sub vcl_fetch {
	set beresp.do_stream = true;
}

2012-06-10 20:50:22 [1, 0]: httperf-lru-stream-gzip(httperf): Number of total connections: 200000
2012-06-10 20:50:22 [1, 0]: httperf-lru-stream-gzip(httperf): Note: connections are subject to rounding when divided among clients. Expect slight deviations.
2012-06-10 20:50:22 [1, 0]: httperf-lru-stream-gzip(httperf): Requests per connection: 10
2012-06-10 20:50:22 [1, 0]: httperf-lru-stream-gzip(httperf): Extra options to httperf: --wset=1000000,0.1
2012-06-10 20:50:22 [1, 0]: httperf-lru-stream-gzip(httperf): Httperf command (last client): httperf --hog --timeout 60 --num-calls 10 --num-conns 8333 --port 8080 --burst-length 10 --client 23/24 --server 10.20.100.12 --wset=1000000,0.1
2012-06-10 20:50:29 [2, 6]: httperf-lru-stream-nogzip(httperf): Starting test
2012-06-10 20:53:48 WARNING [0,199]: httperf-lru-stream-nogzip(httperf): Panic detected. I think!
2012-06-10 20:53:48 WARNING [0, 0]: httperf-lru-stream-nogzip(httperf): 
Last panic at: Sun, 10 Jun 2012 20:53:07 GMT
Assert error in VRT_l_beresp_do_stream(), cache/cache_vrt_var.c line 200:
  Condition((sp) != NULL) not true.
thread = (cache-worker)
ident = Linux,2.6.32-38-generic,x86_64,-smalloc,-smalloc,-hcritbit,epoll
Backtrace:
  0x431d88: pan_ic+d8
  0x43d32d: VRT_l_beresp_do_stream+8d
  0x7fa72acfb919: _end+7fa72a677151
  0x43978e: VCL_fetch_method+be
  0x4186a9: cnt_fetch+479
  0x41accd: CNT_Session+42d
  0x43670d: ses_pool_task+fd
  0x433592: Pool_Work_Thread+112
  0x441128: wrk_thread_real+c8
  0x7fa738ea09ca: _end+7fa73881c202
sp = 0x7fa727eac920 {
  fd = 15, id = 15, xid = 348701368,
  client = 10.20.100.8 13831,
  step = STP_FETCH,
  handling = deliver,
  err_code = 200, err_reason = (null),
  restarts = 0, esi_level = 0
  busyobj = 0x7fa729b24020 {
    ws = 0x7fa729b24070 { 
      id = "bo",
      {s,f,r,e} = {0x7fa729b25aa0,+240,(nil),+58752},
    },
    do_stream
    should_close
    bodystatus = 4 (length),
    },
    http[bereq] = {
      ws = 0x7fa729b24070[bo]
        "GET",
        "/1/5/3/1/8/3.html",
        "HTTP/1.1",
        "User-Agent: httperf/0.9.0",
        "Host: 10.20.100.12",
        "X-Forwarded-For: 10.20.100.8",
        "X-Varnish: 348701368",
    },
    http[beresp] = {
      ws = 0x7fa729b24070[bo]
        "HTTP/1.1",
        "200",
        "OK",
        "Server: nginx/0.7.65",
        "Date: Sun, 10 Jun 2012 20:53:07 GMT",
        "Content-Type: text/plain",
        "Content-Length: 10240",
        "Last-Modified: Sun, 10 Jun 2012 20:50:32 GMT",
        "Connection: close",
        "Accept-Ranges: bytes",
    },
  ws = 0x7fa729a24158 { 
    id = "req",
    {s,f,r,e} = {0x7fa729a25730,+136,(nil),+59632},
  },
  http[req] = {
    ws = 0x7fa729a24158[req]
      "GET",
      "/1/5/3/1/8/3.html",
      "HTTP/1.1",
      "User-Agent: httperf/0.9.0",
      "Host: 10.20.100.12",
      "X-Forwarded-For: 10.20.100.8",
  },
  worker = 0x7fa72910ec60 {
    ws = 0x7fa72910ee20 { 
      id = "wrk",
      {s,f,r,e} = {0x7fa72910e450,0x7fa72910e450,(nil),+2048},
    },
  },
    vcl = {
      srcname = {
        "input",
        "Default",
      },
    },
},




2012-06-10 20:53:48 WARNING [0, 0]: httperf-lru-stream-nogzip(httperf): Varnishstat uptime and measured run-time is too large (measured: 195 stat: 40 diff: 155). Did we crash?
2012-06-10 20:53:49 WARNING [0, 0]: httperf-lru-stream-nogzip(httperf): Out of bounds: n_lru_nuked(538) less than lower boundary 80000
2012-06-10 20:53:49 WARNING [0, 0]: httperf-lru-stream-nogzip(httperf): Out of bounds: client_req(34090) less than lower boundary 1989920
2012-06-10 20:53:49 [1, 0]: httperf-lru-stream-nogzip(httperf): Load:  22:53:49 up 10 days,  9:16,  0 users,  load average: 0.55, 0.80, 1.08

2012-06-10 20:53:49 [1, 0]: httperf-lru-stream-nogzip(httperf): Test name: httperf-lru-stream-nogzip
2012-06-10 20:53:49 [1, 0]: httperf-lru-stream-nogzip(httperf): Varnish options: 
2012-06-10 20:53:49 [1, 0]: httperf-lru-stream-nogzip(httperf): -t=3600
2012-06-10 20:53:49 [1, 0]: httperf-lru-stream-nogzip(httperf): -s=malloc,30M
2012-06-10 20:53:49 [1, 0]: httperf-lru-stream-nogzip(httperf): Varnish parameters: 
2012-06-10 20:53:49 [1, 0]: httperf-lru-stream-nogzip(httperf): thread_stats_rate=1
2012-06-10 20:53:49 [1, 0]: httperf-lru-stream-nogzip(httperf): thread_pool_max=5000
2012-06-10 20:53:49 [1, 0]: httperf-lru-stream-nogzip(httperf): nuke_limit=250
2012-06-10 20:53:49 [1, 0]: httperf-lru-stream-nogzip(httperf): http_gzip_support=off
2012-06-10 20:53:49 [1, 0]: httperf-lru-stream-nogzip(httperf): thread_pool_min=200
2012-06-10 20:53:49 [1, 0]: httperf-lru-stream-nogzip(httperf): Payload size (excludes headers): 10K
2012-06-10 20:53:49 [1, 0]: httperf-lru-stream-nogzip(httperf): Branch: master
2012-06-10 20:53:49 [1, 0]: httperf-lru-stream-nogzip(httperf): Number of clients involved: 24
2012-06-10 20:53:49 [1, 0]: httperf-lru-stream-nogzip(httperf): Type of test: httperf
2012-06-10 20:53:49 [1, 0]: httperf-lru-stream-nogzip(httperf): Test iterations: 1
2012-06-10 20:53:49 [1, 0]: httperf-lru-stream-nogzip(httperf): Runtime: 195 seconds
2012-06-10 20:53:49 [1, 0]: httperf-lru-stream-nogzip(httperf): VCL: 
backend foo {
	.host = "localhost";
	.port = "80";
}

sub vcl_fetch {
	set beresp.do_stream = true;
}

2012-06-10 20:53:49 [1, 0]: httperf-lru-stream-nogzip(httperf): Number of total connections: 200000
2012-06-10 20:53:49 [1, 0]: httperf-lru-stream-nogzip(httperf): Note: connections are subject to rounding when divided among clients. Expect slight deviations.
2012-06-10 20:53:49 [1, 0]: httperf-lru-stream-nogzip(httperf): Requests per connection: 10
2012-06-10 20:53:49 [1, 0]: httperf-lru-stream-nogzip(httperf): Extra options to httperf: --wset=1000000,0.1
2012-06-10 20:53:49 [1, 0]: httperf-lru-stream-nogzip(httperf): Httperf command (last client): httperf --hog --timeout 60 --num-calls 10 --num-conns 8333 --port 8080 --burst-length 10 --client 23/24 --server 10.20.100.12 --wset=1000000,0.1
2012-06-10 20:53:56 [2, 6]: basic-fryer(httperf): Starting test
2012-06-10 20:54:21 [2,24]: cold-nogzip(httperf): Starting test
2012-06-10 20:57:48 WARNING [0,207]: cold-nogzip(httperf): Panic detected. I think!
2012-06-10 20:57:48 WARNING [0, 0]: cold-nogzip(httperf): 
Last panic at: Sun, 10 Jun 2012 20:56:03 GMT
Assert error in VCL_recv_method(), ../../include/tbl/vcl_returns.h line 27:
  Condition((req->sp) != NULL) not true.
thread = (cache-worker)
ident = Linux,2.6.32-38-generic,x86_64,-smalloc,-smalloc,-hcritbit,epoll
Backtrace:
  0x431d88: pan_ic+d8
  0x43a3b5: VCL_recv_method+1a5
  0x4164c5: cnt_recv+1e5
  0x41ae1d: CNT_Session+57d
  0x43670d: ses_pool_task+fd
  0x433592: Pool_Work_Thread+112
  0x441128: wrk_thread_real+c8
  0x7f0b45afc9ca: _end+7f0b45478202
  0x7f0b45859cdd: _end+7f0b451d5515
sp = 0x7f0b34315620 {
  fd = 23, id = 23, xid = 1190877390,
  client = 10.20.100.8 4810,
  step = STP_RECV,
  handling = deliver,
  restarts = 0, esi_level = 0
  ws = 0x7f0b31384158 { 
    id = "req",
    {s,f,r,e} = {0x7f0b31385730,+256,(nil),+59632},
  },
  http[req] = {
    ws = 0x7f0b31384158[req]
      "GET",
      "/0/2/0/6/5/3/4.html",
      "HTTP/1.1",
      "User-Agent: httperf/0.9.0",
      "Host: 10.20.100.12",
  },
  worker = 0x7f0b3694ac60 {
    ws = 0x7f0b3694ae20 { 
      id = "wrk",
      {s,f,r,e} = {0x7f0b3694a450,0x7f0b3694a450,(nil),+2048},
    },
  },
    vcl = {
      srcname = {
        "input",
        "Default",
      },
    },
},




2012-06-10 20:57:48 WARNING [0, 0]: cold-nogzip(httperf): Varnishstat uptime and measured run-time is too large (measured: 203 stat: 104 diff: 99). Did we crash?
2012-06-10 21:01:06 WARNING [0,198]: cold-nogzip(httperf): Panic detected. I think!
2012-06-10 21:01:06 WARNING [0, 0]: cold-nogzip(httperf): 
Last panic at: Sun, 10 Jun 2012 20:59:25 GMT
Assert error in VCL_fetch_method(), ../../include/tbl/vcl_returns.h line 56:
  Condition((req->sp) != NULL) not true.
thread = (cache-worker)
ident = Linux,2.6.32-38-generic,x86_64,-smalloc,-smalloc,-hcritbit,epoll
Backtrace:
  0x431d88: pan_ic+d8
  0x439875: VCL_fetch_method+1a5
  0x4186a9: cnt_fetch+479
  0x41accd: CNT_Session+42d
  0x43670d: ses_pool_task+fd
  0x433592: Pool_Work_Thread+112
  0x441128: wrk_thread_real+c8
  0x7f0b45afc9ca: _end+7f0b45478202
  0x7f0b45859cdd: _end+7f0b451d5515
sp = 0x7f0b32b98d20 {
  fd = 25, id = 25, xid = 266030082,
  client = 10.20.100.9 5656,
  step = STP_FETCH,
  handling = fetch,
  err_code = 200, err_reason = (null),
  restarts = 0, esi_level = 0
  busyobj = 0x7f0b32103020 {
    ws = 0x7f0b32103070 { 
      id = "bo",
      {s,f,r,e} = {0x7f0b32104aa0,+504,(nil),+58752},
    },
    do_stream
    bodystatus = 4 (length),
    },
    http[bereq] = {
      ws = 0x7f0b32103070[bo]
        "GET",
        "/0/2/7/6/5/1/0.html",
        "HTTP/1.1",
        "User-Agent: httperf/0.9.0",
        "Host: 10.20.100.12",
        "X-Forwarded-For: 10.20.100.9",
        "X-Varnish: 266030082",
    },
    http[beresp] = {
      ws = 0x7f0b32103070[bo]
        "HTTP/1.1",
        "200",
        "OK",
        "Server: nginx/0.7.65",
        "Date: Sun, 10 Jun 2012 20:59:25 GMT",
        "Content-Type: text/plain",
        "Content-Length: 256",
        "Last-Modified: Sun, 10 Jun 2012 20:54:24 GMT",
        "Connection: keep-alive",
        "Accept-Ranges: bytes",
    },
  ws = 0x7f0b32950158 { 
    id = "req",
    {s,f,r,e} = {0x7f0b32951730,+216,(nil),+59632},
  },
  http[req] = {
    ws = 0x7f0b32950158[req]
      "GET",
      "/0/2/7/6/5/1/0.html",
      "HTTP/1.1",
      "User-Agent: httperf/0.9.0",
      "Host: 10.20.100.12",
      "X-Forwarded-For: 10.20.100.9",
  },
  worker = 0x7f0b36bcec60 {
    ws = 0x7f0b36bcee20 { 
      id = "wrk",
      {s,f,r,e} = {0x7f0b36bce450,0x7f0b36bce450,(nil),+2048},
    },
  },
    vcl = {
      srcname = {
        "input",
        "Default",
      },
    },
},




2012-06-10 21:01:06 WARNING [0, 0]: cold-nogzip(httperf): Varnishstat uptime and measured run-time is too large (measured: 401 stat: 100 diff: 301). Did we crash?
2012-06-10 21:01:07 WARNING [0, 0]: cold-nogzip(httperf): Out of bounds: client_req(145580) less than lower boundary 1589840
2012-06-10 21:01:07 [1, 0]: cold-nogzip(httperf): Load:  23:01:07 up 10 days,  9:24,  0 users,  load average: 0.50, 0.67, 0.90

2012-06-10 21:01:07 [1, 0]: cold-nogzip(httperf): Test name: cold-nogzip
2012-06-10 21:01:07 [1, 0]: cold-nogzip(httperf): Varnish options: 
2012-06-10 21:01:07 [1, 0]: cold-nogzip(httperf): -t=3600
2012-06-10 21:01:07 [1, 0]: cold-nogzip(httperf): -s=malloc,10G
2012-06-10 21:01:07 [1, 0]: cold-nogzip(httperf): Varnish parameters: 
2012-06-10 21:01:07 [1, 0]: cold-nogzip(httperf): thread_stats_rate=1
2012-06-10 21:01:07 [1, 0]: cold-nogzip(httperf): http_gzip_support=off
2012-06-10 21:01:07 [1, 0]: cold-nogzip(httperf): Payload size (excludes headers): 256
2012-06-10 21:01:07 [1, 0]: cold-nogzip(httperf): Branch: master
2012-06-10 21:01:07 [1, 0]: cold-nogzip(httperf): Number of clients involved: 24
2012-06-10 21:01:07 [1, 0]: cold-nogzip(httperf): Type of test: httperf
2012-06-10 21:01:07 [1, 0]: cold-nogzip(httperf): Test iterations: 2
2012-06-10 21:01:07 [1, 0]: cold-nogzip(httperf): Runtime: 401 seconds
2012-06-10 21:01:07 [1, 0]: cold-nogzip(httperf): VCL: 
backend foo {
	.host = "localhost";
	.port = "80";
}

sub vcl_fetch {
	set beresp.do_stream = true;
}

2012-06-10 21:01:07 [1, 0]: cold-nogzip(httperf): Number of total connections: 80000
2012-06-10 21:01:07 [1, 0]: cold-nogzip(httperf): Note: connections are subject to rounding when divided among clients. Expect slight deviations.
2012-06-10 21:01:07 [1, 0]: cold-nogzip(httperf): Requests per connection: 10
2012-06-10 21:01:07 [1, 0]: cold-nogzip(httperf): Extra options to httperf: --wset=4000000,0.50
2012-06-10 21:01:07 [1, 0]: cold-nogzip(httperf): Httperf command (last client): httperf --hog --timeout 60 --num-calls 10 --num-conns 3333 --port 8080 --burst-length 10 --client 23/24 --server 10.20.100.12 --wset=4000000,0.50
2012-06-10 21:01:15 [2, 7]: 4gpluss-nostream(httperf): Starting test
2012-06-10 21:01:18 WARNING [0, 3]: Varnish failed to start. Fallback attempts starting
2012-06-10 21:01:18 [1, 0]: Removed (hopefully incompatible) parameter to try to start varnish. Key: thread_stats_rate=1
2012-06-10 21:01:18 [1, 0]: Removed (hopefully incompatible) parameter to try to start varnish. Key: thread_pool_max=300
2012-06-10 21:01:19 [1, 0]: Removed (hopefully incompatible) parameter to try to start varnish. Key: sess_timeout=60000s
2012-06-10 21:01:20 [1, 0]: Fallback worked. Parameter that seemed to cause problems: sess_timeout
2012-06-10 21:21:11 [2,1190]: lru-random(httperf): Starting test
2012-06-10 21:32:47 [2,696]: siege-test(siege): Starting test
2012-06-10 21:33:06 WARNING [0,18]: siege-test(siege): Panic detected. I think!
2012-06-10 21:33:06 WARNING [0, 0]: siege-test(siege): 
Last panic at: Sun, 10 Jun 2012 21:32:52 GMT
Assert error in VCL_recv_method(), ../../include/tbl/vcl_returns.h line 27:
  Condition((req->sp) != NULL) not true.
thread = (cache-worker)
ident = Linux,2.6.32-38-generic,x86_64,-smalloc,-smalloc,-hcritbit,epoll
Backtrace:
  0x431d88: pan_ic+d8
  0x43a3b5: VCL_recv_method+1a5
  0x4164c5: cnt_recv+1e5
  0x41ae1d: CNT_Session+57d
  0x43670d: ses_pool_task+fd
  0x433592: Pool_Work_Thread+112
  0x441128: wrk_thread_real+c8
  0x7ff130ef99ca: _end+7ff130875202
  0x7ff130c56cdd: _end+7ff1305d2515
sp = 0x7ff1221ac920 {
  fd = 16, id = 16, xid = 172455205,
  client = 10.20.100.8 36312,
  step = STP_RECV,
  handling = deliver,
  restarts = 0, esi_level = 0
  ws = 0x7ff1221dd158 { 
    id = "req",
    {s,f,r,e} = {0x7ff1221de730,+152,(nil),+59632},
  },
  http[req] = {
    ws = 0x7ff1221dd158[req]
      "GET",
      "/",
      "HTTP/1.1",
      "Host: 10.20.100.12:8080",
      "Accept: */*",
      "Accept-Encoding: gzip",
      "User-Agent: JoeDog/1.00 [en] (X11; I; Siege 2.66)",
      "Connection: close",
  },
  worker = 0x7ff122590c60 {
    ws = 0x7ff122590e20 { 
      id = "wrk",
      {s,f,r,e} = {0x7ff122590450,0x7ff122590450,(nil),+2048},
    },
  },
    vcl = {
      srcname = {
        "input",
        "Default",
      },
    },
},




2012-06-10 21:33:07 [1, 0]: siege-test(siege): Load:  23:33:07 up 10 days,  9:56,  0 users,  load average: 0.28, 0.39, 0.49

2012-06-10 21:33:07 [1, 0]: siege-test(siege): Test name: siege-test
2012-06-10 21:33:07 [1, 0]: siege-test(siege): Varnish options: 
2012-06-10 21:33:07 [1, 0]: siege-test(siege): Varnish parameters: 
2012-06-10 21:33:07 [1, 0]: siege-test(siege): thread_stats_rate=1
2012-06-10 21:33:07 [1, 0]: siege-test(siege): Payload size (excludes headers): 256
2012-06-10 21:33:07 [1, 0]: siege-test(siege): Branch: master
2012-06-10 21:33:07 [1, 0]: siege-test(siege): Number of clients involved: 0
2012-06-10 21:33:07 [1, 0]: siege-test(siege): Type of test: siege
2012-06-10 21:33:07 [1, 0]: siege-test(siege): Test iterations: 1
2012-06-10 21:33:07 [1, 0]: siege-test(siege): Runtime: 15 seconds
2012-06-10 21:33:07 [1, 0]: siege-test(siege): VCL: 
backend foo {
	.host = "localhost";
	.port = "80";
}

sub vcl_fetch {
	set beresp.do_stream = true;
}

2012-06-10 21:33:13 [2, 6]: httperf-lru-nostream-default(httperf): Starting test
2012-06-10 21:36:37 WARNING [0,203]: httperf-lru-nostream-default(httperf): Panic detected. I think!
2012-06-10 21:36:37 WARNING [0, 0]: httperf-lru-nostream-default(httperf): 
Last panic at: Sun, 10 Jun 2012 21:35:24 GMT
Assert error in VCL_recv_method(), ../../include/tbl/vcl_returns.h line 27:
  Condition((req->sp) != NULL) not true.
thread = (cache-worker)
ident = Linux,2.6.32-38-generic,x86_64,-smalloc,-smalloc,-hcritbit,epoll
Backtrace:
  0x431d88: pan_ic+d8
  0x43a3b5: VCL_recv_method+1a5
  0x4164c5: cnt_recv+1e5
  0x41ae1d: CNT_Session+57d
  0x43670d: ses_pool_task+fd
  0x433592: Pool_Work_Thread+112
  0x441128: wrk_thread_real+c8
  0x7f13c9b949ca: _end+7f13c9510202
  0x7f13c98f1cdd: _end+7f13c926d515
sp = 0x7f13ba104120 {
  fd = 14, id = 14, xid = 600344449,
  client = 10.20.100.8 14418,
  step = STP_RECV,
  handling = deliver,
  restarts = 0, esi_level = 0
  ws = 0x7f13b8c14158 { 
    id = "req",
    {s,f,r,e} = {0x7f13b8c15730,+408,(nil),+59632},
  },
  http[req] = {
    ws = 0x7f13b8c14158[req]
      "GET",
      "/1/6/2/5/8/5.html",
      "HTTP/1.1",
      "User-Agent: httperf/0.9.0",
      "Host: 10.20.100.12",
  },
  worker = 0x7f13ba356c60 {
    ws = 0x7f13ba356e20 { 
      id = "wrk",
      {s,f,r,e} = {0x7f13ba356450,0x7f13ba356450,(nil),+2048},
    },
  },
    vcl = {
      srcname = {
        "input",
        "Default",
      },
    },
},




2012-06-10 21:36:37 WARNING [0, 0]: httperf-lru-nostream-default(httperf): Varnishstat uptime and measured run-time is too large (measured: 200 stat: 72 diff: 128). Did we crash?
2012-06-10 21:36:38 WARNING [0, 0]: httperf-lru-nostream-default(httperf): Out of bounds: n_lru_nuked(0) less than lower boundary 80000
2012-06-10 21:36:38 WARNING [0, 0]: httperf-lru-nostream-default(httperf): Out of bounds: client_req(50880) less than lower boundary 1989920
2012-06-10 21:36:38 [1, 0]: httperf-lru-nostream-default(httperf): Load:  23:36:38 up 10 days,  9:59,  0 users,  load average: 0.62, 0.84, 0.67

2012-06-10 21:36:38 [1, 0]: httperf-lru-nostream-default(httperf): Test name: httperf-lru-nostream-default
2012-06-10 21:36:38 [1, 0]: httperf-lru-nostream-default(httperf): Varnish options: 
2012-06-10 21:36:38 [1, 0]: httperf-lru-nostream-default(httperf): -t=3600
2012-06-10 21:36:38 [1, 0]: httperf-lru-nostream-default(httperf): -s=malloc,30M
2012-06-10 21:36:38 [1, 0]: httperf-lru-nostream-default(httperf): Varnish parameters: 
2012-06-10 21:36:38 [1, 0]: httperf-lru-nostream-default(httperf): thread_stats_rate=1
2012-06-10 21:36:38 [1, 0]: httperf-lru-nostream-default(httperf): thread_pool_max=5000
2012-06-10 21:36:38 [1, 0]: httperf-lru-nostream-default(httperf): nuke_limit=250
2012-06-10 21:36:38 [1, 0]: httperf-lru-nostream-default(httperf): thread_pool_min=200
2012-06-10 21:36:38 [1, 0]: httperf-lru-nostream-default(httperf): Payload size (excludes headers): 10K
2012-06-10 21:36:38 [1, 0]: httperf-lru-nostream-default(httperf): Branch: master
2012-06-10 21:36:38 [1, 0]: httperf-lru-nostream-default(httperf): Number of clients involved: 24
2012-06-10 21:36:38 [1, 0]: httperf-lru-nostream-default(httperf): Type of test: httperf
2012-06-10 21:36:38 [1, 0]: httperf-lru-nostream-default(httperf): Test iterations: 1
2012-06-10 21:36:38 [1, 0]: httperf-lru-nostream-default(httperf): Runtime: 200 seconds
2012-06-10 21:36:38 [1, 0]: httperf-lru-nostream-default(httperf): VCL: 
backend foo {
	.host = "localhost";
	.port = "80";
}

sub vcl_fetch {
	set beresp.do_stream = false;
}

2012-06-10 21:36:38 [1, 0]: httperf-lru-nostream-default(httperf): Number of total connections: 200000
2012-06-10 21:36:38 [1, 0]: httperf-lru-nostream-default(httperf): Note: connections are subject to rounding when divided among clients. Expect slight deviations.
2012-06-10 21:36:38 [1, 0]: httperf-lru-nostream-default(httperf): Requests per connection: 10
2012-06-10 21:36:38 [1, 0]: httperf-lru-nostream-default(httperf): Extra options to httperf: --wset=1000000,0.1
2012-06-10 21:36:38 [1, 0]: httperf-lru-nostream-default(httperf): Httperf command (last client): httperf --hog --timeout 60 --num-calls 10 --num-conns 8333 --port 8080 --burst-length 10 --client 23/24 --server 10.20.100.12 --wset=1000000,0.1
2012-06-10 21:36:45 [2, 6]: httperf-rapid-expire(httperf): Starting test
2012-06-10 21:37:58 WARNING [0,73]: httperf-rapid-expire(httperf): Panic detected. I think!
2012-06-10 21:37:58 WARNING [0, 0]: httperf-rapid-expire(httperf): 
Last panic at: Sun, 10 Jun 2012 21:37:20 GMT
Assert error in cnt_first(), cache/cache_center.c line 943:
  Condition(req->sp == sp) not true.
thread = (cache-worker)
ident = Linux,2.6.32-38-generic,x86_64,-smalloc,-smalloc,-hcritbit,epoll
Backtrace:
  0x431d88: pan_ic+d8
  0x41b021: CNT_Session+781
  0x43670d: ses_pool_task+fd
  0x433592: Pool_Work_Thread+112
  0x441128: wrk_thread_real+c8
  0x7fd76f8759ca: _end+7fd76f1f1202
  0x7fd76f5d2cdd: _end+7fd76ef4e515
sp = 0x7fd75fa02320 {
  fd = 22, id = 22, xid = 0,
  client =  ,
  step = STP_FIRST,
  handling = deliver,
  restarts = 0, esi_level = 0
  ws = 0x7fd75f857158 { 
    id = "req",
    {s,f,r,e} = {0x7fd75f858730,0x7fd75f858730,(nil),+59632},
  },
  http[req] = {
    ws = (nil)[]
  },
  worker = 0x7fd7618cec60 {
    ws = 0x7fd7618cee20 { 
      id = "wrk",
      {s,f,r,e} = {0x7fd7618ce450,0x7fd7618ce450,(nil),+2048},
    },
  },
},




2012-06-10 21:37:58 WARNING [0, 0]: httperf-rapid-expire(httperf): Varnishstat uptime and measured run-time is too large (measured: 69 stat: 36 diff: 33). Did we crash?
2012-06-10 21:37:58 WARNING [0, 0]: httperf-rapid-expire(httperf): Out of bounds: client_req(62930) less than lower boundary 989840
2012-06-10 21:37:58 [1, 0]: httperf-rapid-expire(httperf): Load:  23:37:58 up 10 days, 10:00,  0 users,  load average: 0.55, 0.79, 0.66

2012-06-10 21:37:58 [1, 0]: httperf-rapid-expire(httperf): Test name: httperf-rapid-expire
2012-06-10 21:37:58 [1, 0]: httperf-rapid-expire(httperf): Varnish options: 
2012-06-10 21:37:58 [1, 0]: httperf-rapid-expire(httperf): -t=2
2012-06-10 21:37:58 [1, 0]: httperf-rapid-expire(httperf): Varnish parameters: 
2012-06-10 21:37:58 [1, 0]: httperf-rapid-expire(httperf): thread_stats_rate=1
2012-06-10 21:37:58 [1, 0]: httperf-rapid-expire(httperf): Payload size (excludes headers): 256
2012-06-10 21:37:58 [1, 0]: httperf-rapid-expire(httperf): Branch: master
2012-06-10 21:37:58 [1, 0]: httperf-rapid-expire(httperf): Number of clients involved: 24
2012-06-10 21:37:58 [1, 0]: httperf-rapid-expire(httperf): Type of test: httperf
2012-06-10 21:37:58 [1, 0]: httperf-rapid-expire(httperf): Test iterations: 1
2012-06-10 21:37:58 [1, 0]: httperf-rapid-expire(httperf): Runtime: 69 seconds
2012-06-10 21:37:58 [1, 0]: httperf-rapid-expire(httperf): VCL: 
backend foo {
	.host = "localhost";
	.port = "80";
}

sub vcl_fetch {
	set beresp.do_stream = true;
}

2012-06-10 21:37:58 [1, 0]: httperf-rapid-expire(httperf): Number of total connections: 100000
2012-06-10 21:37:58 [1, 0]: httperf-rapid-expire(httperf): Note: connections are subject to rounding when divided among clients. Expect slight deviations.
2012-06-10 21:37:58 [1, 0]: httperf-rapid-expire(httperf): Requests per connection: 10
2012-06-10 21:37:58 [1, 0]: httperf-rapid-expire(httperf): Extra options to httperf: --wset=100,0.30
2012-06-10 21:37:58 [1, 0]: httperf-rapid-expire(httperf): Httperf command (last client): httperf --hog --timeout 60 --num-calls 10 --num-conns 4166 --port 8080 --burst-length 10 --client 23/24 --server 10.20.100.12 --wset=100,0.30
2012-06-10 21:38:05 [2, 6]: streaming-grace(httperf): Starting test
2012-06-10 21:40:58 [2,173]: cold-default(httperf): Starting test
2012-06-10 21:44:17 WARNING [0,199]: cold-default(httperf): Panic detected. I think!
2012-06-10 21:44:17 WARNING [0, 0]: cold-default(httperf): 
Last panic at: Sun, 10 Jun 2012 21:42:56 GMT
Assert error in cnt_first(), cache/cache_center.c line 943:
  Condition(req->sp == sp) not true.
thread = (cache-worker)
ident = Linux,2.6.32-38-generic,x86_64,-smalloc,-smalloc,-hcritbit,epoll
Backtrace:
  0x431d88: pan_ic+d8
  0x41b021: CNT_Session+781
  0x43670d: ses_pool_task+fd
  0x433592: Pool_Work_Thread+112
  0x441128: wrk_thread_real+c8
  0x7f13be4549ca: _end+7f13bddd0202
  0x7f13be1b1cdd: _end+7f13bdb2d515
sp = 0x7f13ac17a220 {
  fd = 28, id = 28, xid = 0,
  client =  ,
  step = STP_FIRST,
  handling = deliver,
  restarts = 0, esi_level = 0
  ws = 0x7f13aed8c158 { 
    id = "req",
    {s,f,r,e} = {0x7f13aed8d730,0x7f13aed8d730,(nil),+59632},
  },
  http[req] = {
    ws = (nil)[]
  },
  worker = 0x7f13b010dc60 {
    ws = 0x7f13b010de20 { 
      id = "wrk",
      {s,f,r,e} = {0x7f13b010d450,0x7f13b010d450,(nil),+2048},
    },
  },
},




2012-06-10 21:44:17 WARNING [0, 0]: cold-default(httperf): Varnishstat uptime and measured run-time is too large (measured: 194 stat: 80 diff: 114). Did we crash?
2012-06-10 21:47:42 WARNING [0,204]: cold-default(httperf): Panic detected. I think!
2012-06-10 21:47:42 WARNING [0, 0]: cold-default(httperf): 
Last panic at: Sun, 10 Jun 2012 21:46:07 GMT
Assert error in VCL_recv_method(), ../../include/tbl/vcl_returns.h line 27:
  Condition((req->sp) != NULL) not true.
thread = (cache-worker)
ident = Linux,2.6.32-38-generic,x86_64,-smalloc,-smalloc,-hcritbit,epoll
Backtrace:
  0x431d88: pan_ic+d8
  0x43a3b5: VCL_recv_method+1a5
  0x4164c5: cnt_recv+1e5
  0x41ae1d: CNT_Session+57d
  0x43670d: ses_pool_task+fd
  0x433592: Pool_Work_Thread+112
  0x441128: wrk_thread_real+c8
  0x7f13be4549ca: _end+7f13bddd0202
  0x7f13be1b1cdd: _end+7f13bdb2d515
sp = 0x7f13a76a2f20 {
  fd = 30, id = 30, xid = 436239734,
  client = 10.20.100.9 5135,
  step = STP_RECV,
  handling = deliver,
  restarts = 0, esi_level = 0
  ws = 0x7f13a757e158 { 
    id = "req",
    {s,f,r,e} = {0x7f13a757f730,+256,(nil),+59632},
  },
  http[req] = {
    ws = 0x7f13a757e158[req]
      "GET",
      "/0/2/2/1/8/8/4.html",
      "HTTP/1.1",
      "User-Agent: httperf/0.9.0",
      "Host: 10.20.100.12",
  },
  worker = 0x7f13b0180c60 {
    ws = 0x7f13b0180e20 { 
      id = "wrk",
      {s,f,r,e} = {0x7f13b0180450,0x7f13b0180450,(nil),+2048},
    },
  },
    vcl = {
      srcname = {
        "input",
        "Default",
      },
    },
},




2012-06-10 21:47:42 WARNING [0, 0]: cold-default(httperf): Varnishstat uptime and measured run-time is too large (measured: 399 stat: 94 diff: 305). Did we crash?
2012-06-10 21:47:42 WARNING [0, 0]: cold-default(httperf): Out of bounds: uptime(94) less than lower boundary 100
2012-06-10 21:47:42 WARNING [0, 0]: cold-default(httperf): Out of bounds: client_req(169010) less than lower boundary 1589840
2012-06-10 21:47:42 [1, 0]: cold-default(httperf): Load:  23:47:42 up 10 days, 10:10,  0 users,  load average: 0.57, 0.71, 0.67

2012-06-10 21:47:42 [1, 0]: cold-default(httperf): Test name: cold-default
2012-06-10 21:47:42 [1, 0]: cold-default(httperf): Varnish options: 
2012-06-10 21:47:42 [1, 0]: cold-default(httperf): -t=3600
2012-06-10 21:47:42 [1, 0]: cold-default(httperf): -s=malloc,10G
2012-06-10 21:47:42 [1, 0]: cold-default(httperf): Varnish parameters: 
2012-06-10 21:47:42 [1, 0]: cold-default(httperf): thread_stats_rate=1
2012-06-10 21:47:42 [1, 0]: cold-default(httperf): Payload size (excludes headers): 256
2012-06-10 21:47:42 [1, 0]: cold-default(httperf): Branch: master
2012-06-10 21:47:42 [1, 0]: cold-default(httperf): Number of clients involved: 24
2012-06-10 21:47:42 [1, 0]: cold-default(httperf): Type of test: httperf
2012-06-10 21:47:42 [1, 0]: cold-default(httperf): Test iterations: 2
2012-06-10 21:47:42 [1, 0]: cold-default(httperf): Runtime: 399 seconds
2012-06-10 21:47:42 [1, 0]: cold-default(httperf): VCL: 
backend foo {
	.host = "localhost";
	.port = "80";
}

sub vcl_fetch {
	set beresp.do_stream = true;
}

2012-06-10 21:47:42 [1, 0]: cold-default(httperf): Number of total connections: 80000
2012-06-10 21:47:42 [1, 0]: cold-default(httperf): Note: connections are subject to rounding when divided among clients. Expect slight deviations.
2012-06-10 21:47:42 [1, 0]: cold-default(httperf): Requests per connection: 10
2012-06-10 21:47:42 [1, 0]: cold-default(httperf): Extra options to httperf: --wset=4000000,0.50
2012-06-10 21:47:42 [1, 0]: cold-default(httperf): Httperf command (last client): httperf --hog --timeout 60 --num-calls 10 --num-conns 3333 --port 8080 --burst-length 10 --client 23/24 --server 10.20.100.12 --wset=4000000,0.50
2012-06-10 21:47:49 [2, 6]: 4gpluss-nogzip(httperf): Starting test
2012-06-10 21:47:52 WARNING [0, 2]: Varnish failed to start. Fallback attempts starting
2012-06-10 21:47:52 [1, 0]: Removed (hopefully incompatible) parameter to try to start varnish. Key: thread_stats_rate=1
2012-06-10 21:47:53 [1, 0]: Removed (hopefully incompatible) parameter to try to start varnish. Key: thread_pool_max=300
2012-06-10 21:47:53 [1, 0]: Removed (hopefully incompatible) parameter to try to start varnish. Key: sess_timeout=60000s
2012-06-10 21:47:54 [1, 0]: Fallback worked. Parameter that seemed to cause problems: sess_timeout
2012-06-10 22:09:30 [2,1296]: purge-fail(httperf): Starting test
2012-06-10 22:13:25 WARNING [0,234]: purge-fail(httperf): Panic detected. I think!
2012-06-10 22:13:25 WARNING [0, 0]: purge-fail(httperf): 
Last panic at: Sun, 10 Jun 2012 22:12:44 GMT
Assert error in VCL_recv_method(), ../../include/tbl/vcl_returns.h line 27:
  Condition((req->sp) != NULL) not true.
thread = (cache-worker)
ident = Linux,2.6.32-38-generic,x86_64,-smalloc,-smalloc,-hcritbit,epoll
Backtrace:
  0x431d88: pan_ic+d8
  0x43a3b5: VCL_recv_method+1a5
  0x4164c5: cnt_recv+1e5
  0x41ae1d: CNT_Session+57d
  0x43670d: ses_pool_task+fd
  0x433592: Pool_Work_Thread+112
  0x441128: wrk_thread_real+c8
  0x7fd77c2469ca: _end+7fd77bbc2202
  0x7fd77bfa3cdd: _end+7fd77b91f515
sp = 0x7fd76ea0e120 {
  fd = 12, id = 12, xid = 537662652,
  client = 10.20.100.7 24275,
  step = STP_RECV,
  handling = deliver,
  restarts = 0, esi_level = 0
  ws = 0x7fd76d382158 { 
    id = "req",
    {s,f,r,e} = {0x7fd76d383730,+80,(nil),+59632},
  },
  http[req] = {
    ws = 0x7fd76d382158[req]
      "GET",
      "/8/3/8.html",
      "HTTP/1.1",
      "User-Agent: httperf/0.9.0",
      "Host: 10.20.100.12",
  },
  worker = 0x7fd76d6c9c60 {
    ws = 0x7fd76d6c9e20 { 
      id = "wrk",
      {s,f,r,e} = {0x7fd76d6c9450,0x7fd76d6c9450,(nil),+2048},
    },
  },
    vcl = {
      srcname = {
        "input",
        "Default",
      },
    },
},




2012-06-10 22:13:25 WARNING [0, 0]: purge-fail(httperf): Varnishstat uptime and measured run-time is too large (measured: 230 stat: 40 diff: 190). Did we crash?
2012-06-10 22:13:26 WARNING [0, 0]: purge-fail(httperf): Out of bounds: client_req(29216) less than lower boundary 290000
2012-06-10 22:13:26 [1, 0]: purge-fail(httperf): Load:  00:13:26 up 10 days, 10:36,  0 users,  load average: 1.42, 1.73, 1.50

2012-06-10 22:13:26 [1, 0]: purge-fail(httperf): Test name: purge-fail
2012-06-10 22:13:26 [1, 0]: purge-fail(httperf): Varnish options: 
2012-06-10 22:13:26 [1, 0]: purge-fail(httperf): Varnish parameters: 
2012-06-10 22:13:26 [1, 0]: purge-fail(httperf): thread_stats_rate=1
2012-06-10 22:13:26 [1, 0]: purge-fail(httperf): Payload size (excludes headers): 1K
2012-06-10 22:13:26 [1, 0]: purge-fail(httperf): Branch: master
2012-06-10 22:13:26 [1, 0]: purge-fail(httperf): Number of clients involved: 24
2012-06-10 22:13:26 [1, 0]: purge-fail(httperf): Type of test: httperf
2012-06-10 22:13:26 [1, 0]: purge-fail(httperf): Test iterations: 1
2012-06-10 22:13:26 [1, 0]: purge-fail(httperf): Runtime: 230 seconds
2012-06-10 22:13:26 [1, 0]: purge-fail(httperf): VCL: 
backend foo {
	.host = "localhost";
	.port = "80";
}

sub vcl_recv {
	if (!req.url ~ "/0/0.html") {
		set req.request = "PURGE";
	}
	set req.url = "/foo";
	return (lookup);
}
sub vcl_hit {
	if (req.request == "PURGE") {
		set obj.ttl = 0s;
		error 200 "OK";
	}
}
sub vcl_miss {
	if (req.request == "PURGE") {
		error 200 "Not in cache but not confusing httperf";
	}
}


2012-06-10 22:13:26 [1, 0]: purge-fail(httperf): Number of total connections: 300000
2012-06-10 22:13:26 [1, 0]: purge-fail(httperf): Note: connections are subject to rounding when divided among clients. Expect slight deviations.
2012-06-10 22:13:26 [1, 0]: purge-fail(httperf): Requests per connection: 1
2012-06-10 22:13:26 [1, 0]: purge-fail(httperf): Extra options to httperf: --wset=999,0.5 --timeout=5
2012-06-10 22:13:26 [1, 0]: purge-fail(httperf): Httperf command (last client): httperf --hog --timeout 60 --num-calls 1 --num-conns 12500 --port 8080 --burst-length 10 --client 23/24 --server 10.20.100.12 --wset=999,0.5 --timeout=5
2012-06-10 22:13:33 [2, 6]: streaming-gzip(httperf): Starting test
2012-06-10 22:16:06 WARNING [0,153]: Tests finished with problems detected. Failed expectations: 15 Total run time: 9845 seconds 



More information about the varnish-test mailing list