[Fryer] master FAIL. 10 of 26 tests succeeded.

fryer at oneiros.varnish-software.com fryer at oneiros.varnish-software.com
Wed Mar 14 00:26:17 CET 2012


Tests Failed: httperf-lru-nostream-gzip httperf-lru-nostream-gzip-deflateoff streaming httperf-lru-default memleak httperf-lru-stream-default httperf-lru-nostream-nogzip cold-gzip httperf-lru-stream-gzip httperf-lru-stream-nogzip cold-nogzip lru-random httperf-lru-nostream-default streaming-grace cold-default 4gpluss-nogzip 


Tests OK: 4gpluss-stream httperf-hot 4gpluss basic-fryer 4gpluss-nostream siege-test sky-misc httperf-rapid-expire purge-fail streaming-gzip 



2012-03-13 20:32:25 [1,22]: Server tristran checked out varnish-3.0.0-beta2-890-gd74bc62 of branch master
2012-03-13 20:34:03 [2,98]: httperf-lru-nostream-gzip(httperf): Starting test
2012-03-13 20:39:52 WARNING [0,349]: httperf-lru-nostream-gzip(httperf): Panic detected. I think!
2012-03-13 20:39:52 WARNING [0, 0]: httperf-lru-nostream-gzip(httperf): 
Last panic at: Tue, 13 Mar 2012 20:39:31 GMT
Assert error in FetchBody(), cache/cache_fetch.c line 671:
  Condition(uu == obj->len) not true.
errno = 11 (Resource temporarily unavailable)
thread = (cache-worker)
ident = Linux,2.6.32-39-server,x86_64,-smalloc,-smalloc,-hcritbit,epoll
Backtrace:
  0x431a58: pan_ic+d8
  0x4253cd: FetchBody+78d
  0x433242: Pool_Work_Thread+112
  0x440488: wrk_thread_real+c8
  0x7f8dcbbea9ca: _end+7f8dcb567212
  0x7f8dcb947cdd: _end+7f8dcb2c4525




2012-03-13 20:39:52 [1, 0]: httperf-lru-nostream-gzip(httperf): Varnishstat uptime and measured run-time is too large (measured: 344 stat: 20 diff: 324). Did we crash?
2012-03-13 20:39:53 WARNING [0, 0]: httperf-lru-nostream-gzip(httperf): Out of bounds: n_lru_nuked(0) less than lower boundary 80000
2012-03-13 20:39:53 WARNING [0, 0]: httperf-lru-nostream-gzip(httperf): Out of bounds: client_req(34722) less than lower boundary 1999720
2012-03-13 20:39:53 [1, 0]: httperf-lru-nostream-gzip(httperf): Load:  21:39:53 up 1 day,  9:25,  0 users,  load average: 5.86, 6.83, 3.38

2012-03-13 20:39:53 [1, 0]: httperf-lru-nostream-gzip(httperf): Test name: httperf-lru-nostream-gzip
2012-03-13 20:39:53 [1, 0]: httperf-lru-nostream-gzip(httperf): Varnish options: 
2012-03-13 20:39:53 [1, 0]: httperf-lru-nostream-gzip(httperf): -t=3600
2012-03-13 20:39:53 [1, 0]: httperf-lru-nostream-gzip(httperf): -w=200,5000
2012-03-13 20:39:53 [1, 0]: httperf-lru-nostream-gzip(httperf): -s=malloc,30M
2012-03-13 20:39:53 [1, 0]: httperf-lru-nostream-gzip(httperf): Varnish parameters: 
2012-03-13 20:39:53 [1, 0]: httperf-lru-nostream-gzip(httperf): nuke_limit=250
2012-03-13 20:39:53 [1, 0]: httperf-lru-nostream-gzip(httperf): http_gzip_support=on
2012-03-13 20:39:53 [1, 0]: httperf-lru-nostream-gzip(httperf): Payload size (excludes headers): 10K
2012-03-13 20:39:53 [1, 0]: httperf-lru-nostream-gzip(httperf): Branch: master
2012-03-13 20:39:53 [1, 0]: httperf-lru-nostream-gzip(httperf): Number of clients involved: 24
2012-03-13 20:39:53 [1, 0]: httperf-lru-nostream-gzip(httperf): Type of test: httperf
2012-03-13 20:39:53 [1, 0]: httperf-lru-nostream-gzip(httperf): Test iterations: 1
2012-03-13 20:39:53 [1, 0]: httperf-lru-nostream-gzip(httperf): Runtime: 344 seconds
2012-03-13 20:39:53 [1, 0]: httperf-lru-nostream-gzip(httperf): VCL: 
backend foo {
	.host = "localhost";
	.port = "80";
}

sub vcl_fetch {
	set beresp.do_stream = false;
}

2012-03-13 20:39:53 [1, 0]: httperf-lru-nostream-gzip(httperf): Number of total connections: 200000
2012-03-13 20:39:53 [1, 0]: httperf-lru-nostream-gzip(httperf): Note: connections are subject to rounding when divided among clients. Expect slight deviations.
2012-03-13 20:39:53 [1, 0]: httperf-lru-nostream-gzip(httperf): Requests per connection: 10
2012-03-13 20:39:53 [1, 0]: httperf-lru-nostream-gzip(httperf): Extra options to httperf: --wset=1000000,0.1
2012-03-13 20:39:53 [1, 0]: httperf-lru-nostream-gzip(httperf): Httperf command (last client): httperf --hog --timeout 60 --num-calls 10 --num-conns 8333 --port 8080 --burst-length 10 --client 23/24 --server 10.20.100.4 --wset=1000000,0.1
2012-03-13 20:40:01 [2, 7]: httperf-lru-nostream-gzip-deflateoff(httperf): Starting test
2012-03-13 20:45:03 WARNING [0,301]: httperf-lru-nostream-gzip-deflateoff(httperf): Panic detected. I think!
2012-03-13 20:45:03 WARNING [0, 0]: httperf-lru-nostream-gzip-deflateoff(httperf): 
Last panic at: Tue, 13 Mar 2012 20:44:22 GMT
Assert error in FetchBody(), cache/cache_fetch.c line 671:
  Condition(uu == obj->len) not true.
thread = (cache-worker)
ident = Linux,2.6.32-39-server,x86_64,-smalloc,-smalloc,-hcritbit,epoll
Backtrace:
  0x431a58: pan_ic+d8
  0x4253cd: FetchBody+78d
  0x433242: Pool_Work_Thread+112
  0x440488: wrk_thread_real+c8
  0x7f632915e9ca: _end+7f6328adb212
  0x7f6328ebbcdd: _end+7f6328838525




2012-03-13 20:45:03 [1, 0]: httperf-lru-nostream-gzip-deflateoff(httperf): Varnishstat uptime and measured run-time is too large (measured: 296 stat: 39 diff: 257). Did we crash?
2012-03-13 20:45:03 WARNING [0, 0]: httperf-lru-nostream-gzip-deflateoff(httperf): Out of bounds: n_lru_nuked(0) less than lower boundary 80000
2012-03-13 20:45:03 WARNING [0, 0]: httperf-lru-nostream-gzip-deflateoff(httperf): Out of bounds: client_req(76486) less than lower boundary 1999720
2012-03-13 20:45:04 [1, 0]: httperf-lru-nostream-gzip-deflateoff(httperf): Load:  21:45:04 up 1 day,  9:31,  0 users,  load average: 2.77, 6.32, 4.38

2012-03-13 20:45:04 [1, 0]: httperf-lru-nostream-gzip-deflateoff(httperf): Test name: httperf-lru-nostream-gzip-deflateoff
2012-03-13 20:45:04 [1, 0]: httperf-lru-nostream-gzip-deflateoff(httperf): Varnish options: 
2012-03-13 20:45:04 [1, 0]: httperf-lru-nostream-gzip-deflateoff(httperf): -t=3600
2012-03-13 20:45:04 [1, 0]: httperf-lru-nostream-gzip-deflateoff(httperf): -w=200,5000
2012-03-13 20:45:04 [1, 0]: httperf-lru-nostream-gzip-deflateoff(httperf): -s=malloc,30M
2012-03-13 20:45:04 [1, 0]: httperf-lru-nostream-gzip-deflateoff(httperf): Varnish parameters: 
2012-03-13 20:45:04 [1, 0]: httperf-lru-nostream-gzip-deflateoff(httperf): nuke_limit=250
2012-03-13 20:45:04 [1, 0]: httperf-lru-nostream-gzip-deflateoff(httperf): http_gzip_support=on
2012-03-13 20:45:04 [1, 0]: httperf-lru-nostream-gzip-deflateoff(httperf): Payload size (excludes headers): 10K
2012-03-13 20:45:04 [1, 0]: httperf-lru-nostream-gzip-deflateoff(httperf): Branch: master
2012-03-13 20:45:04 [1, 0]: httperf-lru-nostream-gzip-deflateoff(httperf): Number of clients involved: 24
2012-03-13 20:45:04 [1, 0]: httperf-lru-nostream-gzip-deflateoff(httperf): Type of test: httperf
2012-03-13 20:45:04 [1, 0]: httperf-lru-nostream-gzip-deflateoff(httperf): Test iterations: 1
2012-03-13 20:45:04 [1, 0]: httperf-lru-nostream-gzip-deflateoff(httperf): Runtime: 296 seconds
2012-03-13 20:45:04 [1, 0]: httperf-lru-nostream-gzip-deflateoff(httperf): VCL: 
backend foo {
	.host = "localhost";
	.port = "80";
}

sub vcl_fetch {
	set beresp.do_stream = false;
	set beresp.do_gzip = true;
}

2012-03-13 20:45:04 [1, 0]: httperf-lru-nostream-gzip-deflateoff(httperf): Number of total connections: 200000
2012-03-13 20:45:04 [1, 0]: httperf-lru-nostream-gzip-deflateoff(httperf): Note: connections are subject to rounding when divided among clients. Expect slight deviations.
2012-03-13 20:45:04 [1, 0]: httperf-lru-nostream-gzip-deflateoff(httperf): Requests per connection: 10
2012-03-13 20:45:04 [1, 0]: httperf-lru-nostream-gzip-deflateoff(httperf): Extra options to httperf: --wset=1000000,0.1
2012-03-13 20:45:04 [1, 0]: httperf-lru-nostream-gzip-deflateoff(httperf): Httperf command (last client): httperf --hog --timeout 60 --num-calls 10 --num-conns 8333 --port 8080 --burst-length 10 --client 23/24 --server 10.20.100.4 --wset=1000000,0.1
2012-03-13 20:45:11 [2, 7]: streaming(httperf): Starting test
2012-03-13 20:47:51 WARNING [0,159]: streaming(httperf): Out of bounds: client_req(9588) less than lower boundary 9784
2012-03-13 20:47:52 [1, 0]: streaming(httperf): Load:  21:47:51 up 1 day,  9:33,  0 users,  load average: 1.11, 3.95, 3.78

2012-03-13 20:47:52 [1, 0]: streaming(httperf): Test name: streaming
2012-03-13 20:47:52 [1, 0]: streaming(httperf): Varnish options: 
2012-03-13 20:47:52 [1, 0]: streaming(httperf): -t=1
2012-03-13 20:47:52 [1, 0]: streaming(httperf): Varnish parameters: 
2012-03-13 20:47:52 [1, 0]: streaming(httperf): thread_pool_add_delay=1
2012-03-13 20:47:52 [1, 0]: streaming(httperf): http_gzip_support=off
2012-03-13 20:47:52 [1, 0]: streaming(httperf): default_grace=0
2012-03-13 20:47:52 [1, 0]: streaming(httperf): Payload size (excludes headers): 1M
2012-03-13 20:47:52 [1, 0]: streaming(httperf): Branch: master
2012-03-13 20:47:52 [1, 0]: streaming(httperf): Number of clients involved: 24
2012-03-13 20:47:52 [1, 0]: streaming(httperf): Type of test: httperf
2012-03-13 20:47:52 [1, 0]: streaming(httperf): Test iterations: 1
2012-03-13 20:47:52 [1, 0]: streaming(httperf): Runtime: 154 seconds
2012-03-13 20:47:52 [1, 0]: streaming(httperf): VCL: 
backend foo {
	.host = "localhost";
	.port = "80";
	.connect_timeout = 10s;
}

sub vcl_fetch {
	set beresp.do_stream = true;
	set beresp.grace = 0s;
	set beresp.ttl = 15s;
}

sub vcl_deliver {
	set resp.http.x-fryer = "some test";
}

2012-03-13 20:47:52 [1, 0]: streaming(httperf): Number of total connections: 10000
2012-03-13 20:47:52 [1, 0]: streaming(httperf): Note: connections are subject to rounding when divided among clients. Expect slight deviations.
2012-03-13 20:47:52 [1, 0]: streaming(httperf): Requests per connection: 1
2012-03-13 20:47:52 [1, 0]: streaming(httperf): Extra options to httperf: --wset=1000,0.1 --rate 3
2012-03-13 20:47:52 [1, 0]: streaming(httperf): Httperf command (last client): httperf --hog --timeout 60 --num-calls 1 --num-conns 416 --port 8080 --burst-length 1 --client 23/24 --server 10.20.100.4 --wset=1000,0.1 --rate 3
2012-03-13 20:47:59 [2, 7]: httperf-lru-default(httperf): Starting test
2012-03-13 20:54:01 WARNING [0,362]: httperf-lru-default(httperf): Panic detected. I think!
2012-03-13 20:54:01 WARNING [0, 0]: httperf-lru-default(httperf): 
Last panic at: Tue, 13 Mar 2012 20:52:51 GMT
Assert error in EXP_Insert(), cache/cache_expire.c line 226:
  Condition((oc)->magic == 0x4d301302) not true.
errno = 11 (Resource temporarily unavailable)
thread = (cache-worker)
ident = Linux,2.6.32-39-server,x86_64,-smalloc,-smalloc,-hcritbit,epoll
Backtrace:
  0x431a58: pan_ic+d8
  0x4240ee: EXP_Insert+7e
  0x42517b: FetchBody+53b
  0x433242: Pool_Work_Thread+112
  0x440488: wrk_thread_real+c8
  0x7f16f1d329ca: _end+7f16f16af212
  0x7f16f1a8fcdd: _end+7f16f140c525




2012-03-13 20:54:01 [1, 0]: httperf-lru-default(httperf): Varnishstat uptime and measured run-time is too large (measured: 357 stat: 69 diff: 288). Did we crash?
2012-03-13 20:54:02 WARNING [0, 0]: httperf-lru-default(httperf): Out of bounds: n_lru_nuked(0) less than lower boundary 80000
2012-03-13 20:54:02 WARNING [0, 0]: httperf-lru-default(httperf): Out of bounds: client_req(232985) less than lower boundary 1999720
2012-03-13 20:54:02 [1, 0]: httperf-lru-default(httperf): Load:  21:54:02 up 1 day,  9:40,  0 users,  load average: 4.40, 7.49, 5.76

2012-03-13 20:54:02 [1, 0]: httperf-lru-default(httperf): Test name: httperf-lru-default
2012-03-13 20:54:02 [1, 0]: httperf-lru-default(httperf): Varnish options: 
2012-03-13 20:54:02 [1, 0]: httperf-lru-default(httperf): -t=3600
2012-03-13 20:54:02 [1, 0]: httperf-lru-default(httperf): -w=200,5000
2012-03-13 20:54:02 [1, 0]: httperf-lru-default(httperf): -s=malloc,30M
2012-03-13 20:54:02 [1, 0]: httperf-lru-default(httperf): Varnish parameters: 
2012-03-13 20:54:02 [1, 0]: httperf-lru-default(httperf): nuke_limit=250
2012-03-13 20:54:02 [1, 0]: httperf-lru-default(httperf): Payload size (excludes headers): 10K
2012-03-13 20:54:02 [1, 0]: httperf-lru-default(httperf): Branch: master
2012-03-13 20:54:02 [1, 0]: httperf-lru-default(httperf): Number of clients involved: 24
2012-03-13 20:54:02 [1, 0]: httperf-lru-default(httperf): Type of test: httperf
2012-03-13 20:54:02 [1, 0]: httperf-lru-default(httperf): Test iterations: 1
2012-03-13 20:54:02 [1, 0]: httperf-lru-default(httperf): Runtime: 357 seconds
2012-03-13 20:54:02 [1, 0]: httperf-lru-default(httperf): VCL: 
backend foo {
	.host = "localhost";
	.port = "80";
}

sub vcl_fetch {
	set beresp.do_stream = true;
}

2012-03-13 20:54:02 [1, 0]: httperf-lru-default(httperf): Number of total connections: 200000
2012-03-13 20:54:02 [1, 0]: httperf-lru-default(httperf): Note: connections are subject to rounding when divided among clients. Expect slight deviations.
2012-03-13 20:54:02 [1, 0]: httperf-lru-default(httperf): Requests per connection: 10
2012-03-13 20:54:02 [1, 0]: httperf-lru-default(httperf): Extra options to httperf: --wset=1000000,0.1
2012-03-13 20:54:02 [1, 0]: httperf-lru-default(httperf): Httperf command (last client): httperf --hog --timeout 60 --num-calls 10 --num-conns 8333 --port 8080 --burst-length 10 --client 23/24 --server 10.20.100.4 --wset=1000000,0.1
2012-03-13 20:54:10 [2, 7]: memleak(httperf): Starting test
2012-03-13 21:07:09 WARNING [0,779]: memleak(httperf): Out of bounds: client_req(9956996) less than lower boundary 9959800
2012-03-13 21:07:10 [1, 0]: memleak(httperf): Load:  22:07:10 up 1 day,  9:53,  0 users,  load average: 20.29, 21.86, 15.72

2012-03-13 21:07:10 [1, 0]: memleak(httperf): Test name: memleak
2012-03-13 21:07:10 [1, 0]: memleak(httperf): Varnish options: 
2012-03-13 21:07:10 [1, 0]: memleak(httperf): -t=3600
2012-03-13 21:07:10 [1, 0]: memleak(httperf): Varnish parameters: 
2012-03-13 21:07:10 [1, 0]: memleak(httperf): thread_pool_add_delay=1
2012-03-13 21:07:10 [1, 0]: memleak(httperf): http_gzip_support=on
2012-03-13 21:07:10 [1, 0]: memleak(httperf): Payload size (excludes headers): 512
2012-03-13 21:07:10 [1, 0]: memleak(httperf): Branch: master
2012-03-13 21:07:10 [1, 0]: memleak(httperf): Number of clients involved: 24
2012-03-13 21:07:10 [1, 0]: memleak(httperf): Type of test: httperf
2012-03-13 21:07:10 [1, 0]: memleak(httperf): Test iterations: 1
2012-03-13 21:07:10 [1, 0]: memleak(httperf): Runtime: 771 seconds
2012-03-13 21:07:10 [1, 0]: memleak(httperf): VCL: 
backend foo {
	.host = "localhost";
	.port = "80";
}

sub vcl_fetch {
	set beresp.do_stream = true;
}

2012-03-13 21:07:10 [1, 0]: memleak(httperf): Number of total connections: 2000
2012-03-13 21:07:10 [1, 0]: memleak(httperf): Note: connections are subject to rounding when divided among clients. Expect slight deviations.
2012-03-13 21:07:10 [1, 0]: memleak(httperf): Requests per connection: 5000
2012-03-13 21:07:10 [1, 0]: memleak(httperf): Extra options to httperf: --wset=100,0.10
2012-03-13 21:07:10 [1, 0]: memleak(httperf): Httperf command (last client): httperf --hog --timeout 60 --num-calls 5000 --num-conns 83 --port 8080 --burst-length 5000 --client 23/24 --server 10.20.100.4 --wset=100,0.10
2012-03-13 21:07:18 [2, 7]: 4gpluss-stream(httperf): Starting test
2012-03-13 21:07:21 WARNING [0, 3]: Varnish failed to start. Fallback attempts starting
2012-03-13 21:07:21 [1, 0]: Removed (hopefully incompatible) parameter to try to start varnish. Key: thread_pool_add_delay=1
2012-03-13 21:07:22 [1, 0]: Removed (hopefully incompatible) parameter to try to start varnish. Key: sess_timeout=60000s
2012-03-13 21:07:23 [1, 1]: Fallback worked. Parameter that seemed to cause problems: sess_timeout
2012-03-13 21:27:51 [2,1228]: httperf-lru-stream-default(httperf): Starting test
2012-03-13 21:33:52 WARNING [0,360]: httperf-lru-stream-default(httperf): Panic detected. I think!
2012-03-13 21:33:52 WARNING [0, 0]: httperf-lru-stream-default(httperf): 
Last panic at: Tue, 13 Mar 2012 21:32:21 GMT
Assert error in EXP_Insert(), cache/cache_expire.c line 226:
  Condition((oc)->magic == 0x4d301302) not true.
thread = (cache-worker)
ident = Linux,2.6.32-39-server,x86_64,-smalloc,-smalloc,-hcritbit,epoll
Backtrace:
  0x431a58: pan_ic+d8
  0x4240ee: EXP_Insert+7e
  0x42517b: FetchBody+53b
  0x433242: Pool_Work_Thread+112
  0x440488: wrk_thread_real+c8
  0x7fddcc5c09ca: _end+7fddcbf3d212
  0x7fddcc31dcdd: _end+7fddcbc9a525




2012-03-13 21:33:52 [1, 0]: httperf-lru-stream-default(httperf): Varnishstat uptime and measured run-time is too large (measured: 351 stat: 89 diff: 262). Did we crash?
2012-03-13 21:33:52 WARNING [0, 0]: httperf-lru-stream-default(httperf): Out of bounds: n_lru_nuked(2108) less than lower boundary 80000
2012-03-13 21:33:52 WARNING [0, 0]: httperf-lru-stream-default(httperf): Out of bounds: client_req(338582) less than lower boundary 1999720
2012-03-13 21:33:53 [1, 0]: httperf-lru-stream-default(httperf): Load:  22:33:53 up 1 day, 10:19,  0 users,  load average: 5.67, 7.13, 6.69

2012-03-13 21:33:53 [1, 0]: httperf-lru-stream-default(httperf): Test name: httperf-lru-stream-default
2012-03-13 21:33:53 [1, 0]: httperf-lru-stream-default(httperf): Varnish options: 
2012-03-13 21:33:53 [1, 0]: httperf-lru-stream-default(httperf): -t=3600
2012-03-13 21:33:53 [1, 0]: httperf-lru-stream-default(httperf): -w=200,5000
2012-03-13 21:33:53 [1, 0]: httperf-lru-stream-default(httperf): -s=malloc,30M
2012-03-13 21:33:53 [1, 0]: httperf-lru-stream-default(httperf): Varnish parameters: 
2012-03-13 21:33:53 [1, 0]: httperf-lru-stream-default(httperf): nuke_limit=250
2012-03-13 21:33:53 [1, 0]: httperf-lru-stream-default(httperf): Payload size (excludes headers): 10K
2012-03-13 21:33:53 [1, 0]: httperf-lru-stream-default(httperf): Branch: master
2012-03-13 21:33:53 [1, 0]: httperf-lru-stream-default(httperf): Number of clients involved: 24
2012-03-13 21:33:53 [1, 0]: httperf-lru-stream-default(httperf): Type of test: httperf
2012-03-13 21:33:53 [1, 0]: httperf-lru-stream-default(httperf): Test iterations: 1
2012-03-13 21:33:53 [1, 0]: httperf-lru-stream-default(httperf): Runtime: 351 seconds
2012-03-13 21:33:53 [1, 0]: httperf-lru-stream-default(httperf): VCL: 
backend foo {
	.host = "localhost";
	.port = "80";
}

sub vcl_fetch {
	set beresp.do_stream = true;
}

2012-03-13 21:33:53 [1, 0]: httperf-lru-stream-default(httperf): Number of total connections: 200000
2012-03-13 21:33:53 [1, 0]: httperf-lru-stream-default(httperf): Note: connections are subject to rounding when divided among clients. Expect slight deviations.
2012-03-13 21:33:53 [1, 0]: httperf-lru-stream-default(httperf): Requests per connection: 10
2012-03-13 21:33:53 [1, 0]: httperf-lru-stream-default(httperf): Extra options to httperf: --wset=1000000,0.1
2012-03-13 21:33:53 [1, 0]: httperf-lru-stream-default(httperf): Httperf command (last client): httperf --hog --timeout 60 --num-calls 10 --num-conns 8333 --port 8080 --burst-length 10 --client 23/24 --server 10.20.100.4 --wset=1000000,0.1
2012-03-13 21:34:01 [2, 7]: httperf-hot(httperf): Starting test
2012-03-13 21:35:58 [2,117]: httperf-lru-nostream-nogzip(httperf): Starting test
2012-03-13 21:40:36 WARNING [0,277]: httperf-lru-nostream-nogzip(httperf): Panic detected. I think!
2012-03-13 21:40:36 WARNING [0, 0]: httperf-lru-nostream-nogzip(httperf): 
Last panic at: Tue, 13 Mar 2012 21:38:45 GMT
Assert error in FetchBody(), cache/cache_fetch.c line 671:
  Condition(uu == obj->len) not true.
thread = (cache-worker)
ident = Linux,2.6.32-39-server,x86_64,-smalloc,-smalloc,-hcritbit,epoll
Backtrace:
  0x431a58: pan_ic+d8
  0x4253cd: FetchBody+78d
  0x433242: Pool_Work_Thread+112
  0x440488: wrk_thread_real+c8
  0x7fed4d95e9ca: _end+7fed4d2db212
  0x7fed4d6bbcdd: _end+7fed4d038525




2012-03-13 21:40:36 [1, 0]: httperf-lru-nostream-nogzip(httperf): Varnishstat uptime and measured run-time is too large (measured: 272 stat: 109 diff: 163). Did we crash?
2012-03-13 21:40:36 WARNING [0, 0]: httperf-lru-nostream-nogzip(httperf): Out of bounds: n_lru_nuked(30680) less than lower boundary 80000
2012-03-13 21:40:36 WARNING [0, 0]: httperf-lru-nostream-nogzip(httperf): Out of bounds: client_req(334980) less than lower boundary 1999720
2012-03-13 21:40:36 [1, 0]: httperf-lru-nostream-nogzip(httperf): Load:  22:40:36 up 1 day, 10:26,  0 users,  load average: 1.21, 5.07, 6.33

2012-03-13 21:40:36 [1, 0]: httperf-lru-nostream-nogzip(httperf): Test name: httperf-lru-nostream-nogzip
2012-03-13 21:40:36 [1, 0]: httperf-lru-nostream-nogzip(httperf): Varnish options: 
2012-03-13 21:40:36 [1, 0]: httperf-lru-nostream-nogzip(httperf): -t=3600
2012-03-13 21:40:36 [1, 0]: httperf-lru-nostream-nogzip(httperf): -w=200,5000
2012-03-13 21:40:36 [1, 0]: httperf-lru-nostream-nogzip(httperf): -s=malloc,30M
2012-03-13 21:40:36 [1, 0]: httperf-lru-nostream-nogzip(httperf): Varnish parameters: 
2012-03-13 21:40:36 [1, 0]: httperf-lru-nostream-nogzip(httperf): nuke_limit=250
2012-03-13 21:40:36 [1, 0]: httperf-lru-nostream-nogzip(httperf): http_gzip_support=off
2012-03-13 21:40:36 [1, 0]: httperf-lru-nostream-nogzip(httperf): Payload size (excludes headers): 10K
2012-03-13 21:40:36 [1, 0]: httperf-lru-nostream-nogzip(httperf): Branch: master
2012-03-13 21:40:36 [1, 0]: httperf-lru-nostream-nogzip(httperf): Number of clients involved: 24
2012-03-13 21:40:36 [1, 0]: httperf-lru-nostream-nogzip(httperf): Type of test: httperf
2012-03-13 21:40:36 [1, 0]: httperf-lru-nostream-nogzip(httperf): Test iterations: 1
2012-03-13 21:40:36 [1, 0]: httperf-lru-nostream-nogzip(httperf): Runtime: 272 seconds
2012-03-13 21:40:36 [1, 0]: httperf-lru-nostream-nogzip(httperf): VCL: 
backend foo {
	.host = "localhost";
	.port = "80";
}

sub vcl_fetch {
	set beresp.do_stream = false;
}

2012-03-13 21:40:36 [1, 0]: httperf-lru-nostream-nogzip(httperf): Number of total connections: 200000
2012-03-13 21:40:36 [1, 0]: httperf-lru-nostream-nogzip(httperf): Note: connections are subject to rounding when divided among clients. Expect slight deviations.
2012-03-13 21:40:36 [1, 0]: httperf-lru-nostream-nogzip(httperf): Requests per connection: 10
2012-03-13 21:40:36 [1, 0]: httperf-lru-nostream-nogzip(httperf): Extra options to httperf: --wset=1000000,0.1
2012-03-13 21:40:36 [1, 0]: httperf-lru-nostream-nogzip(httperf): Httperf command (last client): httperf --hog --timeout 60 --num-calls 10 --num-conns 8333 --port 8080 --burst-length 10 --client 23/24 --server 10.20.100.4 --wset=1000000,0.1
2012-03-13 21:40:44 [2, 7]: cold-gzip(httperf): Starting test
2012-03-13 21:44:55 WARNING [0,250]: cold-gzip(httperf): Panic detected. I think!
2012-03-13 21:44:55 WARNING [0, 0]: cold-gzip(httperf): 
Last panic at: Tue, 13 Mar 2012 21:43:10 GMT
Assert error in EXP_Insert(), cache/cache_expire.c line 226:
  Condition((oc)->magic == 0x4d301302) not true.
thread = (cache-worker)
ident = Linux,2.6.32-39-server,x86_64,-smalloc,-smalloc,-hcritbit,epoll
Backtrace:
  0x431a58: pan_ic+d8
  0x4240ee: EXP_Insert+7e
  0x42517b: FetchBody+53b
  0x433242: Pool_Work_Thread+112
  0x440488: wrk_thread_real+c8
  0x7f03a62289ca: _end+7f03a5ba5212
  0x7f03a5f85cdd: _end+7f03a5902525




2012-03-13 21:44:55 [1, 0]: cold-gzip(httperf): Varnishstat uptime and measured run-time is too large (measured: 245 stat: 103 diff: 142). Did we crash?
2012-03-13 21:49:14 WARNING [0,259]: cold-gzip(httperf): Panic detected. I think!
2012-03-13 21:49:14 WARNING [0, 0]: cold-gzip(httperf): 
Last panic at: Tue, 13 Mar 2012 21:46:03 GMT
Assert error in AssertOCBusy(), cache/cache.h line 1090:
  Condition((oc->flags & (1<<1)) != 0) not true.
thread = (cache-worker)
ident = Linux,2.6.32-39-server,x86_64,-smalloc,-smalloc,-hcritbit,epoll
Backtrace:
  0x431a58: pan_ic+d8
  0x4242fd: EXP_Insert+28d
  0x42517b: FetchBody+53b
  0x433242: Pool_Work_Thread+112
  0x440488: wrk_thread_real+c8
  0x7f03a62289ca: _end+7f03a5ba5212
  0x7f03a5f85cdd: _end+7f03a5902525




2012-03-13 21:49:14 [1, 0]: cold-gzip(httperf): Varnishstat uptime and measured run-time is too large (measured: 504 stat: 189 diff: 315). Did we crash?
2012-03-13 21:49:14 WARNING [0, 0]: cold-gzip(httperf): Out of bounds: client_req(425510) less than lower boundary 1599640
2012-03-13 21:49:15 [1, 0]: cold-gzip(httperf): Load:  22:49:15 up 1 day, 10:35,  0 users,  load average: 1.06, 1.95, 4.16

2012-03-13 21:49:15 [1, 0]: cold-gzip(httperf): Test name: cold-gzip
2012-03-13 21:49:15 [1, 0]: cold-gzip(httperf): Varnish options: 
2012-03-13 21:49:15 [1, 0]: cold-gzip(httperf): -t=3600
2012-03-13 21:49:15 [1, 0]: cold-gzip(httperf): -s=malloc,10G
2012-03-13 21:49:15 [1, 0]: cold-gzip(httperf): Varnish parameters: 
2012-03-13 21:49:15 [1, 0]: cold-gzip(httperf): http_gzip_support=on
2012-03-13 21:49:15 [1, 0]: cold-gzip(httperf): Payload size (excludes headers): 256
2012-03-13 21:49:15 [1, 0]: cold-gzip(httperf): Branch: master
2012-03-13 21:49:15 [1, 0]: cold-gzip(httperf): Number of clients involved: 24
2012-03-13 21:49:15 [1, 0]: cold-gzip(httperf): Type of test: httperf
2012-03-13 21:49:15 [1, 0]: cold-gzip(httperf): Test iterations: 2
2012-03-13 21:49:15 [1, 0]: cold-gzip(httperf): Runtime: 504 seconds
2012-03-13 21:49:15 [1, 0]: cold-gzip(httperf): VCL: 
backend foo {
	.host = "localhost";
	.port = "80";
}

sub vcl_fetch {
	set beresp.do_stream = true;
}

2012-03-13 21:49:15 [1, 0]: cold-gzip(httperf): Number of total connections: 80000
2012-03-13 21:49:15 [1, 0]: cold-gzip(httperf): Note: connections are subject to rounding when divided among clients. Expect slight deviations.
2012-03-13 21:49:15 [1, 0]: cold-gzip(httperf): Requests per connection: 10
2012-03-13 21:49:15 [1, 0]: cold-gzip(httperf): Extra options to httperf: --wset=4000000,0.50
2012-03-13 21:49:15 [1, 0]: cold-gzip(httperf): Httperf command (last client): httperf --hog --timeout 60 --num-calls 10 --num-conns 3333 --port 8080 --burst-length 10 --client 23/24 --server 10.20.100.4 --wset=4000000,0.50
2012-03-13 21:49:22 [2, 7]: 4gpluss(httperf): Starting test
2012-03-13 21:49:26 WARNING [0, 3]: Varnish failed to start. Fallback attempts starting
2012-03-13 21:49:26 [1, 0]: Removed (hopefully incompatible) parameter to try to start varnish. Key: thread_pool_add_delay=1
2012-03-13 21:49:27 [1, 0]: Removed (hopefully incompatible) parameter to try to start varnish. Key: sess_timeout=60000s
2012-03-13 21:49:28 [1, 1]: Fallback worked. Parameter that seemed to cause problems: sess_timeout
2012-03-13 22:10:11 [2,1242]: httperf-lru-stream-gzip(httperf): Starting test
2012-03-13 22:16:34 WARNING [0,383]: httperf-lru-stream-gzip(httperf): Panic detected. I think!
2012-03-13 22:16:34 WARNING [0, 0]: httperf-lru-stream-gzip(httperf): 
Last panic at: Tue, 13 Mar 2012 22:15:57 GMT
Assert error in EXP_Insert(), cache/cache_expire.c line 226:
  Condition((oc)->magic == 0x4d301302) not true.
thread = (cache-worker)
ident = Linux,2.6.32-39-server,x86_64,-smalloc,-smalloc,-hcritbit,epoll
Backtrace:
  0x431a58: pan_ic+d8
  0x4240ee: EXP_Insert+7e
  0x42517b: FetchBody+53b
  0x433242: Pool_Work_Thread+112
  0x440488: wrk_thread_real+c8
  0x7fb252a2b9ca: _end+7fb2523a8212
  0x7fb252788cdd: _end+7fb252105525




2012-03-13 22:16:34 [1, 0]: httperf-lru-stream-gzip(httperf): Varnishstat uptime and measured run-time is too large (measured: 377 stat: 36 diff: 341). Did we crash?
2012-03-13 22:16:35 WARNING [0, 0]: httperf-lru-stream-gzip(httperf): Out of bounds: n_lru_nuked(0) less than lower boundary 80000
2012-03-13 22:16:35 WARNING [0, 0]: httperf-lru-stream-gzip(httperf): Out of bounds: client_req(98292) less than lower boundary 1999720
2012-03-13 22:16:35 [1, 0]: httperf-lru-stream-gzip(httperf): Load:  23:16:35 up 1 day, 11:02,  0 users,  load average: 6.15, 8.13, 5.29

2012-03-13 22:16:35 [1, 0]: httperf-lru-stream-gzip(httperf): Test name: httperf-lru-stream-gzip
2012-03-13 22:16:35 [1, 0]: httperf-lru-stream-gzip(httperf): Varnish options: 
2012-03-13 22:16:35 [1, 0]: httperf-lru-stream-gzip(httperf): -t=3600
2012-03-13 22:16:35 [1, 0]: httperf-lru-stream-gzip(httperf): -w=200,5000
2012-03-13 22:16:35 [1, 0]: httperf-lru-stream-gzip(httperf): -s=malloc,30M
2012-03-13 22:16:35 [1, 0]: httperf-lru-stream-gzip(httperf): Varnish parameters: 
2012-03-13 22:16:35 [1, 0]: httperf-lru-stream-gzip(httperf): nuke_limit=250
2012-03-13 22:16:35 [1, 0]: httperf-lru-stream-gzip(httperf): http_gzip_support=on
2012-03-13 22:16:35 [1, 0]: httperf-lru-stream-gzip(httperf): Payload size (excludes headers): 10K
2012-03-13 22:16:35 [1, 0]: httperf-lru-stream-gzip(httperf): Branch: master
2012-03-13 22:16:35 [1, 0]: httperf-lru-stream-gzip(httperf): Number of clients involved: 24
2012-03-13 22:16:35 [1, 0]: httperf-lru-stream-gzip(httperf): Type of test: httperf
2012-03-13 22:16:35 [1, 0]: httperf-lru-stream-gzip(httperf): Test iterations: 1
2012-03-13 22:16:35 [1, 0]: httperf-lru-stream-gzip(httperf): Runtime: 377 seconds
2012-03-13 22:16:35 [1, 0]: httperf-lru-stream-gzip(httperf): VCL: 
backend foo {
	.host = "localhost";
	.port = "80";
}

sub vcl_fetch {
	set beresp.do_stream = true;
}

2012-03-13 22:16:35 [1, 0]: httperf-lru-stream-gzip(httperf): Number of total connections: 200000
2012-03-13 22:16:35 [1, 0]: httperf-lru-stream-gzip(httperf): Note: connections are subject to rounding when divided among clients. Expect slight deviations.
2012-03-13 22:16:35 [1, 0]: httperf-lru-stream-gzip(httperf): Requests per connection: 10
2012-03-13 22:16:35 [1, 0]: httperf-lru-stream-gzip(httperf): Extra options to httperf: --wset=1000000,0.1
2012-03-13 22:16:35 [1, 0]: httperf-lru-stream-gzip(httperf): Httperf command (last client): httperf --hog --timeout 60 --num-calls 10 --num-conns 8333 --port 8080 --burst-length 10 --client 23/24 --server 10.20.100.4 --wset=1000000,0.1
2012-03-13 22:16:43 [2, 7]: httperf-lru-stream-nogzip(httperf): Starting test
2012-03-13 22:21:41 WARNING [0,297]: httperf-lru-stream-nogzip(httperf): Panic detected. I think!
2012-03-13 22:21:41 WARNING [0, 0]: httperf-lru-stream-nogzip(httperf): 
Last panic at: Tue, 13 Mar 2012 22:21:11 GMT
Assert error in EXP_Insert(), cache/cache_expire.c line 226:
  Condition((oc)->magic == 0x4d301302) not true.
errno = 11 (Resource temporarily unavailable)
thread = (cache-worker)
ident = Linux,2.6.32-39-server,x86_64,-smalloc,-smalloc,-hcritbit,epoll
Backtrace:
  0x431a58: pan_ic+d8
  0x4240ee: EXP_Insert+7e
  0x42517b: FetchBody+53b
  0x433242: Pool_Work_Thread+112
  0x440488: wrk_thread_real+c8
  0x7f303d4269ca: _end+7f303cda3212
  0x7f303d183cdd: _end+7f303cb00525




2012-03-13 22:21:41 [1, 0]: httperf-lru-stream-nogzip(httperf): Varnishstat uptime and measured run-time is too large (measured: 292 stat: 29 diff: 263). Did we crash?
2012-03-13 22:21:41 WARNING [0, 0]: httperf-lru-stream-nogzip(httperf): Out of bounds: n_lru_nuked(1740) less than lower boundary 80000
2012-03-13 22:21:41 WARNING [0, 0]: httperf-lru-stream-nogzip(httperf): Out of bounds: client_req(46024) less than lower boundary 1999720
2012-03-13 22:21:41 [1, 0]: httperf-lru-stream-nogzip(httperf): Load:  23:21:41 up 1 day, 11:07,  0 users,  load average: 1.64, 5.13, 4.90

2012-03-13 22:21:41 [1, 0]: httperf-lru-stream-nogzip(httperf): Test name: httperf-lru-stream-nogzip
2012-03-13 22:21:41 [1, 0]: httperf-lru-stream-nogzip(httperf): Varnish options: 
2012-03-13 22:21:41 [1, 0]: httperf-lru-stream-nogzip(httperf): -t=3600
2012-03-13 22:21:41 [1, 0]: httperf-lru-stream-nogzip(httperf): -w=200,5000
2012-03-13 22:21:41 [1, 0]: httperf-lru-stream-nogzip(httperf): -s=malloc,30M
2012-03-13 22:21:41 [1, 0]: httperf-lru-stream-nogzip(httperf): Varnish parameters: 
2012-03-13 22:21:41 [1, 0]: httperf-lru-stream-nogzip(httperf): nuke_limit=250
2012-03-13 22:21:41 [1, 0]: httperf-lru-stream-nogzip(httperf): http_gzip_support=off
2012-03-13 22:21:41 [1, 0]: httperf-lru-stream-nogzip(httperf): Payload size (excludes headers): 10K
2012-03-13 22:21:41 [1, 0]: httperf-lru-stream-nogzip(httperf): Branch: master
2012-03-13 22:21:41 [1, 0]: httperf-lru-stream-nogzip(httperf): Number of clients involved: 24
2012-03-13 22:21:41 [1, 0]: httperf-lru-stream-nogzip(httperf): Type of test: httperf
2012-03-13 22:21:41 [1, 0]: httperf-lru-stream-nogzip(httperf): Test iterations: 1
2012-03-13 22:21:41 [1, 0]: httperf-lru-stream-nogzip(httperf): Runtime: 292 seconds
2012-03-13 22:21:41 [1, 0]: httperf-lru-stream-nogzip(httperf): VCL: 
backend foo {
	.host = "localhost";
	.port = "80";
}

sub vcl_fetch {
	set beresp.do_stream = true;
}

2012-03-13 22:21:41 [1, 0]: httperf-lru-stream-nogzip(httperf): Number of total connections: 200000
2012-03-13 22:21:41 [1, 0]: httperf-lru-stream-nogzip(httperf): Note: connections are subject to rounding when divided among clients. Expect slight deviations.
2012-03-13 22:21:41 [1, 0]: httperf-lru-stream-nogzip(httperf): Requests per connection: 10
2012-03-13 22:21:41 [1, 0]: httperf-lru-stream-nogzip(httperf): Extra options to httperf: --wset=1000000,0.1
2012-03-13 22:21:41 [1, 0]: httperf-lru-stream-nogzip(httperf): Httperf command (last client): httperf --hog --timeout 60 --num-calls 10 --num-conns 8333 --port 8080 --burst-length 10 --client 23/24 --server 10.20.100.4 --wset=1000000,0.1
2012-03-13 22:21:49 [2, 7]: basic-fryer(httperf): Starting test
2012-03-13 22:22:04 [2,14]: cold-nogzip(httperf): Starting test
2012-03-13 22:26:04 WARNING [0,239]: cold-nogzip(httperf): Panic detected. I think!
2012-03-13 22:26:04 WARNING [0, 0]: cold-nogzip(httperf): 
Last panic at: Tue, 13 Mar 2012 22:25:00 GMT
Assert error in EXP_Insert(), cache/cache_expire.c line 226:
  Condition((oc)->magic == 0x4d301302) not true.
thread = (cache-worker)
ident = Linux,2.6.32-39-server,x86_64,-smalloc,-smalloc,-hcritbit,epoll
Backtrace:
  0x431a58: pan_ic+d8
  0x4240ee: EXP_Insert+7e
  0x42517b: FetchBody+53b
  0x433242: Pool_Work_Thread+112
  0x440488: wrk_thread_real+c8
  0x7f117c3dd9ca: _end+7f117bd5a212
  0x7f117c13acdd: _end+7f117bab7525




2012-03-13 22:26:04 [1, 0]: cold-nogzip(httperf): Varnishstat uptime and measured run-time is too large (measured: 234 stat: 62 diff: 172). Did we crash?
2012-03-13 22:30:06 WARNING [0,242]: cold-nogzip(httperf): Panic detected. I think!
2012-03-13 22:30:06 WARNING [0, 0]: cold-nogzip(httperf): 
Last panic at: Tue, 13 Mar 2012 22:27:48 GMT
Assert error in HSH_Ref(), cache/cache_hash.c line 623:
  Condition(oc->refcnt > 0) not true.
thread = (cache-worker)
ident = Linux,2.6.32-39-server,x86_64,-smalloc,-smalloc,-hcritbit,epoll
Backtrace:
  0x431a58: pan_ic+d8
  0x4280d5: HSH_Ref+e5
  0x42410b: EXP_Insert+9b
  0x42517b: FetchBody+53b
  0x433242: Pool_Work_Thread+112
  0x440488: wrk_thread_real+c8
  0x7f117c3dd9ca: _end+7f117bd5a212
  0x7f117c13acdd: _end+7f117bab7525




2012-03-13 22:30:06 [1, 0]: cold-nogzip(httperf): Varnishstat uptime and measured run-time is too large (measured: 476 stat: 136 diff: 340). Did we crash?
2012-03-13 22:30:06 WARNING [0, 0]: cold-nogzip(httperf): Out of bounds: client_req(236590) less than lower boundary 1599640
2012-03-13 22:30:07 [1, 0]: cold-nogzip(httperf): Load:  23:30:07 up 1 day, 11:16,  0 users,  load average: 0.84, 1.80, 3.29

2012-03-13 22:30:07 [1, 0]: cold-nogzip(httperf): Test name: cold-nogzip
2012-03-13 22:30:07 [1, 0]: cold-nogzip(httperf): Varnish options: 
2012-03-13 22:30:07 [1, 0]: cold-nogzip(httperf): -t=3600
2012-03-13 22:30:07 [1, 0]: cold-nogzip(httperf): -s=malloc,10G
2012-03-13 22:30:07 [1, 0]: cold-nogzip(httperf): Varnish parameters: 
2012-03-13 22:30:07 [1, 0]: cold-nogzip(httperf): http_gzip_support=off
2012-03-13 22:30:07 [1, 0]: cold-nogzip(httperf): Payload size (excludes headers): 256
2012-03-13 22:30:07 [1, 0]: cold-nogzip(httperf): Branch: master
2012-03-13 22:30:07 [1, 0]: cold-nogzip(httperf): Number of clients involved: 24
2012-03-13 22:30:07 [1, 0]: cold-nogzip(httperf): Type of test: httperf
2012-03-13 22:30:07 [1, 0]: cold-nogzip(httperf): Test iterations: 2
2012-03-13 22:30:07 [1, 0]: cold-nogzip(httperf): Runtime: 476 seconds
2012-03-13 22:30:07 [1, 0]: cold-nogzip(httperf): VCL: 
backend foo {
	.host = "localhost";
	.port = "80";
}

sub vcl_fetch {
	set beresp.do_stream = true;
}

2012-03-13 22:30:07 [1, 0]: cold-nogzip(httperf): Number of total connections: 80000
2012-03-13 22:30:07 [1, 0]: cold-nogzip(httperf): Note: connections are subject to rounding when divided among clients. Expect slight deviations.
2012-03-13 22:30:07 [1, 0]: cold-nogzip(httperf): Requests per connection: 10
2012-03-13 22:30:07 [1, 0]: cold-nogzip(httperf): Extra options to httperf: --wset=4000000,0.50
2012-03-13 22:30:07 [1, 0]: cold-nogzip(httperf): Httperf command (last client): httperf --hog --timeout 60 --num-calls 10 --num-conns 3333 --port 8080 --burst-length 10 --client 23/24 --server 10.20.100.4 --wset=4000000,0.50
2012-03-13 22:30:14 [2, 7]: 4gpluss-nostream(httperf): Starting test
2012-03-13 22:30:18 WARNING [0, 3]: Varnish failed to start. Fallback attempts starting
2012-03-13 22:30:18 [1, 0]: Removed (hopefully incompatible) parameter to try to start varnish. Key: thread_pool_add_delay=1
2012-03-13 22:30:19 [1, 0]: Removed (hopefully incompatible) parameter to try to start varnish. Key: sess_timeout=60000s
2012-03-13 22:30:20 [1, 1]: Fallback worked. Parameter that seemed to cause problems: sess_timeout
2012-03-13 22:51:20 [2,1259]: lru-random(httperf): Starting test
2012-03-13 22:51:51 WARNING [0,31]: lru-random(httperf): Out of bounds: n_lru_nuked(0) less than lower boundary 3000
2012-03-13 22:51:51 WARNING [0, 0]: lru-random(httperf): Out of bounds: cache_hitpass(22440) more than upper boundary 0
2012-03-13 22:51:52 [1, 0]: lru-random(httperf): Load:  23:51:52 up 1 day, 11:37,  0 users,  load average: 1.09, 1.32, 1.87

2012-03-13 22:51:52 [1, 0]: lru-random(httperf): Test name: lru-random
2012-03-13 22:51:52 [1, 0]: lru-random(httperf): Varnish options: 
2012-03-13 22:51:52 [1, 0]: lru-random(httperf): -t=3600000
2012-03-13 22:51:52 [1, 0]: lru-random(httperf): -s=malloc,1G
2012-03-13 22:51:52 [1, 0]: lru-random(httperf): Varnish parameters: 
2012-03-13 22:51:52 [1, 0]: lru-random(httperf): Payload size (excludes headers): 256
2012-03-13 22:51:52 [1, 0]: lru-random(httperf): Branch: master
2012-03-13 22:51:52 [1, 0]: lru-random(httperf): Number of clients involved: 24
2012-03-13 22:51:52 [1, 0]: lru-random(httperf): Type of test: httperf
2012-03-13 22:51:52 [1, 0]: lru-random(httperf): Test iterations: 1
2012-03-13 22:51:52 [1, 0]: lru-random(httperf): Runtime: 24 seconds
2012-03-13 22:51:52 [1, 0]: lru-random(httperf): VCL: 

backend foo {
	.host = "localhost";
	.port = "80";
}

sub vcl_fetch {
	set beresp.do_stream = false;
//	set beresp.do_gzip = true;
}

2012-03-13 22:51:52 [1, 0]: lru-random(httperf): Number of total connections: 10000
2012-03-13 22:51:52 [1, 0]: lru-random(httperf): Note: connections are subject to rounding when divided among clients. Expect slight deviations.
2012-03-13 22:51:52 [1, 0]: lru-random(httperf): Requests per connection: 3
2012-03-13 22:51:52 [1, 0]: lru-random(httperf): Extra options to httperf: --wset=100000,0.25
2012-03-13 22:51:52 [1, 0]: lru-random(httperf): Httperf command (last client): httperf --hog --timeout 60 --num-calls 3 --num-conns 416 --port 8080 --burst-length 3 --client 23/24 --server 10.20.100.4 --wset=100000,0.25
2012-03-13 22:51:59 [2, 7]: siege-test(siege): Starting test
2012-03-13 22:53:13 [2,73]: sky-misc(httperf): Starting test
2012-03-13 22:59:53 [2,399]: httperf-lru-nostream-default(httperf): Starting test
2012-03-13 23:06:47 WARNING [0,414]: httperf-lru-nostream-default(httperf): Panic detected. I think!
2012-03-13 23:06:47 WARNING [0, 0]: httperf-lru-nostream-default(httperf): 
Last panic at: Tue, 13 Mar 2012 23:04:14 GMT
Assert error in EXP_Insert(), cache/cache_expire.c line 226:
  Condition((oc)->magic == 0x4d301302) not true.
thread = (cache-worker)
ident = Linux,2.6.32-39-server,x86_64,-smalloc,-smalloc,-hcritbit,epoll
Backtrace:
  0x431a58: pan_ic+d8
  0x4240ee: EXP_Insert+7e
  0x42517b: FetchBody+53b
  0x433242: Pool_Work_Thread+112
  0x440488: wrk_thread_real+c8
  0x7fa9ce35b9ca: _end+7fa9cdcd8212
  0x7fa9ce0b8cdd: _end+7fa9cda35525




2012-03-13 23:06:47 [1, 0]: httperf-lru-nostream-default(httperf): Varnishstat uptime and measured run-time is too large (measured: 406 stat: 151 diff: 255). Did we crash?
2012-03-13 23:06:48 WARNING [0, 0]: httperf-lru-nostream-default(httperf): Out of bounds: n_lru_nuked(27232) less than lower boundary 80000
2012-03-13 23:06:48 WARNING [0, 0]: httperf-lru-nostream-default(httperf): Out of bounds: client_req(589679) less than lower boundary 1999720
2012-03-13 23:06:48 [1, 0]: httperf-lru-nostream-default(httperf): Load:  00:06:48 up 1 day, 11:52,  0 users,  load average: 7.49, 13.10, 10.70

2012-03-13 23:06:48 [1, 0]: httperf-lru-nostream-default(httperf): Test name: httperf-lru-nostream-default
2012-03-13 23:06:48 [1, 0]: httperf-lru-nostream-default(httperf): Varnish options: 
2012-03-13 23:06:48 [1, 0]: httperf-lru-nostream-default(httperf): -t=3600
2012-03-13 23:06:48 [1, 0]: httperf-lru-nostream-default(httperf): -w=200,5000
2012-03-13 23:06:48 [1, 0]: httperf-lru-nostream-default(httperf): -s=malloc,30M
2012-03-13 23:06:48 [1, 0]: httperf-lru-nostream-default(httperf): Varnish parameters: 
2012-03-13 23:06:48 [1, 0]: httperf-lru-nostream-default(httperf): nuke_limit=250
2012-03-13 23:06:48 [1, 0]: httperf-lru-nostream-default(httperf): Payload size (excludes headers): 10K
2012-03-13 23:06:48 [1, 0]: httperf-lru-nostream-default(httperf): Branch: master
2012-03-13 23:06:48 [1, 0]: httperf-lru-nostream-default(httperf): Number of clients involved: 24
2012-03-13 23:06:48 [1, 0]: httperf-lru-nostream-default(httperf): Type of test: httperf
2012-03-13 23:06:48 [1, 0]: httperf-lru-nostream-default(httperf): Test iterations: 1
2012-03-13 23:06:48 [1, 0]: httperf-lru-nostream-default(httperf): Runtime: 406 seconds
2012-03-13 23:06:48 [1, 0]: httperf-lru-nostream-default(httperf): VCL: 
backend foo {
	.host = "localhost";
	.port = "80";
}

sub vcl_fetch {
	set beresp.do_stream = false;
}

2012-03-13 23:06:48 [1, 0]: httperf-lru-nostream-default(httperf): Number of total connections: 200000
2012-03-13 23:06:48 [1, 0]: httperf-lru-nostream-default(httperf): Note: connections are subject to rounding when divided among clients. Expect slight deviations.
2012-03-13 23:06:48 [1, 0]: httperf-lru-nostream-default(httperf): Requests per connection: 10
2012-03-13 23:06:48 [1, 0]: httperf-lru-nostream-default(httperf): Extra options to httperf: --wset=1000000,0.1
2012-03-13 23:06:48 [1, 0]: httperf-lru-nostream-default(httperf): Httperf command (last client): httperf --hog --timeout 60 --num-calls 10 --num-conns 8333 --port 8080 --burst-length 10 --client 23/24 --server 10.20.100.4 --wset=1000000,0.1
2012-03-13 23:06:56 [2, 7]: httperf-rapid-expire(httperf): Starting test
2012-03-13 23:08:57 [2,121]: streaming-grace(httperf): Starting test
2012-03-13 23:11:36 WARNING [0,158]: streaming-grace(httperf): Out of bounds: client_req(9572) less than lower boundary 9784
2012-03-13 23:11:36 [1, 0]: streaming-grace(httperf): Load:  00:11:36 up 1 day, 11:57,  0 users,  load average: 1.48, 8.32, 9.61

2012-03-13 23:11:36 [1, 0]: streaming-grace(httperf): Test name: streaming-grace
2012-03-13 23:11:36 [1, 0]: streaming-grace(httperf): Varnish options: 
2012-03-13 23:11:36 [1, 0]: streaming-grace(httperf): -t=1
2012-03-13 23:11:36 [1, 0]: streaming-grace(httperf): Varnish parameters: 
2012-03-13 23:11:36 [1, 0]: streaming-grace(httperf): thread_pool_add_delay=1
2012-03-13 23:11:36 [1, 0]: streaming-grace(httperf): http_gzip_support=off
2012-03-13 23:11:36 [1, 0]: streaming-grace(httperf): default_grace=10
2012-03-13 23:11:36 [1, 0]: streaming-grace(httperf): Payload size (excludes headers): 1M
2012-03-13 23:11:36 [1, 0]: streaming-grace(httperf): Branch: master
2012-03-13 23:11:36 [1, 0]: streaming-grace(httperf): Number of clients involved: 24
2012-03-13 23:11:36 [1, 0]: streaming-grace(httperf): Type of test: httperf
2012-03-13 23:11:36 [1, 0]: streaming-grace(httperf): Test iterations: 1
2012-03-13 23:11:36 [1, 0]: streaming-grace(httperf): Runtime: 152 seconds
2012-03-13 23:11:36 [1, 0]: streaming-grace(httperf): VCL: 
backend foo {
	.host = "localhost";
	.port = "80";
	.connect_timeout = 10s;
}

sub vcl_recv {
	set req.grace = 15s;
}
sub vcl_fetch {
	set beresp.do_stream = true;
	set beresp.grace = 10s;
	set beresp.ttl = 15s;
}

sub vcl_deliver {
	set resp.http.x-fryer = "some test";
}

2012-03-13 23:11:36 [1, 0]: streaming-grace(httperf): Number of total connections: 10000
2012-03-13 23:11:36 [1, 0]: streaming-grace(httperf): Note: connections are subject to rounding when divided among clients. Expect slight deviations.
2012-03-13 23:11:36 [1, 0]: streaming-grace(httperf): Requests per connection: 1
2012-03-13 23:11:36 [1, 0]: streaming-grace(httperf): Extra options to httperf: --wset=1000,0.1 --rate 3
2012-03-13 23:11:36 [1, 0]: streaming-grace(httperf): Httperf command (last client): httperf --hog --timeout 60 --num-calls 1 --num-conns 416 --port 8080 --burst-length 1 --client 23/24 --server 10.20.100.4 --wset=1000,0.1 --rate 3
2012-03-13 23:11:44 [2, 7]: cold-default(httperf): Starting test
2012-03-13 23:16:05 WARNING [0,260]: cold-default(httperf): Panic detected. I think!
2012-03-13 23:16:05 WARNING [0, 0]: cold-default(httperf): 
Last panic at: Tue, 13 Mar 2012 23:14:17 GMT
Assert error in EXP_Insert(), cache/cache_expire.c line 226:
  Condition((oc)->magic == 0x4d301302) not true.
thread = (cache-worker)
ident = Linux,2.6.32-39-server,x86_64,-smalloc,-smalloc,-hcritbit,epoll
Backtrace:
  0x431a58: pan_ic+d8
  0x4240ee: EXP_Insert+7e
  0x42517b: FetchBody+53b
  0x433242: Pool_Work_Thread+112
  0x440488: wrk_thread_real+c8
  0x7fc8a9c279ca: _end+7fc8a95a4212
  0x7fc8a9984cdd: _end+7fc8a9301525




2012-03-13 23:16:05 [1, 0]: cold-default(httperf): Varnishstat uptime and measured run-time is too large (measured: 255 stat: 106 diff: 149). Did we crash?
2012-03-13 23:20:17 WARNING [0,251]: cold-default(httperf): Panic detected. I think!
2012-03-13 23:20:17 WARNING [0, 0]: cold-default(httperf): 
Last panic at: Tue, 13 Mar 2012 23:19:35 GMT
Assert error in HSH_Ref(), cache/cache_hash.c line 623:
  Condition(oc->refcnt > 0) not true.
thread = (cache-worker)
ident = Linux,2.6.32-39-server,x86_64,-smalloc,-smalloc,-hcritbit,epoll
Backtrace:
  0x431a58: pan_ic+d8
  0x4280d5: HSH_Ref+e5
  0x42410b: EXP_Insert+9b
  0x42517b: FetchBody+53b
  0x433242: Pool_Work_Thread+112
  0x440488: wrk_thread_real+c8
  0x7fc8a9c279ca: _end+7fc8a95a4212
  0x7fc8a9984cdd: _end+7fc8a9301525




2012-03-13 23:20:17 [1, 0]: cold-default(httperf): Varnishstat uptime and measured run-time is too large (measured: 507 stat: 41 diff: 466). Did we crash?
2012-03-13 23:20:17 WARNING [0, 0]: cold-default(httperf): Out of bounds: uptime(41) less than lower boundary 100
2012-03-13 23:20:17 WARNING [0, 0]: cold-default(httperf): Out of bounds: client_req(53160) less than lower boundary 1599640
2012-03-13 23:20:18 [1, 0]: cold-default(httperf): Load:  00:20:18 up 1 day, 12:06,  0 users,  load average: 1.35, 2.86, 6.23

2012-03-13 23:20:18 [1, 0]: cold-default(httperf): Test name: cold-default
2012-03-13 23:20:18 [1, 0]: cold-default(httperf): Varnish options: 
2012-03-13 23:20:18 [1, 0]: cold-default(httperf): -t=3600
2012-03-13 23:20:18 [1, 0]: cold-default(httperf): -s=malloc,10G
2012-03-13 23:20:18 [1, 0]: cold-default(httperf): Varnish parameters: 
2012-03-13 23:20:18 [1, 0]: cold-default(httperf): Payload size (excludes headers): 256
2012-03-13 23:20:18 [1, 0]: cold-default(httperf): Branch: master
2012-03-13 23:20:18 [1, 0]: cold-default(httperf): Number of clients involved: 24
2012-03-13 23:20:18 [1, 0]: cold-default(httperf): Type of test: httperf
2012-03-13 23:20:18 [1, 0]: cold-default(httperf): Test iterations: 2
2012-03-13 23:20:18 [1, 0]: cold-default(httperf): Runtime: 507 seconds
2012-03-13 23:20:18 [1, 0]: cold-default(httperf): VCL: 
backend foo {
	.host = "localhost";
	.port = "80";
}

sub vcl_fetch {
	set beresp.do_stream = true;
}

2012-03-13 23:20:18 [1, 0]: cold-default(httperf): Number of total connections: 80000
2012-03-13 23:20:18 [1, 0]: cold-default(httperf): Note: connections are subject to rounding when divided among clients. Expect slight deviations.
2012-03-13 23:20:18 [1, 0]: cold-default(httperf): Requests per connection: 10
2012-03-13 23:20:18 [1, 0]: cold-default(httperf): Extra options to httperf: --wset=4000000,0.50
2012-03-13 23:20:18 [1, 0]: cold-default(httperf): Httperf command (last client): httperf --hog --timeout 60 --num-calls 10 --num-conns 3333 --port 8080 --burst-length 10 --client 23/24 --server 10.20.100.4 --wset=4000000,0.50
2012-03-13 23:20:26 [2, 7]: 4gpluss-nogzip(httperf): Starting test
2012-03-13 23:20:29 WARNING [0, 3]: Varnish failed to start. Fallback attempts starting
2012-03-13 23:20:29 [1, 0]: Removed (hopefully incompatible) parameter to try to start varnish. Key: thread_pool_add_delay=1
2012-03-13 23:20:30 [1, 0]: Removed (hopefully incompatible) parameter to try to start varnish. Key: sess_timeout=60000s
2012-03-13 23:20:31 [1, 1]: Fallback worked. Parameter that seemed to cause problems: sess_timeout
2012-03-13 23:20:52 WARNING [0,20]: 4gpluss-nogzip(httperf): Out of bounds: s_bodybytes(0) less than lower boundary 25769803776
2012-03-13 23:20:52 [1, 0]: 4gpluss-nogzip(httperf): Load:  00:20:52 up 1 day, 12:06,  0 users,  load average: 1.30, 2.67, 6.04

2012-03-13 23:20:52 [1, 0]: 4gpluss-nogzip(httperf): Test name: 4gpluss-nogzip
2012-03-13 23:20:52 [1, 0]: 4gpluss-nogzip(httperf): Varnish options: 
2012-03-13 23:20:52 [1, 0]: 4gpluss-nogzip(httperf): -t=60000
2012-03-13 23:20:52 [1, 0]: 4gpluss-nogzip(httperf): -s=malloc,12G
2012-03-13 23:20:52 [1, 0]: 4gpluss-nogzip(httperf): Varnish parameters: 
2012-03-13 23:20:52 [1, 0]: 4gpluss-nogzip(httperf): sess_timeout=60000s
2012-03-13 23:20:52 [1, 0]: 4gpluss-nogzip(httperf): http_gzip_support=off
2012-03-13 23:20:52 [1, 0]: 4gpluss-nogzip(httperf): send_timeout=60000s
2012-03-13 23:20:52 [1, 0]: 4gpluss-nogzip(httperf): Payload size (excludes headers): 5G
2012-03-13 23:20:52 [1, 0]: 4gpluss-nogzip(httperf): Branch: master
2012-03-13 23:20:52 [1, 0]: 4gpluss-nogzip(httperf): Number of clients involved: 24
2012-03-13 23:20:52 [1, 0]: 4gpluss-nogzip(httperf): Type of test: httperf
2012-03-13 23:20:52 [1, 0]: 4gpluss-nogzip(httperf): Test iterations: 1
2012-03-13 23:20:52 [1, 0]: 4gpluss-nogzip(httperf): Runtime: 18 seconds
2012-03-13 23:20:52 [1, 0]: 4gpluss-nogzip(httperf): VCL: 
backend foo {
	.host = "localhost";
	.port = "80";
}

sub vcl_recv {
	# Only using a single object for the nogzip-variant to reduce
	# memory footprint and save time.
	set req.url = "/1";
}

2012-03-13 23:20:52 [1, 0]: 4gpluss-nogzip(httperf): Number of total connections: 25
2012-03-13 23:20:52 [1, 0]: 4gpluss-nogzip(httperf): Note: connections are subject to rounding when divided among clients. Expect slight deviations.
2012-03-13 23:20:52 [1, 0]: 4gpluss-nogzip(httperf): Requests per connection: 1
2012-03-13 23:20:52 [1, 0]: 4gpluss-nogzip(httperf): Extra options to httperf: --wset=2,0.05 --timeout 6000
2012-03-13 23:20:52 [1, 0]: 4gpluss-nogzip(httperf): Httperf command (last client): httperf --hog --timeout 60 --num-calls 1 --num-conns 1 --port 8080 --burst-length 10 --client 23/24 --server 10.20.100.4 --wset=2,0.05 --timeout 6000
2012-03-13 23:21:00 [2, 7]: purge-fail(httperf): Starting test
2012-03-13 23:23:52 [2,171]: streaming-gzip(httperf): Starting test
2012-03-13 23:26:17 WARNING [0,145]: Tests finished with problems detected. Failed expectations: 16 Total run time: 10455 seconds 



More information about the varnish-test mailing list