[Fryer] experimental-ims FAIL. 19 of 24 tests succeeded.

Thu Oct 13 21:09:09 CEST 2011

Tests Failed: 4gpluss-nostream 4gpluss-stream 4gpluss httperf-rapid-expire purge-fail 


Tests OK: httperf-lru-default httperf-lru-stream-nogzip 4gpluss-nogzip cold-default basic-fryer cold-gzip httperf-lru-nostream-gzip streaming cold-nogzip streaming-gzip httperf-lru-nostream-nogzip httperf-hot memleak sky-misc httperf-lru-stream-gzip httperf-lru-nostream-default streaming-grace siege-test httperf-lru-stream-default 


2011-10-13 16:12:51 [1,26]: Server tristran checked out varnish-3.0.0-beta2-221-g71ee192 of branch experimental-ims
2011-10-13 16:14:12 [2,80]: httperf-lru-default(httperf): Starting test
2011-10-13 16:17:33 [2,200]: httperf-lru-stream-nogzip(httperf): Starting test
2011-10-13 16:20:57 [2,204]: 4gpluss-nostream(httperf): Starting test
2011-10-13 16:42:03 WARNING [0,1265]: 4gpluss-nostream(httperf): Out of bounds: s_bodybytes(562253976) less than lower boundary 25769803776
2011-10-13 16:42:04 [1, 0]: 4gpluss-nostream(httperf): Load:  18:42:04 up 71 days,  6:57,  0 users,  load average: 1.13, 1.34, 2.96

2011-10-13 16:42:04 [1, 0]: 4gpluss-nostream(httperf): Test name: 4gpluss-nostream
2011-10-13 16:42:04 [1, 0]: 4gpluss-nostream(httperf): Varnish options: 
2011-10-13 16:42:04 [1, 0]: 4gpluss-nostream(httperf): -t=60000
2011-10-13 16:42:04 [1, 0]: 4gpluss-nostream(httperf): -s=malloc,12G
2011-10-13 16:42:04 [1, 0]: 4gpluss-nostream(httperf): Varnish parameters: 
2011-10-13 16:42:04 [1, 0]: 4gpluss-nostream(httperf): sess_timeout=60000s
2011-10-13 16:42:04 [1, 0]: 4gpluss-nostream(httperf): send_timeout=60000s
2011-10-13 16:42:04 [1, 0]: 4gpluss-nostream(httperf): Payload size (excludes headers): 5G
2011-10-13 16:42:04 [1, 0]: 4gpluss-nostream(httperf): Branch: experimental-ims
2011-10-13 16:42:04 [1, 0]: 4gpluss-nostream(httperf): Number of clients involved: 24
2011-10-13 16:42:04 [1, 0]: 4gpluss-nostream(httperf): Type of test: httperf
2011-10-13 16:42:04 [1, 0]: 4gpluss-nostream(httperf): Test iterations: 1
2011-10-13 16:42:04 [1, 0]: 4gpluss-nostream(httperf): Runtime: 1257 seconds
2011-10-13 16:42:04 [1, 0]: 4gpluss-nostream(httperf): VCL: 
backend foo {
	.host = "localhost";
	.port = "80";
}

sub vcl_recv {
	if (req.url ~ "[0-9]") {
		set req.url = "/1";
	} else {
		set req.url = "/2";
	}
}
sub vcl_fetch {
	set beresp.do_stream = false;
}

2011-10-13 16:42:04 [1, 0]: 4gpluss-nostream(httperf): Number of total connections: 25
2011-10-13 16:42:04 [1, 0]: 4gpluss-nostream(httperf): Note: connections are subject to rounding when divided among clients. Expect slight deviations.
2011-10-13 16:42:04 [1, 0]: 4gpluss-nostream(httperf): Requests per connection: 1
2011-10-13 16:42:04 [1, 0]: 4gpluss-nostream(httperf): Extra options to httperf: --wset=2,0.05 --timeout 6000
2011-10-13 16:42:04 [1, 0]: 4gpluss-nostream(httperf): Httperf command (last client): httperf --hog --timeout 60 --num-calls 1 --num-conns 1 --port 8080 --burst-length 10 --client 23/24 --server 10.20.100.4 --wset=2,0.05 --timeout 6000
2011-10-13 16:42:11 [2, 7]: 4gpluss-stream(httperf): Starting test
2011-10-13 17:03:21 WARNING [0,1269]: 4gpluss-stream(httperf): Out of bounds: s_bodybytes(538826727) less than lower boundary 25769803776
2011-10-13 17:03:21 [1, 0]: 4gpluss-stream(httperf): Load:  19:03:21 up 71 days,  7:19,  0 users,  load average: 1.14, 1.18, 1.61

2011-10-13 17:03:21 [1, 0]: 4gpluss-stream(httperf): Test name: 4gpluss-stream
2011-10-13 17:03:21 [1, 0]: 4gpluss-stream(httperf): Varnish options: 
2011-10-13 17:03:21 [1, 0]: 4gpluss-stream(httperf): -t=60000
2011-10-13 17:03:21 [1, 0]: 4gpluss-stream(httperf): -s=malloc,12G
2011-10-13 17:03:21 [1, 0]: 4gpluss-stream(httperf): Varnish parameters: 
2011-10-13 17:03:21 [1, 0]: 4gpluss-stream(httperf): sess_timeout=60000s
2011-10-13 17:03:21 [1, 0]: 4gpluss-stream(httperf): send_timeout=60000s
2011-10-13 17:03:21 [1, 0]: 4gpluss-stream(httperf): Payload size (excludes headers): 5G
2011-10-13 17:03:21 [1, 0]: 4gpluss-stream(httperf): Branch: experimental-ims
2011-10-13 17:03:21 [1, 0]: 4gpluss-stream(httperf): Number of clients involved: 24
2011-10-13 17:03:21 [1, 0]: 4gpluss-stream(httperf): Type of test: httperf
2011-10-13 17:03:21 [1, 0]: 4gpluss-stream(httperf): Test iterations: 1
2011-10-13 17:03:21 [1, 0]: 4gpluss-stream(httperf): Runtime: 1258 seconds
2011-10-13 17:03:21 [1, 0]: 4gpluss-stream(httperf): VCL: 
backend foo {
	.host = "localhost";
	.port = "80";
}

sub vcl_recv {
	if (req.url ~ "[0-9]") {
		set req.url = "/1";
	} else {
		set req.url = "/2";
	}
}
sub vcl_fetch {
	set beresp.do_stream = true;
}

2011-10-13 17:03:21 [1, 0]: 4gpluss-stream(httperf): Number of total connections: 25
2011-10-13 17:03:21 [1, 0]: 4gpluss-stream(httperf): Note: connections are subject to rounding when divided among clients. Expect slight deviations.
2011-10-13 17:03:21 [1, 0]: 4gpluss-stream(httperf): Requests per connection: 1
2011-10-13 17:03:21 [1, 0]: 4gpluss-stream(httperf): Extra options to httperf: --wset=2,0.05 --timeout 6000
2011-10-13 17:03:21 [1, 0]: 4gpluss-stream(httperf): Httperf command (last client): httperf --hog --timeout 60 --num-calls 1 --num-conns 1 --port 8080 --burst-length 10 --client 23/24 --server 10.20.100.4 --wset=2,0.05 --timeout 6000
2011-10-13 17:03:34 [2,12]: 4gpluss-nogzip(httperf): Starting test
2011-10-13 17:47:48 [2,2654]: cold-default(httperf): Starting test
2011-10-13 17:52:15 [2,267]: basic-fryer(httperf): Starting test
2011-10-13 17:52:35 [2,19]: cold-gzip(httperf): Starting test
2011-10-13 17:56:51 [2,256]: httperf-lru-nostream-gzip(httperf): Starting test
2011-10-13 18:00:01 [2,190]: streaming(httperf): Starting test
2011-10-13 18:02:48 [2,166]: cold-nogzip(httperf): Starting test
2011-10-13 18:06:17 [2,208]: streaming-gzip(httperf): Starting test
2011-10-13 18:08:50 [2,153]: httperf-lru-nostream-nogzip(httperf): Starting test
2011-10-13 18:12:00 [2,190]: 4gpluss(httperf): Starting test
2011-10-13 18:32:51 WARNING [0,1251]: 4gpluss(httperf): Out of bounds: s_bodybytes(562253976) less than lower boundary 25769803776
2011-10-13 18:32:52 [1, 0]: 4gpluss(httperf): Load:  20:32:52 up 71 days,  8:48,  0 users,  load average: 1.06, 1.19, 2.15

2011-10-13 18:32:52 [1, 0]: 4gpluss(httperf): Test name: 4gpluss
2011-10-13 18:32:52 [1, 0]: 4gpluss(httperf): Varnish options: 
2011-10-13 18:32:52 [1, 0]: 4gpluss(httperf): -t=60000
2011-10-13 18:32:52 [1, 0]: 4gpluss(httperf): -s=malloc,12G
2011-10-13 18:32:52 [1, 0]: 4gpluss(httperf): Varnish parameters: 
2011-10-13 18:32:52 [1, 0]: 4gpluss(httperf): sess_timeout=60000s
2011-10-13 18:32:52 [1, 0]: 4gpluss(httperf): send_timeout=60000s
2011-10-13 18:32:52 [1, 0]: 4gpluss(httperf): Payload size (excludes headers): 5G
2011-10-13 18:32:52 [1, 0]: 4gpluss(httperf): Branch: experimental-ims
2011-10-13 18:32:52 [1, 0]: 4gpluss(httperf): Number of clients involved: 24
2011-10-13 18:32:52 [1, 0]: 4gpluss(httperf): Type of test: httperf
2011-10-13 18:32:52 [1, 0]: 4gpluss(httperf): Test iterations: 1
2011-10-13 18:32:52 [1, 0]: 4gpluss(httperf): Runtime: 1242 seconds
2011-10-13 18:32:52 [1, 0]: 4gpluss(httperf): VCL: 
backend foo {
	.host = "localhost";
	.port = "80";
}

sub vcl_recv {
	if (req.url ~ "[0-9]") {
		set req.url = "/1";
	} else {
		set req.url = "/2";
	}
}

2011-10-13 18:32:52 [1, 0]: 4gpluss(httperf): Number of total connections: 25
2011-10-13 18:32:52 [1, 0]: 4gpluss(httperf): Note: connections are subject to rounding when divided among clients. Expect slight deviations.
2011-10-13 18:32:52 [1, 0]: 4gpluss(httperf): Requests per connection: 1
2011-10-13 18:32:52 [1, 0]: 4gpluss(httperf): Extra options to httperf: --wset=2,0.05 --timeout 6000
2011-10-13 18:32:52 [1, 0]: 4gpluss(httperf): Httperf command (last client): httperf --hog --timeout 60 --num-calls 1 --num-conns 1 --port 8080 --burst-length 10 --client 23/24 --server 10.20.100.4 --wset=2,0.05 --timeout 6000
2011-10-13 18:32:59 [2, 7]: httperf-hot(httperf): Starting test
2011-10-13 18:34:44 [2,104]: memleak(httperf): Starting test
2011-10-13 18:45:43 [2,658]: sky-misc(httperf): Starting test
2011-10-13 18:51:36 [2,353]: httperf-lru-stream-gzip(httperf): Starting test
2011-10-13 18:54:52 [2,196]: httperf-lru-nostream-default(httperf): Starting test
2011-10-13 18:58:11 [2,198]: httperf-rapid-expire(httperf): Starting test
2011-10-13 18:59:09 WARNING [0,58]: httperf-rapid-expire(httperf): Out of bounds: client_req(123468) less than lower boundary 999640
2011-10-13 18:59:09 WARNING [0, 0]: httperf-rapid-expire(httperf): Out of bounds: cache_hitpass(97404) more than upper boundary 0
2011-10-13 18:59:09 [1, 0]: httperf-rapid-expire(httperf): Load:  20:59:09 up 71 days,  9:14,  0 users,  load average: 4.11, 10.94, 12.73

2011-10-13 18:59:09 [1, 0]: httperf-rapid-expire(httperf): Test name: httperf-rapid-expire
2011-10-13 18:59:09 [1, 0]: httperf-rapid-expire(httperf): Varnish options: 
2011-10-13 18:59:09 [1, 0]: httperf-rapid-expire(httperf): -t=2
2011-10-13 18:59:09 [1, 0]: httperf-rapid-expire(httperf): Varnish parameters: 
2011-10-13 18:59:09 [1, 0]: httperf-rapid-expire(httperf): Payload size (excludes headers): 256
2011-10-13 18:59:09 [1, 0]: httperf-rapid-expire(httperf): Branch: experimental-ims
2011-10-13 18:59:09 [1, 0]: httperf-rapid-expire(httperf): Number of clients involved: 24
2011-10-13 18:59:09 [1, 0]: httperf-rapid-expire(httperf): Type of test: httperf
2011-10-13 18:59:09 [1, 0]: httperf-rapid-expire(httperf): Test iterations: 1
2011-10-13 18:59:09 [1, 0]: httperf-rapid-expire(httperf): Runtime: 52 seconds
2011-10-13 18:59:09 [1, 0]: httperf-rapid-expire(httperf): VCL: 
backend foo {
	.host = "localhost";
	.port = "80";
}

sub vcl_fetch {
	set beresp.do_stream = true;
}

2011-10-13 18:59:09 [1, 0]: httperf-rapid-expire(httperf): Number of total connections: 100000
2011-10-13 18:59:09 [1, 0]: httperf-rapid-expire(httperf): Note: connections are subject to rounding when divided among clients. Expect slight deviations.
2011-10-13 18:59:09 [1, 0]: httperf-rapid-expire(httperf): Requests per connection: 10
2011-10-13 18:59:09 [1, 0]: httperf-rapid-expire(httperf): Extra options to httperf: --wset=100,0.30
2011-10-13 18:59:09 [1, 0]: httperf-rapid-expire(httperf): Httperf command (last client): httperf --hog --timeout 60 --num-calls 10 --num-conns 4166 --port 8080 --burst-length 10 --client 23/24 --server 10.20.100.4 --wset=100,0.30
2011-10-13 18:59:22 [2,12]: purge-fail(httperf): Starting test
2011-10-13 19:01:43 WARNING [0,141]: purge-fail(httperf): Out of bounds: cache_hitpass(282018) more than upper boundary 0
2011-10-13 19:01:44 [1, 0]: purge-fail(httperf): Load:  21:01:44 up 71 days,  9:17,  0 users,  load average: 1.58, 7.30, 11.08

2011-10-13 19:01:44 [1, 0]: purge-fail(httperf): Test name: purge-fail
2011-10-13 19:01:44 [1, 0]: purge-fail(httperf): Varnish options: 
2011-10-13 19:01:44 [1, 0]: purge-fail(httperf): -w=5,100
2011-10-13 19:01:44 [1, 0]: purge-fail(httperf): Varnish parameters: 
2011-10-13 19:01:44 [1, 0]: purge-fail(httperf): Payload size (excludes headers): 1K
2011-10-13 19:01:44 [1, 0]: purge-fail(httperf): Branch: experimental-ims
2011-10-13 19:01:44 [1, 0]: purge-fail(httperf): Number of clients involved: 24
2011-10-13 19:01:44 [1, 0]: purge-fail(httperf): Type of test: httperf
2011-10-13 19:01:44 [1, 0]: purge-fail(httperf): Test iterations: 1
2011-10-13 19:01:44 [1, 0]: purge-fail(httperf): Runtime: 135 seconds
2011-10-13 19:01:44 [1, 0]: purge-fail(httperf): VCL: 
backend foo {
	.host = "localhost";
	.port = "80";
}

sub vcl_recv {
	if (!req.url ~ "/0/0.html") {
		set req.request = "PURGE";
	}
	set req.url = "/foo";
	return (lookup);
}
sub vcl_hit {
	if (req.request == "PURGE") {
		set obj.ttl = 0s;
		error 200 "OK";
	}
}
sub vcl_miss {
	if (req.request == "PURGE") {
		error 200 "Not in cache but not confusing httperf";
	}
}


2011-10-13 19:01:44 [1, 0]: purge-fail(httperf): Number of total connections: 300000
2011-10-13 19:01:44 [1, 0]: purge-fail(httperf): Note: connections are subject to rounding when divided among clients. Expect slight deviations.
2011-10-13 19:01:44 [1, 0]: purge-fail(httperf): Requests per connection: 1
2011-10-13 19:01:44 [1, 0]: purge-fail(httperf): Extra options to httperf: --wset=999,0.5 --timeout=5
2011-10-13 19:01:44 [1, 0]: purge-fail(httperf): Httperf command (last client): httperf --hog --timeout 60 --num-calls 1 --num-conns 12500 --port 8080 --burst-length 10 --client 23/24 --server 10.20.100.4 --wset=999,0.5 --timeout=5
2011-10-13 19:01:51 [2, 7]: streaming-grace(httperf): Starting test
2011-10-13 19:04:47 [2,175]: siege-test(siege): Starting test
2011-10-13 19:06:06 [2,79]: httperf-lru-stream-default(httperf): Starting test
2011-10-13 19:09:09 WARNING [0,183]: Tests finished with problems detected. Failed expectations: 5 Total run time: 10604 seconds