Waiting list?

[Jon Drukman]

We've got a varnish server that we're trying to put into production, but 
it seems to get itself into a very bad state after only an hour or so of 
being up.

All requests end up like this:

    92 SessionOpen  c 64.81.61.44 46900
    92 ReqStart     c 64.81.61.44 46900 1629712861
    92 RxRequest    c GET
    92 RxURL        c /
    92 RxProtocol   c HTTP/1.1
    92 RxHeader     c User-Agent: curl/7.16.3 (powerpc-apple-darwin9.0) 
libcurl/7.16.3 OpenSSL/0.9.7l zlib/1.2.3
    92 RxHeader     c Host: go24.cn
    92 RxHeader     c Accept: */*
    92 VCL_call     c recv
    92 VCL_return   c lookup
    92 VCL_call     c hash
    92 VCL_return   c hash
    92 Debug        c "on waiting list on obj 1629712739"
     0 StatAddr       64.81.61.44 0 nan 16 16 0 0 3 5483 637585

That's it.  After the "waiting list" message the request just hangs 
indefinitely.

The only noteworthy piece of information I can think of is that the 
connection between the varnish server and the back end is slow and prone 
to packet loss.  (Varnish is in China, backend is in the USA.)