Strategy for large cache sets

[Barry Abrahamson]

On Jul 1, 2008, at 2:16 PM, Skye Poier Nott wrote:

> I want to deploy Varnish with very large cache sizes (200GB or more)
> for large, long lived file sets.

We are doing this also and running into performance problems.  We have  
tried files and swap  Running on Linux (Debian).  When the cache  
starts to get large, we start to see huge load spikes (loads of 200+)  
caused by IO wait but no corresponding spikes in request rates or any  
of the varnish metrics (except threads running which I am pretty sure  
is a result of the load spike and not the cause).   We are currently  
running 1.1.2 but have tried with trunk and the same thing happens.   
If you find anything useful in your testing, I would love you hear  
about it.

--
Barry Abrahamson | Systems Wrangler | Automattic
Blog: http://barry.wordpress.com