Little stats script - tophits.sh

[Jean-Francois Laurens]

Thanks for sharing this !! 
I'll try it asap !

Jef

Jean-Francois Laurens
pavionove at gmail.com



Le 27 mai 2011 à 03:27, Simon Lyall a écrit :

> 
> In case anyone finds this useful. It is a little script that outputs the URLs that are doing the most hits and most bandwidth.
> 
> It's a bit of a hack (I see bits I could tidy just now) but works okay for me. Main bug is that URLs with different sizes (gziped/non-gziped mainly) are totalled seperately.
> 
> 
> #!/bin/bash
> varnishncsa -d > /tmp/vlog
> #
> START1=`head -1 /tmp/vlog | cut -f4 -d" " | cut -f2 -d"[" | sed "s/\/[0-9]*\:/\//" | awk -F/ ' { print $2" "$1" "$3 } ' `
> START=`date +%s --date="$START1"`
> FIN1=`tail -1 /tmp/vlog | cut -f4 -d" " | cut -f2 -d"[" | sed "s/\/[0-9]*\:/\//" | awk -F/ ' { print $2" "$1" "$3 } ' `
> FIN=`date +%s --date="$FIN1"`
> DIFF=` echo " $FIN - $START " | bc `
> 
> echo "Data for the last $DIFF seconds "
> 
> cat /tmp/vlog | sed "s/\%5F/_/g"  | sed "s/\%2E/\./g" > /tmp/tophits.tmp
> echo ""
> echo "Top Hits per second URLs"
> echo ""
> cat /tmp/tophits.tmp | awk -v interval=$DIFF ' { COUNT += 1 } END { OFMT = "%f" ; printf "Total Hits/second: %i\n" , COUNT/interval }'
> echo ""
> cat /tmp/tophits.tmp | awk ' { print $7 }' | sort | uniq -c | sort -rn | head -20  | awk -v interval=$DIFF ' { printf "%4.1f Hits/s %s\n" , $1/interval , $2 } '
> echo ""
> echo ""
> echo "URLs using the most bandwidth"
> echo ""
> cat /tmp/tophits.tmp | awk -v interval=$DIFF ' { SUM += $10} END { OFMT = "%f" ; printf "Total Bits/second: %6.1f Kb/s \n", SUM*8/interval/1000 }'
> echo ""
> cat /tmp/tophits.tmp | awk  ' { print $10 " " $7 }' | sort | uniq -c | awk -v interval=$DIFF ' { printf "%6.1f Kb/s  %i h/min  %i KB  %s\n" , $1*$2/interval*8/1000,$1*60/interval,$2/1000,$3}' | sort -rn | head -20
> echo ""
> echo ""
> 
> 
> 
> -- 
> Simon Lyall  |  Very Busy  |  Web: http://www.darkmere.gen.nz/
> "To stay awake all night adds a day to your life" - Stilgar | eMT.
> 
> 
> _______________________________________________
> varnish-misc mailing list
> varnish-misc at varnish-cache.org
> http://www.varnish-cache.org/lists/mailman/listinfo/varnish-misc