<html><head>
<meta http-equiv="Content-Type" content="text/html; charset=Windows-1252"><title>Let GoogleBot Crawl full content, reverse DNS lookup</title>
</head>
<body>
<font face="Arial"><span style="font-size:11pt"><br>
I am looking into supporting Google’s “First Click Free for Web Search”. I need to allow the GoogleBots to index the full content of my sites but still maintain the Registration wall for everyone else. Google suggests that you detect there GoogleBots by reverse DNS lookup of the requesters IP. <br>
<br>
Google Desc: <a href="http://www.google.com/support/webmasters/bin/answer.py?answer=80553">http://www.google.com/support/webmasters/bin/answer.py?answer=80553</a><br>
<br>
Has anyone done DNS lookups via VCL to verify access to content or to cache content?<br>
<br>
System Desc:<br>
Varnish 2.1.4<br>
RHEL 5-4<br>
Apache 2.2x<br>
<br>
- Richard</span></font>
</body>
</html>