How to authenticate Googlebot

Who should read it: Whoever is interested in getting traffic from Search Engine esp Google.

Google Bot is a welcome visitor to all the websites and in recent time I have covered few topics on Google Bot. Here is the list:

  1. Google Bot went Unhappy
  2. Google Bot Mystery
  3. Google Bot and cache

Thanks to Matt cutts for helping me continue with the series. As I have explained earlier that you can fake Google bot by changing the user agents. Firefox extensions are allowing you do this easily, try

Matt and his team says,

Telling webmasters to use DNS to verify on a case-by-case basis seems like the best way to go. I think the recommended technique would be to do a reverse DNS lookup, verify that the name is in the domain, and then do a corresponding forward DNS->IP lookup using that name; eg:

> host domain name pointer

> host has address

I don’t think just doing a reverse DNS lookup is sufficient, because a spoofer could set up reverse DNS to point to


One Reply to “How to authenticate Googlebot”

  1. If one add Googlebot/2.1 (+ as an agent to user agent switcher it acts as google bot. You sometimes get access to many hidden files too :).

Comments are closed.