301 Error

[DavT]

Google's freshbot is currently spidering my site or trying to.

It is receiving a ton of 301 errors for pages which I have never moved or changed name.

GoogleBot is the only user-agent receiving these errors, when I call up the relevant page myself no problem, when other people call it no problem either.

Anyone got any ideas?

[RadioRob]

Hello!

Do you have some kind of .htaccess file running on your site? If so, make sure it's set not to disallow robots/spiders. Also make sure it's correctly redirection site traffic.

Good luck!

[DavT]

It's not just GoogleBot now also this:

66.77.73.56 - - [26/Jan/2003:19:56:06 -0800] "GET /robots.txt HTTP/1.0" 301 243 "-" "FAST-WebCrawler

Seems to only affect robots.

Yes RadioRob I use .htaccess but if I were accidentally blocking google or Fast they would be receiving 403s not 301s.

I use RedirectPermanents but obviously not with a robots.txt file! or with any of the other files and directories that are being affected.

64.68.82.46 - - [26/Jan/2003:20:26:16 -0800] "GET /Mirrors/pages/RF_Mir_002.htm HTTP/1.0" 301 261 "-" "Googlebot/2.1 (+http://www.googlebot.com/bot.html)"


I have not touched the 'Mirrors' directory since the site was uploaded 5 months ago. There are no Redirects in .htaccess that mention the Mirrors directory.

I can't work it out. It's worrying because it might affect my ranking.