PDA

View Full Version : Googlebot

mattieu
2-7-04, 08:01 AM
Hi,

How would you put a no archive for Googlebot in the robots.txt file?
l know how to fo in the <head> </head>, but can't find resources related to Google for robots.txt.

Thanks,

Mattieu :cool:
YvetteKuhns
2-7-04, 08:13 AM
<META NAME="ROBOTS" CONTENT="NOINDEX">

http://www.robotstxt.org/wc/faq.html
much more info

http://www.webtoolcentral.com/webmaster/tools/robots_txt_file_generator/
generator to create your own robots.txt file
mattieu
2-7-04, 10:29 AM
Hi,

Thanks for reply. Addresses you sent, l already visited, and went through extensive searches but can't find how l would put
<meta name=googlebot robots="no_archive">

into robots.txt

user-agent googlebot
Disallow: /(what do l input here)

Thanks

Mattieu (UK)
:(
rainbore
2-7-04, 11:36 AM
Hi Mattieu,

To keep Google from indexing your entire site, put the following in your robots.txt file:

User-agent: googlebot
Disallow: /

Good luck!
YvetteKuhns
2-7-04, 01:56 PM
The link I posted tells the names of many robots including Googlebot. rainbore posted it so you don't have to read! I guess I posted more info than you wanted, but I thought you might want it later.
mattieu
2-7-04, 06:39 PM
Thanks, keep well.

Mattieu

:cool: