Results 1 to 3 of 3

Thread: AhrefsBot

  1. #1

    Join Date
    May 2002
    Posts
    90
    Rep Power
    15

    AhrefsBot

    How do I stop AhrefsBot from hitting my site? see snapshot of my stats in attachment...

    I saw one website that said to do the following....

    How to turn it off?

    The quick way to prevent AhrefsBot visiting your site is
    to put these two lines into the /robots.txt file on your server:

    user-agent: AhrefsBot
    disallow: /



    ...But there is no robots folder!

    Not sure what to do but here's where I got the info about the robot.txt...

    http://blocklistpro.com/content-scra...o-spybots.html

    Thanks for any help!
    Mike
    Attached Images Attached Images  

  2. #2
    Rick
    Join Date
    May 2002
    Location
    Minneapolis, MN
    Posts
    1,752
    Rep Power
    18
    The article you saw wasn't referring to a 'robots' folder. It's talking about the 'robots.txt' file, which is the web standard for blocking search engine robots from accessing selected files or directories/folders. The instruction suggested by that article would prevent the Ahrefsbot from accessing any files from your site. See https://support.google.com/webmaster..._topic=2370588 for details on creating and using the robots.txt file.
    Rick Trethewey

  3. #3

    Join Date
    May 2002
    Posts
    90
    Rep Power
    15
    Thank you Rick.

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts
  •