Robots.txt Generator

A robots.txt is a file that's placed in the web root directory of your website. It tells search engines what to crawl as well as what not to crawl. All the major search engines look for and use robots.txt. Use our generator to produce a robots.txt file you can put on your website

Generate a robots.txt file for your web site or blog simply by filling in the form below.

Already a VisibilityPro member? Log-in here

Terms and Conditions | Click here for help

By submitting, you indicate that you have read and agree to the VisibilityPro Terms of Service and Privacy Policy.

Related Tools:

Here are links to other tools related to this section.

Add a Site

Delete a Site

View/Edit Site Details

View Crawl Report

Request a Crawl

Need a little help?

If you are having troubles figuring out just what to do, look no further than below.

Click here for Help