robots.txt Generator

Generate effective robots.txt files that help ensure Google and other search engines are crawling and indexing your site properly. 

By default all robots are

Crawl delay

Enter the Sitemap URL. Leave blank for none.

Robots are allowed to crawl your website:

Restricted directories or files. Relative to root, with trailing slash for dirs.

Your Robots.txt

Popular posts from this blog

Basic Math Calculator

Beautify JavaScript and jQuery Code

Image to Base64 Converter

How to take Screenshot ?

Megapixels vs DPI : How to buy a good camera?