Knowledge Base Article

How to block search bots from accessing your site?

In order to block all bots from accessing your site, you should create a robots.txt file with the following content:

 

User-agent: *
Disallow: /

 

To block all bots from accessing a specific folder, you should create a robots.txt file with the following content:

 

User-agent: *
Disallow: /folder/

 

Please note that blocking all bots will get your site deindexed from search engines.



Rating

Please indicate if this article was helpful for you.

rating :  4.7 from 5
views :  1853
votes :  12

Related Articles

Views

Haven't found what you are looking for? Suggest an article HERE.

powered by

Valid XHTML 1.0 Strict Valid CSS!