|
Knowledge Base Article
How to block bots from accessing your site?
In order to block all bots from accessing your site, you should create a robots.txt file with the following content:
User-agent: *
To block all bots from accessing a specific folder, you should create a robots.txt file with the following content:
User-agent: *
Please note that blocking all bots will get your site deindexed from search engines. Rating
|
Copyright ® 2004-2008 SiteGround.com
Web hosting knowledge base
