|
| Remember! UptimeBot is not crawling all your site through, it just requests the head of your server (about 200 bytes) to check your server type and it's return code only. If you want to exclude your domain name from crawling list, you need either to fill the form below or insert the following code string in your robots.txt file: User-agent: Uptimebot Disallow: / Note: In case if you exclude UptimeBot through robots.txt file, the crawler can still refer to your server in order to check robots.txt file as all other web spiders and crawlers do. |