The exooba crawler is a testing crawler. The information gathered by the exooba crawler is strictly for testing purposes and will not be available for public display. The exooba crawler complies fully with robots.txt so if you do not wish for the exooba crawler to crawl your site create a text file in your server root titled robots.txt if you have not done so already, and enter the following:

If you only would like the exooba crawler to ignore a certain directory or directories, change:

to

For further information regarding robots.txt visit www.robotstxt.org

For further information regarding exooba.com please feel free to email us at info@exooba.com