Check your URL Configuration Patterns. In order to make documents on other websites searchable, but only the documents you link to and not the entire other website, enter "/ INDEX NOFOLLOW" on the first line of the Patterns field. And on the second line, enter "www.yourdomain.com INDEX FOLLOW". This allows you to still configure what parts of your website you do and do not want searchable on subsequent lines in the Patterns field.
CAUTION! Do not just enter "/". The default options are INDEX and FOLLOW. All documents have a "/" in their path somewhere! For example, "http://www.anydomain.com/. All documents on your website and on websites you link to will be crawled. Spiderline does not necessarily crawl all documents beginning with your domain first. If you enter a "/", you could crawl every website on the internet.
If you have only a few website you link to, you can just specify their domain name followed by INDEX NOFOLLOW.
Print