If your crawl is not returning after a adaquate time. Adaquate meaning enough time for you to upload your full site on a 56K connection, time for pdf files and text documents to be opened and read for indexing. Some sites with many PDF files and many documents can take many hours to complete a crawl. Crawl throttleing can affect this as well a 5 second crawl throttle for 1000 documents is adding over an hour of time to your crawl.
If there was an error from your site durring the crawl, your account could have the crawler lock. This lock is to avoid the crawler being in a loop reading your site indefinitely, this is a safety measure for all clients accounts. Your site will still be searchable, the former crawl will be the database for your visitors searches. If your account says "crawl in progress" but has not been updated in the reasonable time, please contact support to have the crawl unlocked.
support@spiderline.com
Print