|
On Demand Updates
At any time you can request a full
recrawl of your site(s) to be performed
immediately.
Span Multiple Sites
Our competitors sell this feature at added cost
under terms like "search portal". At
Spiderline, we consider this basic and offer
it with every service plan.
Turn on/off Fields
Where words are found in documents directly affects the
ranking of search results. You can choose which meta fields
are indexed.
Cookie Support
Our web crawler will act like a real user browsing your website.
Even cookies are supported - allowing Spiderline to crawl parts of
your website that other web crawlers can't reach.
|
|
Spider Throttling
If you're concerned that Spiderline's web crawler may place too great a
load on your web server, you can set a delay between requests.
Password Support
Spiderline can also crawl sites with password protected areas
by allowing you to supply any number of credentials.
Meta Data Option
Many websites use the same meta keyword and description tags
on every page. If this is you, Spiderline lets you turn off
indexing of these words so they do not have a negative effect
on search results.
Custom Cookies
You can specify any number of custom cookies to be added to the web crawler
before it visits your site. This allows for easy integration with even
complex website authentication systems.
|
|
Crawl Scheduling
Scheduling automated
recrawling ensures you're always up-to-date. You can establish a
daily, weekly or monthly schedule.
Crawl Reporting
The results of every crawl are available at all times to help
diagnose problems or determine what areas of the site are being
captured.
Initial Posts
Before crawling your account, Spiderline can make a series of
HTTP POSTs to your website, establishing secure sessions or
triggering other functionality.
|
|
Support for Robots.txt
Spiderline supports the robots exclusion protocol
for controlling where our spider will crawl.
Word Stemming
Applying all possible word endings to every search word,
Spiderline supports standard affix files for precise
translations.
Custom Stopwords
A list of words which should not be indexed because they
are too common to be useful. Each account has its own
copy to edit.
Document Support for Word, PDF, RTF, XML, etc
All versions of Microsoft Word documents are indexed as
well as Adobe Acrobat PDF, rich text, XML, and other formats.
|
|
Support for Robots META Tag
You can indicate if a page may or may not be indexed or
analysed for links through the use of a special HTML META tag.
Robots Section Exclusion
Spiderline supports the upcoming standard for applying robots exclusion
rules to arbitrary sections of a document. You can identify section
which should not be indexed or followed.
Custom Synonyms
A list of synonyms used for expanding search terms.
Each account has its own copy to edit.
|
|
Image ALT Tags
We index these words, too, and allow you to control their
weighting as well.
HTTPS (SSL) Support
If your website can only be reached through a secure connection,
our crawler will also use SSL technology to access your documents.
Session ID Support
If your website uses session IDs in the URL or cookies, our
crawler will maintain these IDs throughout its crawl.
|
|
Template Design
If you know HTML, changing the design of your search result
pages is a snap. You can freely edit your search results template.
A list of variables are used for dynamic HTML.
Last Modified Date
Each document shown in the search results can indicate its
last modification date.
|
|
Predesigned Templates
Whether you know HTML or not, you will find our selection of
ready-made designs useful to get up and running quickly.
No Advertisements
You can advertise if you like, it's your page to do with as you
please, but Spiderline will never place advertisements on your
search results.
|
|
Custom Design Service
With select service plans, we will customize your search
results page to match your site design seamlessly for no additional fee!
No Logo Required
Spiderline does NOT require our logo to be shown on search result
pages. Your absolute control is our number one priority.
|
|
Boolean Searches
Support for full boolean queries using
AND, OR, NOT, and parenthesis grouping is accepted. You
can turn this support off as well.
Substring, Wildcard Searches
Full support for partial word and wildcard expression searches.
XML Formatting
For integration with search results from other databases,
or for other programming tasks, you can request XML output
for search results to make parsing search results easier.
Click-Through Tracking
Spiderline is the only search engine which offers tracking
of which documents customers have been viewing the most.
|
|
Subsection Searching
If your website has a lot of content, you can split it into
separate search categories to refine search results further.
Private Labeling
Not only will we let you totally control your search results
page design, you can also use your own domain name so your
customers will have no way of knowing Spiderline is behind the
scenes.
Referrer Report
Not only will you know what your customers are looking for,
but you'll know from what pages they chose to run their searches.
|
|
Matches Per Page
The default number of matches shown on each page can be set,
as well as offered as a search form control for users.
Raw Query Logs
You can view summary reports of activity on your account
through our website or download the query logs yourself
for importing into a spreadsheet or other application.
|