Servers & Indexer

This is the main page to configure servers you wish to index and server-specific indexing options. To add a new server press Append button.

Access parameters in Server settings

In Name field enter description for the server. URL - enter your server URL. Alias - enter your server alias, see Chapter 10., URL aliases for details. In Type menu select match type for your server or alias. Select follow mode: Page to index only one document, Path to index documents stored in the specified path only, Site to index all the documents belonging to current site and World to make indexer follow all external links. Use case menu to specify case sensitive or case insensitive comparison. If the server access is restricted, enter Login and Password to access the server.

Proxy parameters in Server settings

If you use a proxy server on your network, enter Proxy Address, Port, Proxy Login and Proxy Password.

Options parameters in Server settings

Configure server-specific indexing options here.

In Tag field you may assign a specific tag for the server

Specify a category of the server by filling the Category field

In Period field enter expiration period for the documents stored on the server in seconds (the default value is 604800 which stands for 1 week).

Limit number of Hops indexer may use to access the server.

Select Charset of the documents stored on the server.

Choose Default language of the server.

Specify Timeout for connection to the server in seconds, limit number of network errors (Net errors limit) and specify delay in seconds after network error occurs (Net errors delay).

If you want indexer to index ID3 information found in mp3 files, i.e. song title, artist name, etc., check the Check mp3 tag flag. Note that you have to allow indexing mp3 files first in the section called “Documents tab”.

Check Check only mp3 tag flag to index only data found in ID3 tags of mp3 files, and scan other documents for links only.

Modes parameters in Server settings

• Index: check this box to index server, uncheck to grab links only.
• Delete bad URLs: delete URLs with no corresponding document from database.
• Robots: check robots.txt file on server.

Weights parameters in Server settings

You can specify what parts of a document are to be indexed and taken into account in weight calculation. Body, title, keywords, description are supported.

Indexer page

Use this page to configure indexing options.

Options

By pressing Edit link you can configure the following options.

If you leave Add config URL's unchecked, indexer will process only those links that are already in the database, as previously indexed. Even if you add or remove Servers, this will not affect indexing. To index new URL's you may have added to the Servers list, check this option.

Check Expired first to start indexing with expired documents.

Check Force reindex to index all documents irrelevant if they are expired or not.

You may specify Delay in seconds between indexing each document.

Select number of Threads to start to use when indexing documents. More threads may require higher bandwidth.

Check Use log file and specify Log file name to store indexer messages in a text file.

In Log mode menu select type of messages to be written in log file.

Filters

Use these options to limit indexing according to any of the given parameters.

Filtering by status means limiting indexing to URLs with specific HTTP status, i.e. the HTTP code returned by the server. 0 is for "not indexed", for other codes see Chapter 14., HTTP codes.

You may limit indexing by URL. To do so, enter the URL you wish to limit indexing to.

To limit indexing by Tag and by Category, enter corresponding tag or category in the appropriate fields. Tag and Category can be assigned to a server

Search page

Here you can perform a test search.

Simply enter keywords in the Search for field and press Search! button. You may select number of results to display on one page (Results per page menu), Output format, Search mode (Match, Search for, through, in menus). The results are displayed below.

You may select different front-end to use in searching. To do so, select the desired front-end in Path to search.exe field.

It is possible to use several templates to display search results. In case multiple templates are used, every one of them is assigned an ID number. Press Templates button to add templates and assign unique ID number to each template.

Select ID of template to display search results with the Template drop-down menu.