Monitoring the FAST Search Web crawler

  • Article

 

Applies to: FAST Search Server 2010

You can monitor the FAST Search Web crawler using SCOM, the crawleradmin tool, the beadmin tool or by analyzing logs.

SCOM and the command line tools give overall status and statistics information on the FAST Search Web crawler and its crawl collections. While the FAST Search Web crawler logs and the command line tools provide information on URL granularity and provide debug information.

Essential information you should monitor is:

  • The overall Web item request rate;

  • The number of Web items stored;

  • The number of Web items crawled per cycle;

  • The overall health of the FAST Search Web crawler and the Browser Engine.

Important

It is important to monitor a crawl collection in its first cycle, to ensure that the crawl collection is configured and behaving as intended.

In this section: