How to attracting Search engine spiders at your site.

[Rodney]

Is there a fixed time frame or period after which the search engine spiders crawl a web site? Are there any specific tips to constantly attract the SE spiders?

[Peter]

Once all the pages of a website are indexed, the site is then revisited on a regular basis to determine if any new content has been added, or if there have been any significant updates to the already indexed content. Sites generally get re-crawled based on a variety of factors, including the frequency of content updates or even the command in a page's code that asks the spider to return after every "X" no. of days.

[sanderson]

One of the main factors is how often your site has been visited or viewed by the visitors. For most of the search engines this factor is most important. And spiders of these search engines will visit your site more frequently to get updated on the content of the site. Know that not all type of spiders crawl your site, as there are different spiders for different functions. Some are specially for indexing, some visits for investigation, some are for page content and themes… etc.

How to attract SE Spiders?
Constantly give them some goodies, add fresh content. Some even says that they have seen for crawl frequency is also depends on page rank; a page with higher rank will be crawled more frequently than a page with a lower rank... interesting! So be ready to optimize your pages for even higher rank.