Crawler

This tab acts as a triggering point for on demand crawling.

The crawler is being used to identify all your website's pages. Once the crawling process is complete, the identified pages can be viewed via RSSeo! Pages tab.

By default it offers general control buttons - Start, Pause and Continue along with on progress status:

  • Current URL
  • Level
  • Pages Scanned on the current Level
  • Remaining pages for this level
  • Total Pages

Option to skip links that have rel="nofollow" when crawling.

 

Note:

Since version 1.20, RSSeo! Crawler has been been improved and besides the existing "loopback connections" based crawler we have added the option of crawling pages through AJAX.


3 persons found this article helpful.


Was this article helpful?

Yes No
Sorry about that

You Should Also Read

What can RSSeo! do for your site ? HOT

Keywords Replacements HOT

Redirects