London Web Factory

LWF SEO Web Spider: Standard and Pro Feature Comparison

LWF SEO Web Spider can run as the Standard app or as LWF SEO Web Spider Pro after a valid registration is confirmed.

The current Pro difference is crawl speed availability. Reports, exports and page analysis remain available in Standard.

Feature Standard Pro
In-app browser Yes Yes
Google search or direct URL entry Yes Yes
Recent crawl history suggestions Yes Yes
Page analysis sidebar Yes Yes
Rendered DOM extraction Yes Yes
Same-host website crawling Yes Yes
Crawl window Yes Yes
Internal Links results table Yes Yes
External Links results table Yes Yes
External header checks Yes Yes
URL details drawer Yes Yes
Overview, Inlinks, Outlinks, Resources, Redirects and Headers details Yes Yes
Filter results Yes Yes
Sort results Yes Yes
Resize table columns Yes Yes
Persistent internal column visibility Yes Yes
CSV export Yes Yes
Custom crawler User Agent Yes Yes
Local SQLite crawl storage Yes Yes
Local SQLite crawl history Yes Yes
Help menu legal documents Yes Yes
Gentle crawl speed Yes, 1 rendered worker and 1 asset worker Yes, 1 rendered worker and 1 asset worker
Balanced crawl speed No Yes, 6 rendered workers and 6 asset workers
Fast crawl speed No Yes, 12 rendered workers and 12 asset workers
Product name LWF SEO Web Spider LWF SEO Web Spider Pro
Registration key required No Yes

Which Version Should I Use?

Use Standard when:

  • you are testing a small site;
  • you want a cautious first crawl;
  • you do not need concurrent rendered workers;
  • you are learning the app.

Use Pro when:

  • you crawl larger sites regularly;
  • you have permission to crawl at a higher request rate;
  • you want Balanced or Fast mode;
  • you need to reduce crawl time on sites that can safely handle more requests.

Notes About Adverts

The free app is funded through adverts and product messages. The current application can display London Web Factory managed messages in the splash screen and status bar. Registration currently unlocks speed modes; it does not change every advertising or message surface unless a later release says otherwise.