LWF SEO Web Spider Help

LWF SEO Web Spider is a desktop SEO crawler from London Web Factory. It combines a visible in-app browser, rendered page analysis, live crawl results, CSV export and local SQLite storage.

This help directory is written in Markdown so it can be published on a website or bundled into product support pages.

Publication Order

Publish the help files in this order:

What the App Does

The app lets you:

open websites in a controlled in-app browser;
analyse the currently loaded page;
crawl same-host pages and assets;
inspect internal and external link targets;
check external link response headers;
filter, sort and resize crawl result columns;
open URL details for crawled rows;
export crawl results to CSV;
keep crawl history and settings locally.

Choosing the Right Guide

Start with Quick Start for the shortest path through one analysis and crawl.
Use Crawling a Website for controls, scope and day-to-day crawl operation.
Read How the Crawler Works when you need the discovery, rendering, normalisation, redirect, robots and storage rules.
Read How Link Metrics Are Calculated to understand why A Tags, Outlinks, External Outlinks, Inlinks and their unique versions differ.
Use the Result Variables and Column Glossary as the complete reference for table, Page Analysis and URL Details fields.

Important Notes

Only crawl websites that you own, manage, or have permission to test. Crawling originates from your computer and public IP address. Target websites, hosting providers, network operators or security services may rate-limit, block or blacklist requests.

LWF SEO Web Spider stores crawl data locally in SQLite while the crawl is active. Export any crawl results you need before starting another crawl.

The help pages describe the current application behaviour for version 0.1.0.