Skip to content
TheSoftwarePick
Submit a tool

Screaming Frog SEO Spider

FreemiumTop pick

The industry-standard desktop crawler for technical SEO audits, free for up to 500 URLs.

Overview

Screaming Frog SEO Spider crawls a website from your own computer, like a search engine would, and reports on over 300 SEO issues, including broken links, redirects, page titles, meta descriptions, canonicals, directives, hreflang, duplicate content and structured data. The paid licence removes the 500-URL limit and adds JavaScript rendering, scheduling, crawl comparison, custom extraction, Google integrations and AI-powered crawling with OpenAI and Gemini.

Who it's for

Technical SEOs, agencies and developers who want maximum control over site audits and migrations, at a low annual price.

Our Screaming Frog SEO Spider review

The short version

Screaming Frog SEO Spider is the crawler almost every technical SEO uses. You enter a URL, it crawls the site from your computer, and you get a detailed picture of every page: status codes, redirects, titles, meta descriptions, canonicals, hreflang, structured data and much more. It finds over 300 kinds of SEO issues.

The free version crawls up to 500 URLs, which covers many small sites. A licence costs £199, or $279, per user per year, and unlocks unlimited crawling and the advanced features professionals rely on.

How Screaming Frog works

You download the app for Windows, macOS or Linux, enter a starting URL and start the crawl. Results appear in tabs and filters, such as client errors, missing titles, duplicate pages, non-indexable URLs, and each issue can be exported in bulk to share with developers. You can also upload a list of URLs, which is ideal for checking redirects during a site migration.

With a licence, you can render JavaScript sites built with React, Angular or Vue, extract any data from pages with XPath, CSS Path or regex, connect Google Analytics, Search Console and PageSpeed Insights data to every URL, compare crawls over time or staging against production, schedule crawls and run it from the command line. Newer AI features let you send page content to OpenAI or Gemini during a crawl, for example to generate alt text or classify pages.

Pricing

From Screaming Frog's licence page:

Version Price What you get
Free £0 Crawl up to 500 URLs; core audits for broken links, redirects, titles, meta data, directives, hreflang, duplicates, sitemaps and visualisations
Paid licence £199 / $279 per user per year Unlimited URLs, save and open crawls, JavaScript rendering, crawl comparison, scheduling, custom extraction, Google integrations, AI crawling and more

Licences are per user, so two people need two licences. Bulk discounts apply: $265 each for 5–9 licences, $249 for 10–19 and $235 for 20 or more.

Who it's for, and who should look elsewhere

A good fit if you:

  • do technical SEO audits or site migrations
  • want full control over what's crawled and extracted
  • want a powerful crawler for a low yearly price
  • are happy working in a desktop app with exports

Look elsewhere if you:

Bottom line

Screaming Frog is the best-value professional SEO crawler, and the free version is enough for small sites. If you do technical SEO regularly, the licence pays for itself quickly. Compare it in Screaming Frog vs Sitebulb and our site crawlers roundup.

Key features
  • Crawl sites to find broken links, server errors and redirect chains
  • Analyse page titles, meta descriptions, headings and directives
  • Audit hreflang, canonicals and structured data
  • Exact and near-duplicate content detection
  • XML sitemap generation and site architecture visualisations
  • JavaScript rendering with an integrated Chromium browser (paid)
  • Custom extraction with XPath, CSS Path or regex (paid)
  • Scheduled crawls, command-line automation and crawl comparison (paid)
  • Google Analytics, Search Console and PageSpeed Insights integrations (paid)
  • Crawl with OpenAI and Gemini prompts (paid)
Pros
  • Extremely flexible; handles almost any technical audit
  • Generous free version for sites up to 500 URLs
  • Low-cost annual licence compared with cloud crawlers
  • Runs on Windows, macOS and Linux
  • Excellent for site migrations and staging comparisons
Cons
  • Steep learning curve for beginners
  • Large crawls need a powerful computer
  • Desktop software, so no built-in team dashboards like cloud crawlers
  • Licences are per user

Compare Screaming Frog SEO Spider

Sources

Facts and pricing checked against these pages in November 2026.

Screaming Frog SEO Spider alternatives

See all 3