Crawl Master

Desktop SEO crawler and site audit tool

See what's wrong with your site. Fix the worst first.

Crawl Master is an SEO crawler for Windows. It checks your whole website for broken links, technical SEO, accessibility and spelling problems, and ranks them by how much they matter, with every affected page one click away.

  • No card for the trial
  • No URL limit
  • No subscription
Crawl Master
Crawl Master's issues view: problems ranked by priority, with the selected issue explained
A real crawl of books.toscrape.com, a practice site made for testing crawlers.
  • WCAG 2.2 AA accessibility checks
  • No limit on URLs or saved crawls
  • 19 languages for spelling checks
  • £100 once, not every year

What other crawlers leave out

A technical SEO audit that goes further

Most SEO crawlers give you thousands of rows and leave the rest to you. Crawl Master checks the things your visitors and clients actually notice, and none of it is a paid add-on.

An accessibility checker that knows the law

Every page is tested against WCAG 2.2 AA. Crawl Master then tells you which failures the law in your market points to: the UK's Equality Act and public sector rules, the European Accessibility Act, or the ADA and Section 508 in the US.

  • Deep scan uses pages the way a keyboard or zoom user would: it tabs through, zooms to 200%, narrows to phone width and checks contrast over images.
  • Sends forms empty (nothing is ever submitted) to check that errors are shown and announced.
  • Says plainly what still needs a person to test by hand.
Accessibility results against UK, EU and US standards, with the deep scan panel

A website spell checker for the typos clients spot first

Spelling and grammar are checked on every page's main text, in the page's own language, with UK or US English as you choose. Menus, footers and code are skipped.

  • 19 languages, from English and French to Welsh and Greek.
  • Spots brand and product names used across the site, so they aren't counted as mistakes. Add them to the dictionary in one click.
  • Readability scores for every page, and pages whose content doesn't match their topic.
Spelling and grammar view: mistakes in context and likely names to add

See how you look in Google, and rewrite it there and then

Every page is shown as a desktop and mobile search result, measured in pixels the way Google cuts titles off. Edit the title or description and watch the result change.

  • Filter to results that get cut off, or have no title or description.
  • Download your changes as a list for whoever updates the site.
Desktop and mobile search result previews with editable title and description

See the shape of your site at a glance

A map of every page and how it's reached, coloured by status. Orphan pages, deep pages and dead ends stand out straight away.

  • Crawl diagram, sitemap view, directory tree and depth by directory.
  • Click any page to see everything about it.
Site structure map of 1,195 pages laid out by shortest crawl path

Page weight and carbon for every page

See how heavy each page is and its estimated carbon per visit, rated A+ to F using the Sustainable Web Design Model. Useful for green reporting, and a quick way to find bloated pages that load slowly.

  • Click a rating to see just those pages.
  • Export it all to CSV.
Page weight and carbon view: CO2e per page view and pages rated A+ to F

All included

Everything else you'd expect, and plenty you wouldn't

Every feature comes with every licence. Nothing is locked behind a higher tier.

Tells you how sure each finding is

Every issue is labelled: Google requirement, Google recommendation, web standard, industry study, convention or best practice, with sources and dates. Stop chasing SEO myths, and show clients why a fix matters.

Claude built in

Connect to Claude in one click. Ask it to crawl a site, explain the problems and compare crawls. Developers can say "crawl localhost:3000 and fix the high-priority issues".

Show it on the page

Open any page with its problems outlined in place: broken links, missing alt text, small tap targets, failing accessibility checks and misspelt words. Analytics are blocked, so you don't skew the stats.

Staging against live

Compare any two crawls, even on different addresses. See what's new and what's fixed for every issue before you launch.

Fixed means fixed

Mark an issue fixed and it's hidden until the next crawl. If it's still there, it comes back flagged, so nothing slips through.

Cookie banners handled

Recognises the common cookie banner tools. Leave them as search engines see them, or reject or accept so they don't hide what's being checked.

Scheduled crawls with alerts

Re-crawl a site daily, weekly or monthly, save the CSVs to a folder, and get a desktop alert when new problems appear.

AI on every page

Run your own prompts on every page: classify intent, suggest better titles, summarise content. Use Claude, OpenAI, Gemini, or Ollama on your own computer.

Your data alongside

Pull in Search Console, Analytics and PageSpeed, plus Ahrefs, Majestic and Moz, using your own accounts. Keys stay on your computer.

Structured data and rich results

JSON-LD, Microdata and RDFa validated against Schema.org and Google's rich result rules, with "did you mean" hints for typos.

Custom extraction

Pull any value from every page with CSS, XPath or regex, count matches, or run your own JavaScript. Each one gets its own column.

Command line and CI

Run crawls from a script, export CSVs, and fail a build when high-priority problems appear.

Fast, and polite

Checks pages on every core of your computer, several times faster than using one. If a site starts rate-limiting, it slows down and retries by itself.

Unlimited URLs

Crawl a 50 page brochure site or a huge online shop. No cap, every crawl saved, and big crawls can pause and resume.

Private by design

Crawls stay on your computer. No cloud account, no tracking, nothing uploaded.

Made for people who fix websites

Agencies

Hand clients a ranked list with the evidence for each fix, then prove the work with a before and after comparison.

Freelancers

Every feature for one payment. No yearly bill eating into a small job.

Developers

Crawl localhost before launch, fail the build on serious problems, or let Claude fix them as you work.

In-house teams

Schedule a weekly crawl and get told when something breaks, before your customers notice.

Around 50 checks, plus full audits

Each problem comes with the affected URLs, the pages that link to them, and how to fix it.

  • Broken links (4xx)
  • Server errors (5xx)
  • Redirect chains and loops
  • Blocked by robots.txt
  • Noindex and nofollow
  • Canonicals
  • Page titles
  • Meta descriptions
  • Headings
  • Thin content
  • Exact and near duplicates
  • Placeholder text left in
  • Image size and alt text
  • HTTPS and mixed content
  • Security headers
  • Page speed
  • Mobile usability
  • URL structure
  • Sitemaps and orphan pages
  • Internal linking
  • External links
  • JavaScript rendering
  • Structured data
  • AMP
  • Accessibility (WCAG 2.2 AA)
  • Spelling and grammar
  • Readability

Up and running in minutes

  1. Download

    Install Crawl Master on Windows. No account and no card needed.

  2. Crawl

    Type in a website address and pick a quick check or a full audit. Results appear as it goes.

  3. Fix

    Work down the list from the top. Crawl again to prove it's fixed.

One price. Pay once. Keep it.

Most SEO tools charge you every year, and stop working when you stop paying. Crawl Master is a one-off payment with updates included.

Crawl Master licence

£100 one payment

For one person, on any number of their own computers.

Buy Crawl Master

Or try it free for 14 days

Secure checkout by Stripe. Any VAT or sales tax for your country is shown before you pay. Your licence key arrives by email straight away.

  • Every feature and every check
  • Unlimited URLs and saved crawls
  • Accessibility, spelling and carbon audits
  • Claude connection and command line
  • Scheduled crawls and comparisons
  • Use it on all your own computers
  • Updates and email support
  • No subscription, no renewal
30-day money-back guarantee. If it's not right for you, email within 30 days and you'll get a full refund. No forms, no arguments.

Questions

How does the free trial work?

Download the app and use every feature for 14 days. You don't need to give card details. When the trial ends, you can still open and export the crawls you saved. Starting new crawls needs a licence.

Is it a subscription?

No. You pay once and the licence is yours. It includes updates and email support.

How many computers can I use it on?

A licence is for one person, and they can use it on any number of computers they own or control. A business buying for several people needs one licence per person.

Will crawling slow down my site?

You choose how many pages it fetches at once and can add a pause between requests. If a site starts to push back, Crawl Master slows down and retries by itself, and speeds up again once things settle.

Is the accessibility audit legal advice?

No. It shows which failures each law points to, which is a big head start, but automated checks only find some accessibility problems. A full audit also needs testing by a person, and Crawl Master tells you what to check by hand.

What if it's not right for me?

Email josh@higginsdevelopment.co.uk within 30 days of buying and you'll get a full refund. See the terms and refund policy.

Which systems does it run on?

Windows 10 and 11 today. A Mac version is on the way.

Can I bring in crawls from another tool?

Yes. You can import a Screaming Frog "Internal: All" CSV export and see it in Crawl Master's issues-first view.

Does it send my data anywhere?

No. Crawls are stored on your computer. The app only checks your licence key about once a week. Optional connections, like Google Search Console or an AI provider, use your own accounts and go straight from your computer to that service. See the privacy policy.

Who makes it?

Crawl Master is made by Josh Higgins at Higgins Development, a small software business in the UK. Questions go straight to him at josh@higginsdevelopment.co.uk, and he usually replies within 2 working days.

Find out what's wrong with your site today

14 days free. No card. No URL limit. Then £100 once, if you love it.