Technical SEO

Crawl budget

The amount of crawling a search engine will do on your site in a given period - relevant mainly for large sites.

Crawl budget is roughly how many of your pages a search engine will fetch within a window of time. For most small sites it's a non-issue, but on large sites, wasting it on duplicate URLs, endless parameters, or thin pages can mean important pages get crawled less often.

Clean site structure, correct canonicals, a good sitemap, and pruning low-value URLs all help a search engine spend its crawl budget on the pages that matter.

Further reading

Related terms

Want to see how your page measures up on this and more?

Free first audit

Ready to see what's holding your site back?

Run one page through AuditCrow and get a clear, prioritised report on what is standing between your site and the job you need it to do.

One page free · Plain-language fixes · Your first taste of the full platform