GLOSSARY

Crawl budget.

Crawl budget describes the resources a search engine allocates to crawling a site.

Why it matters

Large stores can generate many low-value combinations through filters and parameters. Focus discovery on useful pages and reduce unnecessary URL duplication.

Review crawler activity alongside your URL inventory and index coverage.

Put it in context

Use this concept alongside the relevant customer journey, business costs and measurement assumptions. A single metric rarely tells the whole story.

Explore Search