Crawl budget

The amount of crawling search engines can allocate to a website during a given period.

SFT perspective

A discovery constraint particularly relevant to large sites. Server logs and crawl reports help document the resources explored.

Relevant pillars : Structure