Pagination No Links
The robots meta tag and the X-Robots-Tag HTTP header give the same instructions to search and…
TL;DR Faceted navigation (the filter and sort controls on category and listing pages) is one of…
TL;DR An XML sitemap is a machine-readable list of the URLs you want search engines to…
Every other tool you use to understand crawling makes an educated guess. A crawl simulator tells…
Robots.txt is tiny but unforgiving. The most common mistakes that block crawling, leak the wrong rules,…
Get new blog posts by email:
Technical SEO consulting and GEO strategy for teams who need real implementation support. 20 years of enterprise experience across major media, technology, recruitment, and ecommerce brands, and a major enterprise brand. Case studies, research, and resources for search and AI visibility.