Robots Restrictions (4 articles)

Disallowed JavaScript File: Why Blocking JS Can Break Rendering

The “Disallowed JavaScript File” issue flags an internal URL with a JavaScript content type that is…
Learn More

Disallowed Image: When Blocking Images in robots.txt Hurts You

Your robots.txt file tells crawlers which URLs they may and may not request. A "Disallowed Image"…
Learn More

Internal Disallowed URLs: Linking to Pages Google Cannot Crawl

Quick version: this flag lists internal links that point at URLs your own robots.txt blocks. Every…
Learn More

Disallowed Style Sheet: Why Blocking CSS Hurts Rendering and Mobile

A "disallowed style sheet" check fires when a CSS file your page loads is blocked by…
Learn More

Get new blog posts by email: