Google Won't Crawl Links in Scalable Vector Graphics

Before and after diagram contrasting iframe embeds with server composed components that render into one indexable document.

Goodbye iframes at the BBC

A case study from the BBC team on the impact of moving from iFrames to the…
Learn More
Sequence diagram of Googlebot sending an If None Match header and the server replying 304 Not Modified or 200 OK with a fresh ETag.

Does Googlebot Use Etag Headers?

An experiment to detect if Googlebot uses Etags to help boost crawl budget efficiency.
Learn More
Three step diagram showing how reflected input, Googlebot JavaScript rendering, and injected markup can poison the search index.

XSS attacks on Googlebot allow search index manipulation

An experiment where Tom Anthony writes up how he manipulated Google search using XSS attacks.
Learn More
Diagram showing how Googlebot lowers its crawl rate when a site slows down and how rankings recover once performance is fixed.

How Google Treated A Major Site Performance Problem From A Crawling And Ranking Perspective

A case study which shows how a load balance stopped Googlebot from crawling and indexing pages.
Learn More
Diagram outlining a five step Googlebot log file study, from collecting server logs to steering crawl toward revenue pages.

Here's what happened when I followed Googlebot for 3 months

An experiment which follows how Googlebot discovers and crawls pages on a website.
Learn More
Diagram of an SEO crawler and the Google Search Console Page with redirect report surfacing unexpected 302 temporary redirects, which are then fixed to 301 permanent redirects and recrawled.

Night of the Living 302s: How SEO Crawlers and GSC’s Index Coverage Reporting Helped Me Surface A Sinister 302 Redirect Problem [Case Study]

A case study which shows the impact of 302 redirects across key pages on a large…
Learn More

Get new blog posts by email: