Keeping Googlebot Happy Revisited
I stumbled upon an older blog post I wrote a couple of years back discussing the advantages of keeping your site fast, specifically so Google can crawl it efficiently to…
I stumbled upon an older blog post I wrote a couple of years back discussing the advantages of keeping your site fast, specifically so Google can crawl it efficiently to keep their index as fresh as possible. I loaded up Google’s Webmaster Tools to see what kind of numbers we’re doing these days and was pretty happy with the results.
March 3, 2009
October 8, 2011
The graphs speak for themselves, but I’m pretty proud of the fact that we’ve been able to simultaneously increase the number of pages crawled per day while cutting the average page download time by a significant amount.
Here’s to keeping things fast and fresh!
Written by
Related posts
Still a developer. Just outside. Our latest GitHub Shop collection is here.
The ESC collection lets you escape the confines of your desk and get out into the sun where good ideas are bound to happen.
Take your local GitHub sessions anywhere
Kick off work in VS Code or the CLI, finish it from your phone. Remote control for GitHub Copilot sessions is now generally available on github.com and GitHub Mobile.
GitHub availability report: April 2026
In April, we experienced 10 incidents that resulted in degraded performance across GitHub services.