Keeping Googlebot Happy Revisited
I stumbled upon an older blog post I wrote a couple of years back discussing the advantages of keeping your site fast, specifically so Google can crawl it efficiently to…
I stumbled upon an older blog post I wrote a couple of years back discussing the advantages of keeping your site fast, specifically so Google can crawl it efficiently to keep their index as fresh as possible. I loaded up Google’s Webmaster Tools to see what kind of numbers we’re doing these days and was pretty happy with the results.
March 3, 2009
October 8, 2011
The graphs speak for themselves, but I’m pretty proud of the fact that we’ve been able to simultaneously increase the number of pages crawled per day while cutting the average page download time by a significant amount.
Here’s to keeping things fast and fresh!
Written by
Related posts
GitHub Universe 2026: Evolving every layer of the stack
Today, we laid out our vision for GitHub as the most comprehensive, end-to-end software delivery system in the world.
Octoverse: Commits, pushes, reach new highs in 2026 as developers build with agents
See how a record year of growth reached every industry, every field, and every kind of builder in the 2026 Octoverse report.
The next developer interface is ambient intelligence
AI, agents, voice, and physical controls are shifting software development from operating tools to expressing intent—and helping developers stay focused on building.