Nodeload Metrics
Nodeload 2 has been rocking since August, so I thought I’d give a quick report of its performance. Nodeload is the system responsible for dynamically building and delivering your Git…
Nodeload 2 has been rocking since August,
so I thought I’d give a quick report of its performance. Nodeload is the
system responsible for dynamically building and delivering your Git repositories as
zip files.
Nodeload is composed of two Node.js apps. A proxy app routes download requests to one of the 32 file servers (including failovers), and proxies the zip files back to the user. The file
servers also run an archiver app that delivers git-archive
contents over HTTP.
We started instrumenting various details about the running applications months
ago to help troubleshoot problems. We can see how much zipped Git data is
written, how much data is sent, memory usage, and active connection count.
When Nodeload has problems, we can use these graphs to help pinpoint the cause.
This morning, I noticed that Nodeload hit a new record: over 1GB of Git data
sent to users in a one minute duration.
Here’s one of the cool Boundary graphs from about 15 minutes after the above
time period. It’s the throughput on the Nodeload proxy server per second, averaged
over the last 10 minutes.
This amounts to about 70GB data sent every day. I wish we had the
amazing StatsD and Graphite setup
several years ago that we have now, for comparisons.
Overall, we’ve been very happy with the Nodeload apps. Node.js makes it really
easy to prototype streaming servers through its simple and consistent streaming
APIs. Part of me would like to experiment with servers in other
languages and frameworks, but the more pragmatic side loves that we can focus on
other real problems for now.
Written by
Related posts
![](https://github.blog/wp-content/uploads/2023/10/Collaboration-DarkMode-2.png?resize=400%2C212)
2024 is the biggest global election year in history. What’s at stake for developers?
GitHub is considering what is at stake for our users and platform, how we can take responsible action to support free and fair elections, and how developers contribute to resilient democratic processes.
![](https://github.blog/wp-content/uploads/2023/10/AI-DarkMode-2.png?resize=400%2C212)
GitHub named a Leader in the Gartner first-ever Magic Quadrant for AI Code Assistants
This year, as part of its annual Magic Quadrant series, Gartner published a first-of-its-kind report analyzing the state of play in the AI Code Assistants market–and named GitHub a Leader.
![AI in software development 2024 survey results with colorful graphics and percentages.](https://github.blog/wp-content/uploads/2024/08/ai-survey-header.png?resize=400%2C212)
Survey: The AI wave continues to grow on software development teams
We surveyed 2,000 people on software development teams at enterprises in the U.S., Brazil, India, and Germany about the use, experience, and expectations around generative AI tools in software development.