Technology1 min read

Inside GitHub’s new Git storage architecture

By · Published by Everything Blog

In short

The overhauled backend addresses future sustained workloads where continuous integration systems face massive read fan-out from nonstop automated commits. By restricting synchronization solely to reference updates, multiple distributed writer nodes can accept changes concurrently without cross-node contention. Internal testing validated that the platform can absorb thousands of simultaneous agent pushes on a single project while sustaining low read latency.

Key points

  • The storage system targets vertical scale to accommodate thousands of automated agents pu…: The storage system targets vertical scale to accommodate thousands of automated agents pushing to the same repository simultaneously.
  • Decoupling compute from storage allows multiple writer nodes to distribute intensive task…: Decoupling compute from storage allows multiple writer nodes to distribute intensive tasks and minimize commit latency.
  • Future continuous development workloads are projected to produce round-the-clock write tr…: Future continuous development workloads are projected to produce round-the-clock write traffic that drastically exceeds traditional human burst patterns.

Sources checked by our analysis pipeline: 1

Inside GitHub’s new Git storage architecture

GitHub’s new Git storage architecture is built so thousands of agents can push to a single repository at once. Here’s how it works.

Last week at GitHub Universe, we announced our new Git storage architecture, capable of handling thousands of writes per second with reads that scale on demand. Through internal testing, we’ve demonstrated the ability to support 5,000 concurrent agents working on a repository, sending 7,200 pushes per second to a repo, all while serving read traffic with consistently low latency. This new architecture is the foundation for GitHub to support agentic development for hundreds of millions of developers, and we’ve been building it underneath GitHub while it keeps running.

Over the past year, agents changed what a busy repository looks like on GitHub. In our first post in this series, we laid out the two principles behind our next-generation Git storage architecture: minimize coordination, and decouple storage from compute. In our last post, we covered the bridge: moving 99.99999% of repositories into Azure, scoping the write quorum to individual references, and standing…

Technology