Before we dive into why we decided to use direct-wired architecture – let’s talk about what direct-wired actually is.
So, what is a direct-wired architecture?
In a server with direct-wired architecture, there is a 1 to 1 connection for the drive to the system with the full throughput of each drive in the server. The drives connect through a card called the LSI 9305. The LSI 9305 is the standard option, although others are available.
This card has 4 ports, each available to connect to 4 SATA or SAS hard drives. Connected to the LSI card is a custom cable that connects on one end to the LSI card through an SFF8643, which fans out to 4 SATA connectors. This way, there are 4 drives per port which work well with the 15 drives per row that connect to one card. Connecting the cables this way provides high bandwidth. To hear our lead engineer explain our direct-wired architecture in more detail – watch this video.
So why did we decide on direct-wired architecture?
The original servers used 9 port-multiplying backplanes. Each backplane had five SATA hard drive connectors, and one SATA cable connector that connects the backplane to a SATA controller plugged into the motherboard. This allowed up to five hard drives to be plugged into the board, multiplexed, and sent to a shared SATA port through one cable. Expand this out nine times, and you get 45 HDD densely packed into a storage chassis. Therefore, 45Drives required only nine cables and SATA ports. This was and still is economical as well as practical for a large number of machines.
Caveats were included:
When manufacturing servers Backblaze’s, we noticed that their needs were different from the needs of other storage users, and Protocase ended up customizing about 50% of ordered servers.
Many of the changes included:
Eventually, backplanes (CFI-B53PM (SIL 3726)) went end of life, and the need of meeting several criteria compounded the challenge of finding a replacement:
At this point, we were also having interesting exchanges with engineers at Netflix, who, as many know, build their own storage servers to stream video to their customers. They were successfully making direct-wired connection architecture work on a large scale.
We and Backblaze agreed that this approach had certain advantages and began developing the Pod 4.0 architecture (otherwise known as the Storinator), based on an inventive leap of fixing connectors on ‘wired backplanes’ so drives could be mounted in the same configuration as previous servers.
Eventually, Backblaze went back to a backplane-based design because it made more sense within their business model and technology context.
Although most of those who bought the earlier backplane-based pods did just fine, we saw too many users struggle to make this class of machine work for them. However, once we got through our early cable and driver problems, we saw the load on our support team drop dramatically, and users were delighted by the performance going way up!
So, direct wired became our thing.
Sign up to be the first to know about new blog posts and other technical resources