Dell MD1000 and an x4 SAS connector throughput / layout

You'll be massively oversubscribed. A single 4-lane SAS link at 3Gbps == 12Gbps total throughput. There's an expander on each MD1000 enclosure, so your 45 (SAS or SATA) disks will easily saturate that link. That's a theoretical max throughput of 1.5 Gigabytes/second over that connection - 12 Gigabits/sec == 1.5 Gigabytes/sec.


I'm going to argue that while the theoretical sequential max throughput of all your disks is greater than the SAS chain can handle, with a backup server you may very well never reach that limit or come close to it.

Let's look at some limits in your system.

Theoretical max throughput of a 7.2k SAS drive ~ 1.2Gbit/sec (150 megabytes per second) Theoretical max throughput of 45 of your SAS drives= (45*1200) = 54Gbit/sec Theoretical max throughput of your SAS chain = 12Gbit/sec

So we're down to 12Gbit/sec so far.

How is your server connected to the DAS? 3Gb SAS? Ok, you've got 12Gbit again.

Your application is a backup server. Does it really have 12Gbit/sec connectivity to all of its backup clients? If so, can each client saturate the backup network (reading from their own disks) to the point where you would actually get 12Gbit/sec coming into the backup server? Probably not. That is a LOT of throughput! Your network would have to support that traffic. The backup server would have to have enough CPU to process all that traffic. Etc. etc.

My point is simply, if you have a couple of 1Gb NICs on this box and are using it for backup, you very well may never need to worry about the bandwdith of the SAS chain, because you'll never hit that limit before you max out your network or the throughput capabilities of your backup clients.

That said, if I could design the system myself, I would give you more SAS bandwidth, but my take away here is it may not be a problem in the real world at all.


All,

So here is the answer, the SAS back plane is basically just a huge bus architecture. It works very much like a hub (not a switch). The md1200's to some extent have no bearing on this. From a generic raid controllers perspective it just see's 45 drives. The lanes aren't being broken apart or anything like that. At least not between the chassis.

SAS, by in large is just a big single cable, the easiest way to think about it is Christmas lights. The cable is the path, and the lights are the HDD's.