I recently heard a rumour that Cisco was coming out with an 8 port Fabric Extender (FEX) for the UCS 5108, so I thought I’d take some time to see what this would look like. NOTE: this is purely speculation, I have no definitive information from Cisco so this may be false info.
Before we discuss the 8 port FEX, let’s take a look at the 4 port UCS 2140XP FEX and how the blade servers connect, or “pin” to them. The diagram below shows a single FEX. A single UCS 2140XP FEX has 4 x 10Gb uplinks to the 6100 Fabric Interconnect Module. The UCS 5108 chassis has 2 FEX per chassis, so each server would have a 10Gb connection per FEX. However, as you can see, the server shares that 10Gb connection with another blade server. I’m not an I/O guy, so I can’t say whether or not having 2 servers connect to the same 10Gb uplink port would cause problems, but simple logic would tell me that two items competing for the same resource “could” cause contention. If you decide to only connect 2 of the 4 external FEX ports, then you have all of the “odd #” blade servers connecting to port 1 and all of the “even # blades” connecting to port 2. Now you are looking at a 4 servers contending for 1 uplink port. Of course, if you only connect 1 external uplink, then you are looking at all 8 servers using 1 uplink port.
Introducing the 8 Port Fabric Extender (FEX)
I’ve looked around and can’t confirm if this product is really coming or not, but I’ve heard a rumour that there is going to be an 8 port version of the UCS 2100 series Fabric Extender. I’d imagine it would be the UCS 2180XP Fabric Extender and the diagram below shows what I picture it would look like. The biggest advantage I see of this design would be that each server would have a dedicated uplink port to the Fabric Interconnect. That being said, if the existing 20 and 40 port Fabric Interconnects remain, this 8 port FEX design would quickly eat up the available ports on the Fabric Interconnect switches since the FEX ports directly connect to the Fabric Interconnect ports. So – does this mean there is also a larger 6100 series Fabric Interconnect on the way? I don’t know, but it definitely seems possible.
What do you think of this rumoured new offering? Does having a 1:1 blade server to uplink port matter or is this just more
Pingback: Kevin Houston
1:1 is needed to compenstate for over subscription. UCS has already had some industry watchers mention that this is an issue, and as we see with Intel Nehalem EX's massive power, the idea of having hundreds of VM's on 2 servers using the same link its a no brainer that a bottleneck will occur down the road. Kudos to Cisco for being ahead of that curve!
Adam – thanks for your comments on the #Cisco 8 port FEX for the UCS!
Pingback: Kevin Houston
probably they need it to give more IO for servers . they in good direction with the UCS system
Pingback: Kevin Houston
Pingback: unix player
What “oversubscription”?
8 servers – 8 x 10GE DCB connections. (Both FEX are Active)
Each server has it’s own 10G LOSSLESS ethernet connection. First understand the effects of the new protocol standard then understand the technology.